Jul 14 11:06:53.435428 ip-10-0-128-125 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 11:06:53.812094 ip-10-0-128-125 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 11:06:53.812094 ip-10-0-128-125 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 11:06:53.812094 ip-10-0-128-125 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 11:06:53.812094 ip-10-0-128-125 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 11:06:53.812094 ip-10-0-128-125 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 11:06:53.813707 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.813631    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 11:06:53.817714 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817701    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 11:06:53.817714 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817715    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817719    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817722    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817725    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817730    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817733    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817736    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817739    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817742    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817744    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817747    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817749    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817752    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817754    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817757    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817760    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817762    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817765    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817767    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 11:06:53.817780 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817770    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817773    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817775    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817777    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817780    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817782    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817785    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817787    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817790    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817793    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817796    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817798    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817800    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817803    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817805    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817807    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817810    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817812    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817814    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817816    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 11:06:53.818240 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817819    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817821    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817824    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817826    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817828    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817831    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817833    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817835    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817838    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817840    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817842    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817844    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817847    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817850    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817853    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817855    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817859    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817862    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817865    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 11:06:53.818687 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817867    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817870    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817872    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817874    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817877    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817879    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817882    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817884    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817886    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817888    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817891    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817893    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817896    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817898    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817901    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817903    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817905    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817908    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817910    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 11:06:53.819093 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817913    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817916    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817918    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817920    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817922    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817925    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817927    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817930    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817932    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817935    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817937    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817939    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817942    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817945    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817948    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817951    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817954    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817957    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817959    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817961    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 11:06:53.819522 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.817964    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819453    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819461    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819464    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819467    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819469    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819473    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819475    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819478    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819480    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819483    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819485    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819488    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819490    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819493    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819495    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819497    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819500    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819502    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819505    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 11:06:53.819987 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819508    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819510    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819513    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819516    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819519    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819523    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819527    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819530    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819532    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819535    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819538    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819540    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819542    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819545    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819547    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819550    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819552    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819554    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 11:06:53.820489 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819557    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819560    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819562    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819565    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819568    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819571    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819573    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819576    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819578    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819580    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819583    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819585    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819587    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819590    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819593    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819595    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819597    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819600    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819602    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819605    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 11:06:53.820878 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819607    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819609    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819611    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819613    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819616    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819618    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819620    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819623    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819625    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819628    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819630    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819632    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819634    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819637    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819639    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819643    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819646    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819648    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819650    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819652    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 11:06:53.821348 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819654    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819657    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819659    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819661    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819664    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819667    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819669    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819671    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819674    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819677    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819680    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819683    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819685    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819688    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819690    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819692    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819694    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819696    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819699    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819701    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 11:06:53.821792 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819703    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.819705    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820075    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820081    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820085    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820088    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820091    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820094    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820098    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820101    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820104    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820107    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820109    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820112    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820115    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820118    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820120    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820123    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820125    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 11:06:53.822251 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820128    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820130    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820133    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820135    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820144    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820157    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820160    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820163    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820165    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820168    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820170    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820173    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820175    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820177    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820181    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820184    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820187    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820190    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820192    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 11:06:53.822662 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820195    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820200    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820203    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820205    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820208    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820210    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820213    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820215    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820217    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820220    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820222    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820224    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820227    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820229    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820232    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820234    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820236    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820238    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820241    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820243    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 11:06:53.823074 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820245    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820248    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820250    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820252    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820255    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820257    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820259    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820261    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820264    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820266    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820269    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820271    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820273    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820275    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820278    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820281    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820283    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820286    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820289    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820291    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 11:06:53.823529 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820293    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820296    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820298    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820301    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820303    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820305    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820307    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820310    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820312    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820314    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820316    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820319    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820321    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820323    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820326    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820328    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820330    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820332    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820337    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820339    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 11:06:53.823973 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820341    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820344    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820346    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820403    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820409    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820416    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820420    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820424    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820427    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820430    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820434    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820437    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820440    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820443    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820446    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820448    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820452    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820454    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820457    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820460    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820462    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820467    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820470    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820472    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 11:06:53.824442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820475    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820479    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820482    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820485    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820487    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820491    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820497    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820500    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820503    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820506    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820509    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820512    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820515    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820518    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820521    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820523    2581 flags.go:64] FLAG: --enable-server="true"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820527    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820530    2581 flags.go:64] FLAG: --event-burst="100"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820533    2581 flags.go:64] FLAG: --event-qps="50"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820536    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820539    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820542    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820545    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820548    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820551    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 11:06:53.824961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820553    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820556    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820558    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820561    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820564    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820566    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820569    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820572    2581 flags.go:64] FLAG: --feature-gates=""
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820575    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820578    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820581    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820584    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820586    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820590    2581 flags.go:64] FLAG: --help="false"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820593    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-128-125.ec2.internal"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820596    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820598    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820601    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820604    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820607    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820610    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820613    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820615    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 11:06:53.825622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820618    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820621    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820624    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820627    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820630    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820632    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820635    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820637    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820640    2581 flags.go:64] FLAG: --lock-file=""
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820643    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820645    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820648    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820653    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820655    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820658    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820661    2581 flags.go:64] FLAG: --logging-format="text"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820663    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820666    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820669    2581 flags.go:64] FLAG: --manifest-url=""
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820671    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820675    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820678    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820683    2581 flags.go:64] FLAG: --max-pods="110"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820685    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820688    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 11:06:53.826171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820691    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820693    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820696    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820699    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820702    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820708    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820711    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820714    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820717    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820720    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820725    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820728    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820730    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820733    2581 flags.go:64] FLAG: --port="10250"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820736    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820739    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021d5876eeeb3d7d6"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820742    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820744    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820747    2581 flags.go:64] FLAG: --register-node="true"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820749    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820753    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820755    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820758    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820760    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820764    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 11:06:53.826989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820766    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820769    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820772    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820774    2581 flags.go:64] FLAG: --runonce="false"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820777    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820780    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820783    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820786    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820789    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820791    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820795    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820798    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820801    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820804    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820806    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820809    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820812    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820815    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820818    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820823    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820826    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820828    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820832    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820835    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820837    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 11:06:53.827982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820840    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820842    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820845    2581 flags.go:64] FLAG: --v="2"
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820848    2581 flags.go:64] FLAG: --version="false"
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820852    2581 flags.go:64] FLAG: --vmodule=""
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820855    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.820859    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820960    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820964    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820967    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820970    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820986    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820991    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820994    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820997    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.820999    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821003    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821007    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821009    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821012    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821015    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 11:06:53.828984 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821017    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821020    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821023    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821025    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821029    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821031    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821034    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821036    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821038    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821041    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821043    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821045    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821047    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821050    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821052    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821054    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821057    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821059    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821061    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821070    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 11:06:53.829860 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821072    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821075    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821077    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821081    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821083    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821086    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821088    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821090    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821094    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821096    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821099    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821101    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821104    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821106    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821108    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821111    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821113    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821116    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821119    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821121    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 11:06:53.830716 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821124    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821126    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821128    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821130    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821133    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821135    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821137    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821144    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821158    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821160    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821163    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821165    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821168    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821170    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821172    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821176    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821178    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821181    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821183    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 11:06:53.831433 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821185    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821189    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821191    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821194    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821196    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821199    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821201    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821204    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821207    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821210    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821213    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821216    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821219    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821222    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821225    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821228    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821231    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821233    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821236    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 11:06:53.832009 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821239    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821242    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821245    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821247    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821249    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821252    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.821254    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.821843    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.829213    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.829233    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.829260    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.829268    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829372    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829382    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 11:06:53.832531 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829387    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829392    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829396    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829400    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829404    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829408    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829412    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829416    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829419    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829423    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829427    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829431    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829435    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829438    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829442    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829446    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829450    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829454    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829457    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829462    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 11:06:53.832865 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829466    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829470    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829473    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829477    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829481    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829485    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829489    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829500    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829505    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829508    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829512    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829516    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829520    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829524    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829527    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829533    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829538    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829543    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829549    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 11:06:53.833326 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829553    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829558    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829562    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829566    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829570    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829575    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829578    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829582    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829586    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829590    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829594    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829597    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829602    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829606    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829610    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829614    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829618    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829621    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829625    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 11:06:53.833736 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829629    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829633    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829644    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829649    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829653    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829657    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829661    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829664    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829670    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829675    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829679    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829684    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829687    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829691    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829695    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829699    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829702    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829706    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829710    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829714    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 11:06:53.834168 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829718    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829722    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829726    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829730    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829734    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829738    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829742    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829745    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829749    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829753    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829757    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829761    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829765    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829769    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829773    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829783    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829787    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829791    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 11:06:53.834599 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.829795    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.829803    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830015    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830023    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830028    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830032    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830035    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830040    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830045    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830049    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830053    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830057    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830062    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830076    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830080    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 11:06:53.834986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830084    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830088    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830092    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830096    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830100    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830105    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830109    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830113    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830117    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830121    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830125    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830128    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830134    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830161    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830167    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830180    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830184    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830189    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830192    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 11:06:53.835340 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830197    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830201    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830205    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830209    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830213    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830216    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830220    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830224    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830227    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830231    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830235    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830239    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830243    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830247    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830251    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830254    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830258    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830262    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830266    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 11:06:53.835779 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830269    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830273    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830278    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830281    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830285    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830289    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830293    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830297    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830300    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830304    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830315    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830319    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830323    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830327    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830331    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830334    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830338    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830342    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830346    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830349    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830353    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 11:06:53.836308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830357    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830361    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830364    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830368    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830372    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830376    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830380    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830384    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830388    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830391    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830395    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830399    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830403    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830407    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830411    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830415    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830418    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830422    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830426    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 11:06:53.836766 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830430    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830436    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830441    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830452    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830457    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830460    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830464    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:53.830468    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.830475    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.832035    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 11:06:53.837199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.836197    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 11:06:53.837425 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.837420    2581 server.go:1019] "Starting client certificate rotation"
Jul 14 11:06:53.837529 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.837512    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 11:06:53.837558 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.837549    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 11:06:53.839713 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.839701    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 11:06:53.842615 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.842603    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 11:06:53.851521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.851503    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 14 11:06:53.853588 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.853577    2581 log.go:25] "Validated CRI v1 image API"
Jul 14 11:06:53.854342 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.854325    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 11:06:53.856930 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.856907    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ac3fb516-3d92-4268-b38c-49134aa0d4c7:/dev/nvme0n1p4 f2e3192b-e5b9-40d2-85e1-78067e5d05c9:/dev/nvme0n1p3]
Jul 14 11:06:53.856996 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.856928    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 11:06:53.861532 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.861516    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 11:06:53.862993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.862862    2581 manager.go:216] Machine: {Timestamp:2026-07-14 11:06:53.861547393 +0000 UTC m=+0.314493259 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097249 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec207928a31d01f7dbbbca9ba8a3a031 SystemUUID:ec207928-a31d-01f7-dbbb-ca9ba8a3a031 BootID:191c50c3-23e6-4b9a-ab58-40e31affe32f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:b5:7c:c2:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:b5:7c:c2:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:79:67:52:a8:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 11:06:53.862993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.862987    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 11:06:53.863106 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.863061    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 11:06:53.865928 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.865907    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 11:06:53.866083 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.865930    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 11:06:53.866644 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.866635    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 11:06:53.866680 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.866646    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 11:06:53.866680 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.866653    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 11:06:53.867483 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.867473    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 11:06:53.870122 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.870107    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 11:06:53.872658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.872648    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 11:06:53.872914 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.872905    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 11:06:53.872949 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.872942    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 11:06:53.872975 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.872958    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 11:06:53.873006 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.872977    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 11:06:53.873006 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.872989    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 14 11:06:53.873006 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.873005    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 11:06:53.873575 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.873551    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 11:06:53.873682 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.873580    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 11:06:53.877074 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.877056    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 11:06:53.878743 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.878731    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 11:06:53.878795 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.878758    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 11:06:53.879339 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879329    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 11:06:53.879368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879345    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 11:06:53.879368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879351    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 11:06:53.879368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879356    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 11:06:53.879368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879364    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 11:06:53.879368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879369    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 11:06:53.879507 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879500    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 11:06:53.879507 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879508    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 11:06:53.879558 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879514    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 11:06:53.879558 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879519    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 11:06:53.879558 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879526    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 11:06:53.879558 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.879533    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 11:06:53.880241 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.880233    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 11:06:53.880269 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.880242    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 11:06:53.881794 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.881773    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bn486"
Jul 14 11:06:53.882898 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.882883    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 11:06:53.882961 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.882947    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 11:06:53.882999 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.882950    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 11:06:53.883511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.883500    2581 server.go:1268] "Started kubelet"
Jul 14 11:06:53.883589 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.883558    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 11:06:53.883638 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.883582    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 11:06:53.883679 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.883658    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 11:06:53.884416 ip-10-0-128-125 systemd[1]: Started Kubernetes Kubelet.
Jul 14 11:06:53.884701 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.884682    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 11:06:53.885940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.885929    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 11:06:53.888342 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.888326    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bn486"
Jul 14 11:06:53.889013 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.888998    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 11:06:53.889625 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.888753    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-125.ec2.internal.18c2234c8127858c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-125.ec2.internal,UID:ip-10-0-128-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-125.ec2.internal,},FirstTimestamp:2026-07-14 11:06:53.88347534 +0000 UTC m=+0.336421209,LastTimestamp:2026-07-14 11:06:53.88347534 +0000 UTC m=+0.336421209,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-125.ec2.internal,}"
Jul 14 11:06:53.892019 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892006    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 11:06:53.892082 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892012    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 11:06:53.892360 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.892338    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:53.892745 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892716    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 11:06:53.892745 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892718    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 11:06:53.892878 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892755    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 11:06:53.892878 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892853    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 11:06:53.892878 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892861    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 11:06:53.892976 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892942    2581 factory.go:55] Registering systemd factory
Jul 14 11:06:53.892976 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.892957    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 14 11:06:53.893184 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.893158    2581 factory.go:153] Registering CRI-O factory
Jul 14 11:06:53.893184 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.893182    2581 factory.go:223] Registration of the crio container factory successfully
Jul 14 11:06:53.893309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.893223    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 11:06:53.893309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.893249    2581 factory.go:103] Registering Raw factory
Jul 14 11:06:53.893309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.893262    2581 manager.go:1196] Started watching for new ooms in manager
Jul 14 11:06:53.893734 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.893721    2581 manager.go:349] Starting recovery of all containers
Jul 14 11:06:53.894401 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.894382    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 11:06:53.897397 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.897374    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-125.ec2.internal\" not found" node="ip-10-0-128-125.ec2.internal"
Jul 14 11:06:53.904113 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.903955    2581 manager.go:354] Recovery completed
Jul 14 11:06:53.908996 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.908984    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 11:06:53.910836 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.910819    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 11:06:53.910915 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.910846    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 11:06:53.910915 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.910856    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientPID"
Jul 14 11:06:53.911335 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.911323    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 11:06:53.911335 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.911333    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 11:06:53.911413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.911342    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 11:06:53.911413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.911348    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 11:06:53.911918 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.911903    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 11:06:53.911978 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.911929    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 11:06:53.911978 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.911941    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientPID"
Jul 14 11:06:53.912420 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.912410    2581 policy_none.go:49] "None policy: Start"
Jul 14 11:06:53.912452 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.912424    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 11:06:53.912452 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.912433    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 11:06:53.913236 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.913226    2581 policy_none.go:47] "Start"
Jul 14 11:06:53.939676 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.939662    2581 manager.go:337] "Starting Device Plugin manager"
Jul 14 11:06:53.939755 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.939692    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 11:06:53.939755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.939701    2581 server.go:87] "Starting device plugin registration server"
Jul 14 11:06:53.939940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.939929    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 11:06:53.939976 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.939943    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 11:06:53.940032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.940008    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 11:06:53.940167 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.940134    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 11:06:53.940167 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:53.940159    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 11:06:53.940633 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.940614    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 11:06:53.940696 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:53.940664    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.040507 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.040476    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 11:06:54.041540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.041371    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 11:06:54.041540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.041423    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 11:06:54.041540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.041436    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientPID"
Jul 14 11:06:54.041540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.041466    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.044242 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.044219    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 11:06:54.045347 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.045332    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 11:06:54.045424 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.045370    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 11:06:54.045424 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.045389    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 11:06:54.045424 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.045422    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 11:06:54.047565 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.047542    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 11:06:54.049359 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.049344    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.049429 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.049372    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-125.ec2.internal\": node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.113468 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.113443    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.146551 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.146494    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal"]
Jul 14 11:06:54.146613 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.146592    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 11:06:54.148391 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.148375    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 11:06:54.148459 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.148402    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 11:06:54.148459 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.148416    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientPID"
Jul 14 11:06:54.149718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.149707    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 11:06:54.149823 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.149811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.149861 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.149851    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 11:06:54.150471 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.150455    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 11:06:54.150471 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.150466    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 11:06:54.150591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.150483    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 11:06:54.150591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.150486    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 11:06:54.150591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.150492    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientPID"
Jul 14 11:06:54.150591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.150496    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientPID"
Jul 14 11:06:54.151636 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.151623    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.151684 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.151649    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 11:06:54.153289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.153266    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 11:06:54.153289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.153291    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 11:06:54.153395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.153302    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeHasSufficientPID"
Jul 14 11:06:54.167662 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.167643    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-125.ec2.internal\" not found" node="ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.170762 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.170747    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-125.ec2.internal\" not found" node="ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.194661 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.194642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77fcba313979623a01a7ba7462c3ffc2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal\" (UID: \"77fcba313979623a01a7ba7462c3ffc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.194726 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.194664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77fcba313979623a01a7ba7462c3ffc2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal\" (UID: \"77fcba313979623a01a7ba7462c3ffc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.194726 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.194679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c473f26d8bf8389afb77ad42acd15a9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-125.ec2.internal\" (UID: \"7c473f26d8bf8389afb77ad42acd15a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.214002 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.213979    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.295710 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.295673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77fcba313979623a01a7ba7462c3ffc2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal\" (UID: \"77fcba313979623a01a7ba7462c3ffc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.295846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.295719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77fcba313979623a01a7ba7462c3ffc2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal\" (UID: \"77fcba313979623a01a7ba7462c3ffc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.295846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.295739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c473f26d8bf8389afb77ad42acd15a9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-125.ec2.internal\" (UID: \"7c473f26d8bf8389afb77ad42acd15a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.295846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.295680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77fcba313979623a01a7ba7462c3ffc2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal\" (UID: \"77fcba313979623a01a7ba7462c3ffc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.295846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.295774    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c473f26d8bf8389afb77ad42acd15a9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-125.ec2.internal\" (UID: \"7c473f26d8bf8389afb77ad42acd15a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.295846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.295813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77fcba313979623a01a7ba7462c3ffc2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal\" (UID: \"77fcba313979623a01a7ba7462c3ffc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.314733 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.314712    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.415431 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.415360    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.469511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.469485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.474073 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.474054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:54.516376 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.516341    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.616765 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.616743    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.717192 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.717102    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.745614 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.745588    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 11:06:54.817976 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.817951    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.837104 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.837073    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 11:06:54.837244 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.837229    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 11:06:54.837279 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.837230    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 11:06:54.837279 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.837230    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 11:06:54.892770 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.892737    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 11:01:53 +0000 UTC" deadline="2028-01-08 01:48:06.500296081 +0000 UTC"
Jul 14 11:06:54.892770 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.892769    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13022h41m11.607531893s"
Jul 14 11:06:54.918040 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:54.918006    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:54.965673 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:54.965639    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c473f26d8bf8389afb77ad42acd15a9.slice/crio-7da898adae670ed4f17551e2611668394f069a63630fe307cf48ec9ade153b6c WatchSource:0}: Error finding container 7da898adae670ed4f17551e2611668394f069a63630fe307cf48ec9ade153b6c: Status 404 returned error can't find the container with id 7da898adae670ed4f17551e2611668394f069a63630fe307cf48ec9ade153b6c
Jul 14 11:06:54.965883 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:54.965864    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77fcba313979623a01a7ba7462c3ffc2.slice/crio-81a1b4409bba29563dde78fb0e0120bd3ea70f0bebd239a3e0a5adc39528a258 WatchSource:0}: Error finding container 81a1b4409bba29563dde78fb0e0120bd3ea70f0bebd239a3e0a5adc39528a258: Status 404 returned error can't find the container with id 81a1b4409bba29563dde78fb0e0120bd3ea70f0bebd239a3e0a5adc39528a258
Jul 14 11:06:54.969678 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:54.969665    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 11:06:55.018772 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:55.018745    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:55.049199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.049143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal" event={"ID":"7c473f26d8bf8389afb77ad42acd15a9","Type":"ContainerStarted","Data":"7da898adae670ed4f17551e2611668394f069a63630fe307cf48ec9ade153b6c"}
Jul 14 11:06:55.050078 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.050061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal" event={"ID":"77fcba313979623a01a7ba7462c3ffc2","Type":"ContainerStarted","Data":"81a1b4409bba29563dde78fb0e0120bd3ea70f0bebd239a3e0a5adc39528a258"}
Jul 14 11:06:55.119460 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:55.119429    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:55.219893 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:55.219827    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:55.320144 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:55.320126    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-125.ec2.internal\" not found"
Jul 14 11:06:55.374827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.374806    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 11:06:55.392872 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.392856    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:55.401426 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.401407    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 11:06:55.402322 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.402308    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal"
Jul 14 11:06:55.410860 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.410845    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 11:06:55.873377 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.873350    2581 apiserver.go:52] "Watching apiserver"
Jul 14 11:06:55.881517 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.880915    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 11:06:55.881724 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.881702    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78","openshift-cluster-node-tuning-operator/tuned-mp5zc","openshift-dns/node-resolver-wxx9k","openshift-image-registry/node-ca-xdmdm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal","openshift-multus/multus-additional-cni-plugins-bzzjp","openshift-multus/network-metrics-daemon-pql22","openshift-network-diagnostics/network-check-target-q7gjd","kube-system/global-pull-secret-syncer-lvmq6","kube-system/konnectivity-agent-qg6c7","kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal","openshift-multus/multus-vzdfb","openshift-network-operator/iptables-alerter-j4kzl","openshift-ovn-kubernetes/ovnkube-node-ztpgb"]
Jul 14 11:06:55.883754 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.883655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:55.883754 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:55.883737    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:06:55.884790 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.884771    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:55.884868 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:55.884835    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:06:55.885706 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.885602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:55.886800 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.886778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:55.887718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.887698    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 11:06:55.887801 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.887773    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 11:06:55.887873 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.887857    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-46zxz\""
Jul 14 11:06:55.889011 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.888694    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.889755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.889428    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gqfpc\""
Jul 14 11:06:55.889755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.889501    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 11:06:55.889755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.889541    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 11:06:55.889755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.889628    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 11:06:55.891666 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.891367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.893031 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.893002    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 11:06:55.893856 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.893836    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 11:06:55.893856 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.893852    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 11:06:55.893992 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.893923    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 11:06:55.893992 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.893984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2cmcm\""
Jul 14 11:06:55.896892 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.896874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:55.897017 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:55.896933    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:06:55.897484 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.897465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:55.897638 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.897614    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 11:06:55.897844 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.897828    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 11:06:55.898027 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.898012    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 11:06:55.898241 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.898226    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-snbgk\""
Jul 14 11:06:55.898418 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.898393    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 11:06:55.898672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.898657    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 11:06:55.899243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.899224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:55.899546 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.899528    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 11:06:55.899760 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.899740    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbrh7\""
Jul 14 11:06:55.899912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.899857    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 11:06:55.899988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.899925    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 11:06:55.900734 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.900713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:55.901234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.901215    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 11:06:55.901503 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.901485    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pxxgl\""
Jul 14 11:06:55.901777 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.901761    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 11:06:55.902691 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.902675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:55.903533 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-system-cni-dir\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.903612 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-sys-fs\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.903612 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mqjv\" (UniqueName: \"kubernetes.io/projected/27f979fc-b080-484f-8540-023f1b78e6c5-kube-api-access-9mqjv\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:55.903612 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:55.903741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-device-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.903741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0c360fc-9142-49aa-91ad-b2f93750c852-kubelet-config\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:55.903741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmrj\" (UniqueName: \"kubernetes.io/projected/745bbd5d-f1aa-443a-af58-ed96f0048275-kube-api-access-jmmrj\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.903879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903821    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p74nz\""
Jul 14 11:06:55.903879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.903871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:55.904041 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904024    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 11:06:55.904476 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqdqh\" (UniqueName: \"kubernetes.io/projected/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-kube-api-access-qqdqh\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:55.904553 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-registration-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.904553 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.904553 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.904689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0c360fc-9142-49aa-91ad-b2f93750c852-dbus\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:55.904689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-tmp-dir\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:55.904689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:55.904689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-etc-selinux\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.904689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:55.904689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-host\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-cnibin\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-os-release\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-hosts-file\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27fdr\" (UniqueName: \"kubernetes.io/projected/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-kube-api-access-27fdr\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-socket-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrh9p\" (UniqueName: \"kubernetes.io/projected/7238246b-5f84-4ff5-aabc-798e3afa3608-kube-api-access-rrh9p\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:55.904946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.904912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-serviceca\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:55.906968 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.906948    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 11:06:55.907047 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907003    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 11:06:55.907163 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.906961    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 11:06:55.907227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907208    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 11:06:55.907362 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907345    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x24zx\""
Jul 14 11:06:55.907424 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907373    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 11:06:55.907511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907498    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 11:06:55.907564 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907547    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 11:06:55.907634 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 11:06:55.907945 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.907930    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 11:06:55.909469 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.909451    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xqss4\""
Jul 14 11:06:55.921298 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.921277    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-764x8"
Jul 14 11:06:55.933390 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.933292    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-764x8"
Jul 14 11:06:55.994332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:55.994306    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 11:06:56.005282 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovnkube-script-lib\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-system-cni-dir\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-cni-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-sys-fs\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-device-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005372    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-system-cni-dir\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-kubernetes\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcb78\" (UniqueName: \"kubernetes.io/projected/1d23f3b5-2628-44dd-9121-aba36b19db12-kube-api-access-hcb78\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.005438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae81f669-74d5-4af6-99ea-590029ff201b-konnectivity-ca\") pod \"konnectivity-agent-qg6c7\" (UID: \"ae81f669-74d5-4af6-99ea-590029ff201b\") " pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005450    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-sys-fs\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-device-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqdqh\" (UniqueName: \"kubernetes.io/projected/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-kube-api-access-qqdqh\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-registration-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-socket-dir-parent\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-etc-kubernetes\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-system-cni-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-cni-bin\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-registration-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-kubelet\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.005793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj4x7\" (UniqueName: \"kubernetes.io/projected/355cd5e8-6ed9-4414-88a9-bb31006ad399-kube-api-access-nj4x7\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysctl-d\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-systemd\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005839    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjntv\" (UniqueName: \"kubernetes.io/projected/2d11c591-8388-4aff-971a-fdfde5c66a3f-kube-api-access-bjntv\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005922    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-cni-multus\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-conf-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.005988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-multus-certs\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-cnibin\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-cnibin\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-os-release\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.006173    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/745bbd5d-f1aa-443a-af58-ed96f0048275-os-release\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.006221    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs podName:27f979fc-b080-484f-8540-023f1b78e6c5 nodeName:}" failed. No retries permitted until 2026-07-14 11:06:56.50620717 +0000 UTC m=+2.959153027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs") pod "network-metrics-daemon-pql22" (UID: "27f979fc-b080-484f-8540-023f1b78e6c5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.006413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-hosts-file\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-modprobe-d\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysconfig\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-lib-modules\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovnkube-config\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27fdr\" (UniqueName: \"kubernetes.io/projected/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-kube-api-access-27fdr\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-socket-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-cnibin\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-kubelet\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-systemd-units\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-run-netns\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-serviceca\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-hostroot\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-var-lib-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mqjv\" (UniqueName: \"kubernetes.io/projected/27f979fc-b080-484f-8540-023f1b78e6c5-kube-api-access-9mqjv\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:56.007176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-host\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-ovn\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-cni-netd\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovn-node-metrics-cert\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0c360fc-9142-49aa-91ad-b2f93750c852-kubelet-config\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmrj\" (UniqueName: \"kubernetes.io/projected/745bbd5d-f1aa-443a-af58-ed96f0048275-kube-api-access-jmmrj\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-k8s-cni-cncf-io\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-iptables-alerter-script\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-host-slash\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-etc-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-env-overrides\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0c360fc-9142-49aa-91ad-b2f93750c852-dbus\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-var-lib-kubelet\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-systemd\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.007879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-node-log\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-tmp-dir\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-run\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d11c591-8388-4aff-971a-fdfde5c66a3f-tmp\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-slash\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0c360fc-9142-49aa-91ad-b2f93750c852-kubelet-config\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.006978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-log-socket\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-hosts-file\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.007158    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.007202    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret podName:e0c360fc-9142-49aa-91ad-b2f93750c852 nodeName:}" failed. No retries permitted until 2026-07-14 11:06:56.507187123 +0000 UTC m=+2.960132996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret") pod "global-pull-secret-syncer-lvmq6" (UID: "e0c360fc-9142-49aa-91ad-b2f93750c852") : object "kube-system"/"original-pull-secret" not registered
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0c360fc-9142-49aa-91ad-b2f93750c852-dbus\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-etc-selinux\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-host\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-sys\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-tmp-dir\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:56.008422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-os-release\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-netns\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-daemon-config\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-tuned\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r72q\" (UniqueName: \"kubernetes.io/projected/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-kube-api-access-8r72q\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-cni-bin\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-host\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrh9p\" (UniqueName: \"kubernetes.io/projected/7238246b-5f84-4ff5-aabc-798e3afa3608-kube-api-access-rrh9p\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-socket-dir\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysctl-conf\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d23f3b5-2628-44dd-9121-aba36b19db12-cni-binary-copy\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7238246b-5f84-4ff5-aabc-798e3afa3608-etc-selinux\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae81f669-74d5-4af6-99ea-590029ff201b-agent-certs\") pod \"konnectivity-agent-qg6c7\" (UID: \"ae81f669-74d5-4af6-99ea-590029ff201b\") " pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-serviceca\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:56.008964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.007691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/745bbd5d-f1aa-443a-af58-ed96f0048275-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.011444 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.011422    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 11:06:56.012851 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.012825    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 11:06:56.013853 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.013832    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 11:06:56.013927 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.013856    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 11:06:56.013927 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.013870    2581 projected.go:196] Error preparing data for projected volume kube-api-access-h2wdp for pod openshift-network-diagnostics/network-check-target-q7gjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:56.014030 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.013944    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp podName:82bd5432-bd78-4c49-b915-b2902756aadb nodeName:}" failed. No retries permitted until 2026-07-14 11:06:56.513929078 +0000 UTC m=+2.966874949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h2wdp" (UniqueName: "kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp") pod "network-check-target-q7gjd" (UID: "82bd5432-bd78-4c49-b915-b2902756aadb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:56.016266 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.016246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27fdr\" (UniqueName: \"kubernetes.io/projected/ccf3a373-3d7c-4bbb-86fe-76aed78860f7-kube-api-access-27fdr\") pod \"node-ca-xdmdm\" (UID: \"ccf3a373-3d7c-4bbb-86fe-76aed78860f7\") " pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:56.016349 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.016246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqdqh\" (UniqueName: \"kubernetes.io/projected/484fe3a1-4a30-4b1d-9d4f-5343989fd5e4-kube-api-access-qqdqh\") pod \"node-resolver-wxx9k\" (UID: \"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4\") " pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:56.016682 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.016663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mqjv\" (UniqueName: \"kubernetes.io/projected/27f979fc-b080-484f-8540-023f1b78e6c5-kube-api-access-9mqjv\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:56.016773 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.016746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrh9p\" (UniqueName: \"kubernetes.io/projected/7238246b-5f84-4ff5-aabc-798e3afa3608-kube-api-access-rrh9p\") pod \"aws-ebs-csi-driver-node-swk78\" (UID: \"7238246b-5f84-4ff5-aabc-798e3afa3608\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.017869 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.017850    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmrj\" (UniqueName: \"kubernetes.io/projected/745bbd5d-f1aa-443a-af58-ed96f0048275-kube-api-access-jmmrj\") pod \"multus-additional-cni-plugins-bzzjp\" (UID: \"745bbd5d-f1aa-443a-af58-ed96f0048275\") " pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.108126 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-host\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-ovn\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-cni-netd\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovn-node-metrics-cert\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-k8s-cni-cncf-io\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-host\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-iptables-alerter-script\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-ovn\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-host-slash\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-k8s-cni-cncf-io\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108311    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-host-slash\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-etc-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-env-overrides\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-var-lib-kubelet\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-systemd\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-node-log\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108484    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-run\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d11c591-8388-4aff-971a-fdfde5c66a3f-tmp\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-slash\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-log-socket\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-sys\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.108623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-os-release\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-cni-netd\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-netns\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-daemon-config\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-run\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-tuned\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-log-socket\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r72q\" (UniqueName: \"kubernetes.io/projected/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-kube-api-access-8r72q\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-cni-bin\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-systemd\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-iptables-alerter-script\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-cni-bin\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-sys\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-slash\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysctl-conf\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-var-lib-kubelet\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d23f3b5-2628-44dd-9121-aba36b19db12-cni-binary-copy\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae81f669-74d5-4af6-99ea-590029ff201b-agent-certs\") pod \"konnectivity-agent-qg6c7\" (UID: \"ae81f669-74d5-4af6-99ea-590029ff201b\") " pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:56.109195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108886    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-node-log\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-os-release\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-etc-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.108926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-netns\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-env-overrides\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d23f3b5-2628-44dd-9121-aba36b19db12-cni-binary-copy\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovnkube-script-lib\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-daemon-config\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysctl-conf\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-cni-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-cni-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-kubernetes\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcb78\" (UniqueName: \"kubernetes.io/projected/1d23f3b5-2628-44dd-9121-aba36b19db12-kube-api-access-hcb78\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae81f669-74d5-4af6-99ea-590029ff201b-konnectivity-ca\") pod \"konnectivity-agent-qg6c7\" (UID: \"ae81f669-74d5-4af6-99ea-590029ff201b\") " pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:56.109953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.110579 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.109967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.110579 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae81f669-74d5-4af6-99ea-590029ff201b-konnectivity-ca\") pod \"konnectivity-agent-qg6c7\" (UID: \"ae81f669-74d5-4af6-99ea-590029ff201b\") " pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:56.110579 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovnkube-script-lib\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.110579 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-kubernetes\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.110579 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-run-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.110579 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-socket-dir-parent\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-etc-kubernetes\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-etc-kubernetes\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-system-cni-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-socket-dir-parent\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-cni-bin\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.110883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110859    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-cni-bin\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-kubelet\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-kubelet\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-system-cni-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj4x7\" (UniqueName: \"kubernetes.io/projected/355cd5e8-6ed9-4414-88a9-bb31006ad399-kube-api-access-nj4x7\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysctl-d\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.110992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-systemd\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjntv\" (UniqueName: \"kubernetes.io/projected/2d11c591-8388-4aff-971a-fdfde5c66a3f-kube-api-access-bjntv\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-cni-multus\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-conf-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-multus-certs\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-modprobe-d\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysconfig\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-lib-modules\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.111249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovnkube-config\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.111815 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-var-lib-cni-multus\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.113243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-cnibin\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.113330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-multus-conf-dir\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.113429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-host-run-multus-certs\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.113429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovnkube-config\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.113429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-lib-modules\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.113519 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-modprobe-d\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.113519 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysconfig\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.113589 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-tuned\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.113674 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d11c591-8388-4aff-971a-fdfde5c66a3f-tmp\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.113833 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113787    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-sysctl-d\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.113833 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.113795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d11c591-8388-4aff-971a-fdfde5c66a3f-etc-systemd\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.114060 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/355cd5e8-6ed9-4414-88a9-bb31006ad399-ovn-node-metrics-cert\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114141 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.111225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-cnibin\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.114141 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae81f669-74d5-4af6-99ea-590029ff201b-agent-certs\") pod \"konnectivity-agent-qg6c7\" (UID: \"ae81f669-74d5-4af6-99ea-590029ff201b\") " pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:56.114141 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-kubelet\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-systemd-units\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-kubelet\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-run-netns\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-hostroot\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.114294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-var-lib-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-systemd-units\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114473 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114356    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-var-lib-openvswitch\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114473 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355cd5e8-6ed9-4414-88a9-bb31006ad399-host-run-netns\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.114473 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.114402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d23f3b5-2628-44dd-9121-aba36b19db12-hostroot\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.117405 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.117386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r72q\" (UniqueName: \"kubernetes.io/projected/8a5162eb-033c-45b2-b2a8-7b7eddc5d613-kube-api-access-8r72q\") pod \"iptables-alerter-j4kzl\" (UID: \"8a5162eb-033c-45b2-b2a8-7b7eddc5d613\") " pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.118535 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.118515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj4x7\" (UniqueName: \"kubernetes.io/projected/355cd5e8-6ed9-4414-88a9-bb31006ad399-kube-api-access-nj4x7\") pod \"ovnkube-node-ztpgb\" (UID: \"355cd5e8-6ed9-4414-88a9-bb31006ad399\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.119019 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.118999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcb78\" (UniqueName: \"kubernetes.io/projected/1d23f3b5-2628-44dd-9121-aba36b19db12-kube-api-access-hcb78\") pod \"multus-vzdfb\" (UID: \"1d23f3b5-2628-44dd-9121-aba36b19db12\") " pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.121018 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.121002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjntv\" (UniqueName: \"kubernetes.io/projected/2d11c591-8388-4aff-971a-fdfde5c66a3f-kube-api-access-bjntv\") pod \"tuned-mp5zc\" (UID: \"2d11c591-8388-4aff-971a-fdfde5c66a3f\") " pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.200999 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.200924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wxx9k"
Jul 14 11:06:56.212544 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.212521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xdmdm"
Jul 14 11:06:56.222027 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.222009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78"
Jul 14 11:06:56.228376 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.228356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzzjp"
Jul 14 11:06:56.237509 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.237490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4kzl"
Jul 14 11:06:56.243758 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.243741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mp5zc"
Jul 14 11:06:56.251025 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.251009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:06:56.258289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.258270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:06:56.264592 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.264571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vzdfb"
Jul 14 11:06:56.375275 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.375247    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 11:06:56.516814 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.516733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:56.516814 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.516796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:56.517011 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.516829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:56.517011 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.516857    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:56.517011 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.516920    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 11:06:56.517011 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.516932    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs podName:27f979fc-b080-484f-8540-023f1b78e6c5 nodeName:}" failed. No retries permitted until 2026-07-14 11:06:57.51691357 +0000 UTC m=+3.969859443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs") pod "network-metrics-daemon-pql22" (UID: "27f979fc-b080-484f-8540-023f1b78e6c5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:56.517011 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.516951    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 11:06:56.517011 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.516973    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 11:06:56.517011 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.516986    2581 projected.go:196] Error preparing data for projected volume kube-api-access-h2wdp for pod openshift-network-diagnostics/network-check-target-q7gjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:56.517355 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.516959    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret podName:e0c360fc-9142-49aa-91ad-b2f93750c852 nodeName:}" failed. No retries permitted until 2026-07-14 11:06:57.51694877 +0000 UTC m=+3.969894662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret") pod "global-pull-secret-syncer-lvmq6" (UID: "e0c360fc-9142-49aa-91ad-b2f93750c852") : object "kube-system"/"original-pull-secret" not registered
Jul 14 11:06:56.517355 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:56.517047    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp podName:82bd5432-bd78-4c49-b915-b2902756aadb nodeName:}" failed. No retries permitted until 2026-07-14 11:06:57.517029789 +0000 UTC m=+3.969975656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2wdp" (UniqueName: "kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp") pod "network-check-target-q7gjd" (UID: "82bd5432-bd78-4c49-b915-b2902756aadb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:56.935675 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.935630    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:01:55 +0000 UTC" deadline="2028-04-12 00:57:56.275792124 +0000 UTC"
Jul 14 11:06:56.935675 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:56.935671    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15301h50m59.34012526s"
Jul 14 11:06:56.964208 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.964179    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d11c591_8388_4aff_971a_fdfde5c66a3f.slice/crio-4a88597ab5aaedffebc357bdf93abd6dba1ee588f981a86b35377d94dd673d40 WatchSource:0}: Error finding container 4a88597ab5aaedffebc357bdf93abd6dba1ee588f981a86b35377d94dd673d40: Status 404 returned error can't find the container with id 4a88597ab5aaedffebc357bdf93abd6dba1ee588f981a86b35377d94dd673d40
Jul 14 11:06:56.968656 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.968573    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5162eb_033c_45b2_b2a8_7b7eddc5d613.slice/crio-dfbc7afba68820fb619ceef3075e1eea6d943b27abc87e30a7cb8027e256272b WatchSource:0}: Error finding container dfbc7afba68820fb619ceef3075e1eea6d943b27abc87e30a7cb8027e256272b: Status 404 returned error can't find the container with id dfbc7afba68820fb619ceef3075e1eea6d943b27abc87e30a7cb8027e256272b
Jul 14 11:06:56.969255 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.969233    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355cd5e8_6ed9_4414_88a9_bb31006ad399.slice/crio-29f5cf9043ce0e83be596a38f61556670245a1ddd6ee2485a62377418a595133 WatchSource:0}: Error finding container 29f5cf9043ce0e83be596a38f61556670245a1ddd6ee2485a62377418a595133: Status 404 returned error can't find the container with id 29f5cf9043ce0e83be596a38f61556670245a1ddd6ee2485a62377418a595133
Jul 14 11:06:56.970679 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.970571    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745bbd5d_f1aa_443a_af58_ed96f0048275.slice/crio-e889ae9817e5c3b2f00186afd1518731d7b76230abb8b8b6d302be6cee2a957d WatchSource:0}: Error finding container e889ae9817e5c3b2f00186afd1518731d7b76230abb8b8b6d302be6cee2a957d: Status 404 returned error can't find the container with id e889ae9817e5c3b2f00186afd1518731d7b76230abb8b8b6d302be6cee2a957d
Jul 14 11:06:56.971225 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.971198    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484fe3a1_4a30_4b1d_9d4f_5343989fd5e4.slice/crio-d955d9f95ee771dd4d1cc65da9e388ff2425c0f8e9ba94a6582bdb60299e827a WatchSource:0}: Error finding container d955d9f95ee771dd4d1cc65da9e388ff2425c0f8e9ba94a6582bdb60299e827a: Status 404 returned error can't find the container with id d955d9f95ee771dd4d1cc65da9e388ff2425c0f8e9ba94a6582bdb60299e827a
Jul 14 11:06:56.972572 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.972556    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae81f669_74d5_4af6_99ea_590029ff201b.slice/crio-3a778e1c73b4b7fba77166236631c4677201cb9122fbdf74e7ae14d3812e2740 WatchSource:0}: Error finding container 3a778e1c73b4b7fba77166236631c4677201cb9122fbdf74e7ae14d3812e2740: Status 404 returned error can't find the container with id 3a778e1c73b4b7fba77166236631c4677201cb9122fbdf74e7ae14d3812e2740
Jul 14 11:06:56.973950 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.973924    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7238246b_5f84_4ff5_aabc_798e3afa3608.slice/crio-d6ccd7e6fdb5191240e204c66bceb311a102ede4ee760718d367c57ea2607938 WatchSource:0}: Error finding container d6ccd7e6fdb5191240e204c66bceb311a102ede4ee760718d367c57ea2607938: Status 404 returned error can't find the container with id d6ccd7e6fdb5191240e204c66bceb311a102ede4ee760718d367c57ea2607938
Jul 14 11:06:56.974947 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.974839    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf3a373_3d7c_4bbb_86fe_76aed78860f7.slice/crio-02798f906773e07eb0cf00f4aa7dab0e0eca332422f51533a631874c04719f53 WatchSource:0}: Error finding container 02798f906773e07eb0cf00f4aa7dab0e0eca332422f51533a631874c04719f53: Status 404 returned error can't find the container with id 02798f906773e07eb0cf00f4aa7dab0e0eca332422f51533a631874c04719f53
Jul 14 11:06:56.976541 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:06:56.976510    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d23f3b5_2628_44dd_9121_aba36b19db12.slice/crio-eb35a4a563acc4b283155bedc7d0434f281f35237fbfce9f43009a193da4725e WatchSource:0}: Error finding container eb35a4a563acc4b283155bedc7d0434f281f35237fbfce9f43009a193da4725e: Status 404 returned error can't find the container with id eb35a4a563acc4b283155bedc7d0434f281f35237fbfce9f43009a193da4725e
Jul 14 11:06:57.045728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.045587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:57.045860 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.045836    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:06:57.055437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.054646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xdmdm" event={"ID":"ccf3a373-3d7c-4bbb-86fe-76aed78860f7","Type":"ContainerStarted","Data":"02798f906773e07eb0cf00f4aa7dab0e0eca332422f51533a631874c04719f53"}
Jul 14 11:06:57.056472 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.056442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qg6c7" event={"ID":"ae81f669-74d5-4af6-99ea-590029ff201b","Type":"ContainerStarted","Data":"3a778e1c73b4b7fba77166236631c4677201cb9122fbdf74e7ae14d3812e2740"}
Jul 14 11:06:57.057618 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.057595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wxx9k" event={"ID":"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4","Type":"ContainerStarted","Data":"d955d9f95ee771dd4d1cc65da9e388ff2425c0f8e9ba94a6582bdb60299e827a"}
Jul 14 11:06:57.058848 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.058825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mp5zc" event={"ID":"2d11c591-8388-4aff-971a-fdfde5c66a3f","Type":"ContainerStarted","Data":"4a88597ab5aaedffebc357bdf93abd6dba1ee588f981a86b35377d94dd673d40"}
Jul 14 11:06:57.060029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.060003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"29f5cf9043ce0e83be596a38f61556670245a1ddd6ee2485a62377418a595133"}
Jul 14 11:06:57.061696 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.061676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vzdfb" event={"ID":"1d23f3b5-2628-44dd-9121-aba36b19db12","Type":"ContainerStarted","Data":"eb35a4a563acc4b283155bedc7d0434f281f35237fbfce9f43009a193da4725e"}
Jul 14 11:06:57.062945 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.062923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78" event={"ID":"7238246b-5f84-4ff5-aabc-798e3afa3608","Type":"ContainerStarted","Data":"d6ccd7e6fdb5191240e204c66bceb311a102ede4ee760718d367c57ea2607938"}
Jul 14 11:06:57.064007 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.063988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerStarted","Data":"e889ae9817e5c3b2f00186afd1518731d7b76230abb8b8b6d302be6cee2a957d"}
Jul 14 11:06:57.065496 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.065465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4kzl" event={"ID":"8a5162eb-033c-45b2-b2a8-7b7eddc5d613","Type":"ContainerStarted","Data":"dfbc7afba68820fb619ceef3075e1eea6d943b27abc87e30a7cb8027e256272b"}
Jul 14 11:06:57.066697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.066681    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 11:06:57.526869 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.526784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:57.526869 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.526847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:57.527079 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.526887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:57.527079 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527020    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 11:06:57.527200 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527082    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret podName:e0c360fc-9142-49aa-91ad-b2f93750c852 nodeName:}" failed. No retries permitted until 2026-07-14 11:06:59.527063218 +0000 UTC m=+5.980009088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret") pod "global-pull-secret-syncer-lvmq6" (UID: "e0c360fc-9142-49aa-91ad-b2f93750c852") : object "kube-system"/"original-pull-secret" not registered
Jul 14 11:06:57.527652 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527630    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:57.527752 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527688    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs podName:27f979fc-b080-484f-8540-023f1b78e6c5 nodeName:}" failed. No retries permitted until 2026-07-14 11:06:59.527670891 +0000 UTC m=+5.980616747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs") pod "network-metrics-daemon-pql22" (UID: "27f979fc-b080-484f-8540-023f1b78e6c5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:57.527828 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527794    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 11:06:57.527828 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527809    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 11:06:57.527828 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527823    2581 projected.go:196] Error preparing data for projected volume kube-api-access-h2wdp for pod openshift-network-diagnostics/network-check-target-q7gjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:57.527961 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:57.527861    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp podName:82bd5432-bd78-4c49-b915-b2902756aadb nodeName:}" failed. No retries permitted until 2026-07-14 11:06:59.527847689 +0000 UTC m=+5.980793546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2wdp" (UniqueName: "kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp") pod "network-check-target-q7gjd" (UID: "82bd5432-bd78-4c49-b915-b2902756aadb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:57.935870 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.935801    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:01:55 +0000 UTC" deadline="2028-01-29 18:40:31.560215563 +0000 UTC"
Jul 14 11:06:57.935870 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:57.935843    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13543h33m33.624377359s"
Jul 14 11:06:58.048829 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:58.048128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:58.048829 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:58.048278    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:06:58.048829 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:58.048682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:58.048829 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:58.048772    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:06:58.091228 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:58.090873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal" event={"ID":"7c473f26d8bf8389afb77ad42acd15a9","Type":"ContainerStarted","Data":"e9bd640c4f68f622e99903362b2d5b595d438ea907b31e9b4bed2bd71397a1f2"}
Jul 14 11:06:58.100988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:58.100954    2581 generic.go:356] "Generic (PLEG): container finished" podID="77fcba313979623a01a7ba7462c3ffc2" containerID="c971ff8b5878a351cd021c4d31c8d2252a0daa6f3d6c69822cae97524a3a7f98" exitCode=0
Jul 14 11:06:58.101114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:58.101012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal" event={"ID":"77fcba313979623a01a7ba7462c3ffc2","Type":"ContainerDied","Data":"c971ff8b5878a351cd021c4d31c8d2252a0daa6f3d6c69822cae97524a3a7f98"}
Jul 14 11:06:58.117183 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:58.117121    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-125.ec2.internal" podStartSLOduration=3.11710329 podStartE2EDuration="3.11710329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:06:58.116179695 +0000 UTC m=+4.569125573" watchObservedRunningTime="2026-07-14 11:06:58.11710329 +0000 UTC m=+4.570049170"
Jul 14 11:06:59.046112 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:59.046078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:59.046661 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.046234    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:06:59.118334 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:59.118285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal" event={"ID":"77fcba313979623a01a7ba7462c3ffc2","Type":"ContainerStarted","Data":"d2f9deda6060563b9c2bc28d0718d9d843727c035ffc0c583c85ca413093192b"}
Jul 14 11:06:59.145391 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:59.145332    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-125.ec2.internal" podStartSLOduration=4.145313567 podStartE2EDuration="4.145313567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:06:59.143006998 +0000 UTC m=+5.595952914" watchObservedRunningTime="2026-07-14 11:06:59.145313567 +0000 UTC m=+5.598259445"
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:59.543287    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:59.543342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:06:59.543391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.543517    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.543577    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs podName:27f979fc-b080-484f-8540-023f1b78e6c5 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:03.543558869 +0000 UTC m=+9.996504741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs") pod "network-metrics-daemon-pql22" (UID: "27f979fc-b080-484f-8540-023f1b78e6c5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.543973    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.543991    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.544003    2581 projected.go:196] Error preparing data for projected volume kube-api-access-h2wdp for pod openshift-network-diagnostics/network-check-target-q7gjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.544048    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp podName:82bd5432-bd78-4c49-b915-b2902756aadb nodeName:}" failed. No retries permitted until 2026-07-14 11:07:03.544031338 +0000 UTC m=+9.996977210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2wdp" (UniqueName: "kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp") pod "network-check-target-q7gjd" (UID: "82bd5432-bd78-4c49-b915-b2902756aadb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.544105    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 11:06:59.544186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:06:59.544138    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret podName:e0c360fc-9142-49aa-91ad-b2f93750c852 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:03.54412719 +0000 UTC m=+9.997073050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret") pod "global-pull-secret-syncer-lvmq6" (UID: "e0c360fc-9142-49aa-91ad-b2f93750c852") : object "kube-system"/"original-pull-secret" not registered
Jul 14 11:07:00.046023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:00.045949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:00.046225 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:00.046095    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:00.046225 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:00.046112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:00.046647 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:00.046279    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:01.045762 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:01.045731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:01.045953 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:01.045866    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:02.045894 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:02.045638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:02.045894 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:02.045637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:02.045894 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:02.045745    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:02.045894 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:02.045826    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:03.046111 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:03.045993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:03.046600 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.046136    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:03.581293 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:03.581036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:03.581293 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:03.581104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:03.581293 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:03.581141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:03.581293 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581198    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 11:07:03.581293 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581257    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret podName:e0c360fc-9142-49aa-91ad-b2f93750c852 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:11.581237682 +0000 UTC m=+18.034183551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret") pod "global-pull-secret-syncer-lvmq6" (UID: "e0c360fc-9142-49aa-91ad-b2f93750c852") : object "kube-system"/"original-pull-secret" not registered
Jul 14 11:07:03.581293 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581260    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 11:07:03.581293 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581269    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:07:03.581740 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581275    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 11:07:03.581740 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581334    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs podName:27f979fc-b080-484f-8540-023f1b78e6c5 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:11.581315638 +0000 UTC m=+18.034261505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs") pod "network-metrics-daemon-pql22" (UID: "27f979fc-b080-484f-8540-023f1b78e6c5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:07:03.581740 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581344    2581 projected.go:196] Error preparing data for projected volume kube-api-access-h2wdp for pod openshift-network-diagnostics/network-check-target-q7gjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:07:03.581740 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:03.581397    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp podName:82bd5432-bd78-4c49-b915-b2902756aadb nodeName:}" failed. No retries permitted until 2026-07-14 11:07:11.581380188 +0000 UTC m=+18.034326047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2wdp" (UniqueName: "kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp") pod "network-check-target-q7gjd" (UID: "82bd5432-bd78-4c49-b915-b2902756aadb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:07:04.046083 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:04.046012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:04.046240 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:04.046143    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:04.047703 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:04.047674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:04.047901 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:04.047782    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:05.045844 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:05.045805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:05.046011 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:05.045932    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:06.046274 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:06.046241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:06.046727 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:06.046374    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:06.046727 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:06.046525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:06.046727 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:06.046629    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:07.046047 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:07.046018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:07.046233 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:07.046132    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:08.045690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:08.045604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:08.045690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:08.045604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:08.046186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:08.045742    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:08.046186 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:08.046070    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:09.046669 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:09.046633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:09.047059 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:09.046773    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:10.046122 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:10.046085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:10.046311 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:10.046242    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:10.046362 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:10.046332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:10.046476 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:10.046437    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:11.046295 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:11.046259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:11.046847 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.046383    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:11.644812 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:11.644780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:11.644980 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:11.644830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:11.644980 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:11.644863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:11.644980 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.644919    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:07:11.644980 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.644967    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 11:07:11.645137 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.644983    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs podName:27f979fc-b080-484f-8540-023f1b78e6c5 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:27.644962072 +0000 UTC m=+34.097907929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs") pod "network-metrics-daemon-pql22" (UID: "27f979fc-b080-484f-8540-023f1b78e6c5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:07:11.645137 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.645015    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret podName:e0c360fc-9142-49aa-91ad-b2f93750c852 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:27.644999747 +0000 UTC m=+34.097945620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret") pod "global-pull-secret-syncer-lvmq6" (UID: "e0c360fc-9142-49aa-91ad-b2f93750c852") : object "kube-system"/"original-pull-secret" not registered
Jul 14 11:07:11.645137 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.645019    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 11:07:11.645137 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.645044    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 11:07:11.645137 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.645057    2581 projected.go:196] Error preparing data for projected volume kube-api-access-h2wdp for pod openshift-network-diagnostics/network-check-target-q7gjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:07:11.645137 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:11.645113    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp podName:82bd5432-bd78-4c49-b915-b2902756aadb nodeName:}" failed. No retries permitted until 2026-07-14 11:07:27.645096715 +0000 UTC m=+34.098042594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2wdp" (UniqueName: "kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp") pod "network-check-target-q7gjd" (UID: "82bd5432-bd78-4c49-b915-b2902756aadb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:07:12.046070 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:12.046035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:12.046268 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:12.046035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:12.046495 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:12.046450    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:12.046804 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:12.046632    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:13.046214 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:13.046180    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:13.046384 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:13.046312    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:14.046617 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:14.046585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:14.047087 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:14.046708    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:14.047087 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:14.046944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:14.047087 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:14.047048    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:15.046429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:15.046396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:15.046642 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:15.046516    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:16.046487 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.046210    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:16.046602 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.046252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:16.046673 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:16.046649    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:16.047138 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:16.046676    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:16.152747 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.152719    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"e8a74f4042bcd0fc8bf705f0a975037bbf7b8cd53aeb0801274c7d54f41b8fc1"}
Jul 14 11:07:16.152849 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.152790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"fc4b3c98df06b31667735dce7a614bcaf6661285e3570577632d58e6e49996ad"}
Jul 14 11:07:16.152849 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.152833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"b5e075c61b1a79c19cbb2d25df8b817aedf81347e32f7a1cee53c8a797c7cef4"}
Jul 14 11:07:16.154028 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.154009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vzdfb" event={"ID":"1d23f3b5-2628-44dd-9121-aba36b19db12","Type":"ContainerStarted","Data":"6f2f329e0d2224ba9903dd0dfe2fd56bd271fb2b5ebfbfb5e3eb999a9c78c5f3"}
Jul 14 11:07:16.155767 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.155744    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78" event={"ID":"7238246b-5f84-4ff5-aabc-798e3afa3608","Type":"ContainerStarted","Data":"fac8705c91945e47ef314d5341149fb64218bc669eb7c7dd7c71e961995fd7e3"}
Jul 14 11:07:16.157228 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.157208    2581 generic.go:356] "Generic (PLEG): container finished" podID="745bbd5d-f1aa-443a-af58-ed96f0048275" containerID="4537cf2ae1b51bfc9d6a0bed5f8f8e08955b0740648017d189f1d60f08da2f66" exitCode=0
Jul 14 11:07:16.157306 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.157284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerDied","Data":"4537cf2ae1b51bfc9d6a0bed5f8f8e08955b0740648017d189f1d60f08da2f66"}
Jul 14 11:07:16.158881 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.158853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xdmdm" event={"ID":"ccf3a373-3d7c-4bbb-86fe-76aed78860f7","Type":"ContainerStarted","Data":"d688f71cf4ba2fbc3ad1c4d3f381592e8a65e149bf93c2b56daa0736bc497c3a"}
Jul 14 11:07:16.160476 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.160457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qg6c7" event={"ID":"ae81f669-74d5-4af6-99ea-590029ff201b","Type":"ContainerStarted","Data":"7ba5da1b971a6c7699def1cec0eee7eb987370388fc4dedd6ee696262d87eb02"}
Jul 14 11:07:16.161939 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.161914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wxx9k" event={"ID":"484fe3a1-4a30-4b1d-9d4f-5343989fd5e4","Type":"ContainerStarted","Data":"ac9ea9a3f1988b58483047aea635f505ccc2d108305975141661b56554760617"}
Jul 14 11:07:16.163337 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.163318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mp5zc" event={"ID":"2d11c591-8388-4aff-971a-fdfde5c66a3f","Type":"ContainerStarted","Data":"f56e51a2989098a2dc704503614693b43df7164d3a1679af0176d25e9a8ebd51"}
Jul 14 11:07:16.174833 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.173543    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vzdfb" podStartSLOduration=4.371170311 podStartE2EDuration="23.17352584s" totalImagesPullingTime="18.802355529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:16.172536646 +0000 UTC m=+22.625482526" watchObservedRunningTime="2026-07-14 11:07:16.17352584 +0000 UTC m=+22.626471721"
Jul 14 11:07:16.186958 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.186924    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xdmdm" podStartSLOduration=4.428739159 podStartE2EDuration="23.18691244s" totalImagesPullingTime="18.758173281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:16.186905325 +0000 UTC m=+22.639851202" watchObservedRunningTime="2026-07-14 11:07:16.18691244 +0000 UTC m=+22.639858317"
Jul 14 11:07:16.206506 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.206473    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mp5zc" podStartSLOduration=4.42227061 podStartE2EDuration="23.206461623s" totalImagesPullingTime="18.784191013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:16.206396858 +0000 UTC m=+22.659342748" watchObservedRunningTime="2026-07-14 11:07:16.206461623 +0000 UTC m=+22.659407501"
Jul 14 11:07:16.222460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.222405    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wxx9k" podStartSLOduration=4.423219809 podStartE2EDuration="23.222394465s" totalImagesPullingTime="18.799174656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:16.22196595 +0000 UTC m=+22.674911828" watchObservedRunningTime="2026-07-14 11:07:16.222394465 +0000 UTC m=+22.675340343"
Jul 14 11:07:16.267514 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:16.267480    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qg6c7" podStartSLOduration=4.491181205 podStartE2EDuration="23.26746491s" totalImagesPullingTime="18.776283705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:16.267226059 +0000 UTC m=+22.720171947" watchObservedRunningTime="2026-07-14 11:07:16.26746491 +0000 UTC m=+22.720410788"
Jul 14 11:07:17.045914 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.045852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:17.046072 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:17.045953    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:17.169315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.169288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"94bda34e905d4d0797b246f1db490f8b36962e4c131a36a133e30217d053915b"}
Jul 14 11:07:17.169722 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.169368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"bdc0927f6848e8988030c1705fc3d8a929f09bef6dc30b3de5abf2203715f024"}
Jul 14 11:07:17.169722 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.169418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"1c8eb89edd5cdc2707c0bdcb1a2e8a59abcb98c7cb9d78aaa09761c0f0d2ef7b"}
Jul 14 11:07:17.170748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.170721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4kzl" event={"ID":"8a5162eb-033c-45b2-b2a8-7b7eddc5d613","Type":"ContainerStarted","Data":"e5c55477782d81cf5a973081ac523bf6873f092a248a0c50c505b49cb9043d62"}
Jul 14 11:07:17.185126 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.185079    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j4kzl" podStartSLOduration=5.388969716 podStartE2EDuration="24.185061648s" totalImagesPullingTime="18.796091932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:17.184915066 +0000 UTC m=+23.637860945" watchObservedRunningTime="2026-07-14 11:07:17.185061648 +0000 UTC m=+23.638007528"
Jul 14 11:07:17.187317 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.187294    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 11:07:17.952223 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.952094    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T11:07:17.187313585Z","UUID":"d2157b71-5ee3-4b21-bcc1-69778d4cba07","Handler":null,"Name":"","Endpoint":""}
Jul 14 11:07:17.953939 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.953914    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 11:07:17.954078 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:17.953988    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 11:07:18.046276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:18.046246    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:18.046437 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:18.046383    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:18.046437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:18.046422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:18.046561 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:18.046530    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:18.175565 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:18.175523    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78" event={"ID":"7238246b-5f84-4ff5-aabc-798e3afa3608","Type":"ContainerStarted","Data":"6ceac2cc55a0fc17d037766393c13397c8636477e5b7e5523c0d4d8b98572265"}
Jul 14 11:07:19.046698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:19.046508    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:19.046861 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:19.046784    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:19.180964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:19.180933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"ba7d9bf7f686f5f7586f39f4d10c0f904c8ebd0cfb3c084142f7936d27dff0e2"}
Jul 14 11:07:19.182830 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:19.182810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78" event={"ID":"7238246b-5f84-4ff5-aabc-798e3afa3608","Type":"ContainerStarted","Data":"3340ca2e4622fe38af14c0a539e732735fa78a66a7630c3e255bf85ef4e10c46"}
Jul 14 11:07:19.359572 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:19.359539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:07:19.360230 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:19.360208    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:07:19.376542 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:19.376489    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swk78" podStartSLOduration=5.383275484 podStartE2EDuration="26.376473065s" totalImagesPullingTime="20.993197581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:19.204657251 +0000 UTC m=+25.657603140" watchObservedRunningTime="2026-07-14 11:07:19.376473065 +0000 UTC m=+25.829418942"
Jul 14 11:07:20.045943 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:20.045909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:20.045943 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:20.045940    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:20.046202 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:20.046019    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:20.046202 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:20.046114    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:21.046633 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.046454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:21.047247 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:21.046702    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:21.190421 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.190393    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" event={"ID":"355cd5e8-6ed9-4414-88a9-bb31006ad399","Type":"ContainerStarted","Data":"1a6bbfb7e91716fd9a3a96cb2d82fd9f23bee40738c9bed6ecebaf85bd2f0076"}
Jul 14 11:07:21.190737 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.190720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:07:21.192189 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.192166    2581 generic.go:356] "Generic (PLEG): container finished" podID="745bbd5d-f1aa-443a-af58-ed96f0048275" containerID="5d5898a3f110daeedd5f07b3cd70cc062ba86ad2bb117f02e83a76cf2d9c634c" exitCode=0
Jul 14 11:07:21.192189 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.192181    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerDied","Data":"5d5898a3f110daeedd5f07b3cd70cc062ba86ad2bb117f02e83a76cf2d9c634c"}
Jul 14 11:07:21.204959 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.204942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:07:21.215085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.215062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:07:21.215194 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.215168    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 14 11:07:21.215649 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.215632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qg6c7"
Jul 14 11:07:21.217348 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:21.217312    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb" podStartSLOduration=9.345965142 podStartE2EDuration="28.217300696s" totalImagesPullingTime="18.871335554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:21.21572808 +0000 UTC m=+27.668673994" watchObservedRunningTime="2026-07-14 11:07:21.217300696 +0000 UTC m=+27.670246574"
Jul 14 11:07:22.048505 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.048469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:22.048993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.048469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:22.048993 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:22.048600    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:22.048993 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:22.048727    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:22.195001 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.194963    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:07:22.195360 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.195346    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:07:22.210867 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.210845    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:07:22.798792 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.798765    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pql22"]
Jul 14 11:07:22.798993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.798877    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:22.799057 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:22.798996    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:22.800250 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.800222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lvmq6"]
Jul 14 11:07:22.800363 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.800314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:22.800437 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:22.800416    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:22.800733 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.800705    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q7gjd"]
Jul 14 11:07:22.800848 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:22.800794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:22.800914 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:22.800868    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:23.198944 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:23.198751    2581 generic.go:356] "Generic (PLEG): container finished" podID="745bbd5d-f1aa-443a-af58-ed96f0048275" containerID="46eb83e13a11446165685139da34055c88101c7759b81bb7f55d899daf22b0be" exitCode=0
Jul 14 11:07:23.199374 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:23.198834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerDied","Data":"46eb83e13a11446165685139da34055c88101c7759b81bb7f55d899daf22b0be"}
Jul 14 11:07:24.046907 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:24.046873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:24.047084 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:24.046961    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:25.046124 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:25.046094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:25.046898 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:25.046094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:25.046898 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:25.046222    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:25.046898 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:25.046364    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:25.205974 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:25.205907    2581 generic.go:356] "Generic (PLEG): container finished" podID="745bbd5d-f1aa-443a-af58-ed96f0048275" containerID="bc2f7ad8e51495092b6bd59800ef2b0fc293757d24f7534d7465cd6abd598d2b" exitCode=0
Jul 14 11:07:25.205974 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:25.205942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerDied","Data":"bc2f7ad8e51495092b6bd59800ef2b0fc293757d24f7534d7465cd6abd598d2b"}
Jul 14 11:07:26.046330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:26.046293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:26.046776 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:26.046417    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:27.046534 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:27.046502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:27.046977 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.046615    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmq6" podUID="e0c360fc-9142-49aa-91ad-b2f93750c852"
Jul 14 11:07:27.046977 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:27.046678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:27.046977 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.046778    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql22" podUID="27f979fc-b080-484f-8540-023f1b78e6c5"
Jul 14 11:07:27.670130 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:27.670096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:27.670310 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:27.670164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:27.670310 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:27.670229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:27.670310 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670289    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 11:07:27.670458 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670312    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:07:27.670458 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670325    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 11:07:27.670458 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670346    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 11:07:27.670458 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670359    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs podName:27f979fc-b080-484f-8540-023f1b78e6c5 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:59.670339929 +0000 UTC m=+66.123285788 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs") pod "network-metrics-daemon-pql22" (UID: "27f979fc-b080-484f-8540-023f1b78e6c5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 11:07:27.670458 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670360    2581 projected.go:196] Error preparing data for projected volume kube-api-access-h2wdp for pod openshift-network-diagnostics/network-check-target-q7gjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:07:27.670458 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670378    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret podName:e0c360fc-9142-49aa-91ad-b2f93750c852 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:59.67036849 +0000 UTC m=+66.123314345 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret") pod "global-pull-secret-syncer-lvmq6" (UID: "e0c360fc-9142-49aa-91ad-b2f93750c852") : object "kube-system"/"original-pull-secret" not registered
Jul 14 11:07:27.670458 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:27.670415    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp podName:82bd5432-bd78-4c49-b915-b2902756aadb nodeName:}" failed. No retries permitted until 2026-07-14 11:07:59.67039987 +0000 UTC m=+66.123345753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2wdp" (UniqueName: "kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp") pod "network-check-target-q7gjd" (UID: "82bd5432-bd78-4c49-b915-b2902756aadb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 11:07:28.046227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.046140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:28.046394 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:28.046272    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7gjd" podUID="82bd5432-bd78-4c49-b915-b2902756aadb"
Jul 14 11:07:28.349944 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.349913    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-125.ec2.internal" event="NodeReady"
Jul 14 11:07:28.350529 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.350087    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 11:07:28.395524 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.395498    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8l87r"]
Jul 14 11:07:28.398431 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.398394    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.400056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.400029    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zlqhn"]
Jul 14 11:07:28.401834 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.401816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:28.403465 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.403416    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 11:07:28.403598 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.403552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 11:07:28.403798 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.403780    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-grcgd\""
Jul 14 11:07:28.404239 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.404219    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 11:07:28.404344 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.404261    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 11:07:28.404748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.404728    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7vlft\""
Jul 14 11:07:28.404822 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.404731    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 11:07:28.409460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.409438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8l87r"]
Jul 14 11:07:28.412400 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.412378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlqhn"]
Jul 14 11:07:28.575942 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.575905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af456ff-1a86-41dc-90f9-6c6566c40355-tmp-dir\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.576125 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.575957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7af456ff-1a86-41dc-90f9-6c6566c40355-config-volume\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.576125 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.575993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ncr\" (UniqueName: \"kubernetes.io/projected/c88130e7-b11f-4ac9-bbbb-6bc55657e978-kube-api-access-j9ncr\") pod \"ingress-canary-zlqhn\" (UID: \"c88130e7-b11f-4ac9-bbbb-6bc55657e978\") " pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:28.576125 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.576052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.576125 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.576091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9td6\" (UniqueName: \"kubernetes.io/projected/7af456ff-1a86-41dc-90f9-6c6566c40355-kube-api-access-f9td6\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.576330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.576213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c88130e7-b11f-4ac9-bbbb-6bc55657e978-cert\") pod \"ingress-canary-zlqhn\" (UID: \"c88130e7-b11f-4ac9-bbbb-6bc55657e978\") " pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:28.677239 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.677161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c88130e7-b11f-4ac9-bbbb-6bc55657e978-cert\") pod \"ingress-canary-zlqhn\" (UID: \"c88130e7-b11f-4ac9-bbbb-6bc55657e978\") " pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:28.677239 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.677235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af456ff-1a86-41dc-90f9-6c6566c40355-tmp-dir\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.677425 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.677405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7af456ff-1a86-41dc-90f9-6c6566c40355-config-volume\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.677493 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.677442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ncr\" (UniqueName: \"kubernetes.io/projected/c88130e7-b11f-4ac9-bbbb-6bc55657e978-kube-api-access-j9ncr\") pod \"ingress-canary-zlqhn\" (UID: \"c88130e7-b11f-4ac9-bbbb-6bc55657e978\") " pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:28.677493 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.677470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.677596 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.677535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7af456ff-1a86-41dc-90f9-6c6566c40355-tmp-dir\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.677596 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.677588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9td6\" (UniqueName: \"kubernetes.io/projected/7af456ff-1a86-41dc-90f9-6c6566c40355-kube-api-access-f9td6\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.677696 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:28.677641    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 11:07:28.677696 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:28.677691    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls podName:7af456ff-1a86-41dc-90f9-6c6566c40355 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:29.177677079 +0000 UTC m=+35.630622935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls") pod "dns-default-8l87r" (UID: "7af456ff-1a86-41dc-90f9-6c6566c40355") : secret "dns-default-metrics-tls" not found
Jul 14 11:07:28.678059 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.678036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7af456ff-1a86-41dc-90f9-6c6566c40355-config-volume\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.681632 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.681607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c88130e7-b11f-4ac9-bbbb-6bc55657e978-cert\") pod \"ingress-canary-zlqhn\" (UID: \"c88130e7-b11f-4ac9-bbbb-6bc55657e978\") " pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:28.688663 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.688483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9td6\" (UniqueName: \"kubernetes.io/projected/7af456ff-1a86-41dc-90f9-6c6566c40355-kube-api-access-f9td6\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:28.688770 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.688749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ncr\" (UniqueName: \"kubernetes.io/projected/c88130e7-b11f-4ac9-bbbb-6bc55657e978-kube-api-access-j9ncr\") pod \"ingress-canary-zlqhn\" (UID: \"c88130e7-b11f-4ac9-bbbb-6bc55657e978\") " pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:28.717709 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:28.717674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlqhn"
Jul 14 11:07:29.046519 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.046500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:29.046720 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.046680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:29.049077 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.049060    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 11:07:29.049186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.049167    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bhbfh\""
Jul 14 11:07:29.050110 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.050094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 11:07:29.136369 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.136346    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlqhn"]
Jul 14 11:07:29.139608 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:07:29.139586    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88130e7_b11f_4ac9_bbbb_6bc55657e978.slice/crio-3204a668eb0a8de23f43ba625f0fb92e8db8cdaf24090164144fe80501c642e8 WatchSource:0}: Error finding container 3204a668eb0a8de23f43ba625f0fb92e8db8cdaf24090164144fe80501c642e8: Status 404 returned error can't find the container with id 3204a668eb0a8de23f43ba625f0fb92e8db8cdaf24090164144fe80501c642e8
Jul 14 11:07:29.181610 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.181579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:29.181759 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:29.181740    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 11:07:29.181811 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:29.181799    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls podName:7af456ff-1a86-41dc-90f9-6c6566c40355 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:30.181784773 +0000 UTC m=+36.634730629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls") pod "dns-default-8l87r" (UID: "7af456ff-1a86-41dc-90f9-6c6566c40355") : secret "dns-default-metrics-tls" not found
Jul 14 11:07:29.221830 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.221797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerStarted","Data":"261fb6b063dfb801cd10a2a27ca096abb0dd9a47a2b861bf9d1e7b589e80b48c"}
Jul 14 11:07:29.223245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:29.223226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlqhn" event={"ID":"c88130e7-b11f-4ac9-bbbb-6bc55657e978","Type":"ContainerStarted","Data":"3204a668eb0a8de23f43ba625f0fb92e8db8cdaf24090164144fe80501c642e8"}
Jul 14 11:07:30.046201 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:30.046167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:30.050100 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:30.050075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zjjh4\""
Jul 14 11:07:30.050100 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:30.050098    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 11:07:30.050290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:30.050169    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 11:07:30.188466 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:30.188429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:30.188684 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:30.188587    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 11:07:30.188684 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:30.188649    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls podName:7af456ff-1a86-41dc-90f9-6c6566c40355 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:32.18863278 +0000 UTC m=+38.641578636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls") pod "dns-default-8l87r" (UID: "7af456ff-1a86-41dc-90f9-6c6566c40355") : secret "dns-default-metrics-tls" not found
Jul 14 11:07:30.229196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:30.229141    2581 generic.go:356] "Generic (PLEG): container finished" podID="745bbd5d-f1aa-443a-af58-ed96f0048275" containerID="261fb6b063dfb801cd10a2a27ca096abb0dd9a47a2b861bf9d1e7b589e80b48c" exitCode=0
Jul 14 11:07:30.229329 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:30.229212    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerDied","Data":"261fb6b063dfb801cd10a2a27ca096abb0dd9a47a2b861bf9d1e7b589e80b48c"}
Jul 14 11:07:31.235896 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:31.235646    2581 generic.go:356] "Generic (PLEG): container finished" podID="745bbd5d-f1aa-443a-af58-ed96f0048275" containerID="ebd3bf3551aaf8d00b24e735b9e606d821168430f342d894d3153138508c1f3f" exitCode=0
Jul 14 11:07:31.235896 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:31.235732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerDied","Data":"ebd3bf3551aaf8d00b24e735b9e606d821168430f342d894d3153138508c1f3f"}
Jul 14 11:07:32.205369 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:32.205340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:32.205549 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:32.205498    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 11:07:32.205614 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:32.205573    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls podName:7af456ff-1a86-41dc-90f9-6c6566c40355 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:36.205552972 +0000 UTC m=+42.658498855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls") pod "dns-default-8l87r" (UID: "7af456ff-1a86-41dc-90f9-6c6566c40355") : secret "dns-default-metrics-tls" not found
Jul 14 11:07:32.240576 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:32.240538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" event={"ID":"745bbd5d-f1aa-443a-af58-ed96f0048275","Type":"ContainerStarted","Data":"e8bc47f92bf787a6394d6db8a04e7da06b2c5c72fe1e98f1b3f22c03f066d068"}
Jul 14 11:07:32.241761 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:32.241741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlqhn" event={"ID":"c88130e7-b11f-4ac9-bbbb-6bc55657e978","Type":"ContainerStarted","Data":"c73c25477c78450953fd88844cb60e583666c8bdc18349134d3bb75511c52c0d"}
Jul 14 11:07:32.262144 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:32.262009    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzzjp" podStartSLOduration=9.75476988 podStartE2EDuration="39.261995828s" totalImagesPullingTime="29.507225948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:32.26078962 +0000 UTC m=+38.713735497" watchObservedRunningTime="2026-07-14 11:07:32.261995828 +0000 UTC m=+38.714941708"
Jul 14 11:07:32.274836 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:32.274790    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zlqhn" podStartSLOduration=1.936143576 podStartE2EDuration="4.274777861s" totalImagesPullingTime="2.338634285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:32.274212172 +0000 UTC m=+38.727158051" watchObservedRunningTime="2026-07-14 11:07:32.274777861 +0000 UTC m=+38.727723738"
Jul 14 11:07:33.336766 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.336737    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"]
Jul 14 11:07:33.369494 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.369469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"]
Jul 14 11:07:33.369619 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.369555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"
Jul 14 11:07:33.372163 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.372117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gwjfc\""
Jul 14 11:07:33.372163 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.372122    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 14 11:07:33.372309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.372127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 14 11:07:33.442680 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.442652    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6fbbc7db94-vdx9z"]
Jul 14 11:07:33.464249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.464224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fbbc7db94-vdx9z"]
Jul 14 11:07:33.464364 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.464309    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.467120 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.467103    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7d62c\""
Jul 14 11:07:33.467223 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.467103    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 14 11:07:33.467223 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.467105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 14 11:07:33.467593 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.467568    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 14 11:07:33.467685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.467663    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 11:07:33.467748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.467722    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 11:07:33.467935 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.467921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 14 11:07:33.516496 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.516471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6w4j\" (UniqueName: \"kubernetes.io/projected/f37f13c8-f48c-4753-b912-eaddfad26793-kube-api-access-b6w4j\") pod \"volume-data-source-validator-78495597f6-cxbl6\" (UID: \"f37f13c8-f48c-4753-b912-eaddfad26793\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"
Jul 14 11:07:33.617067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.616997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-default-certificate\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.617067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.617029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.617278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.617069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.617278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.617098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6w4j\" (UniqueName: \"kubernetes.io/projected/f37f13c8-f48c-4753-b912-eaddfad26793-kube-api-access-b6w4j\") pod \"volume-data-source-validator-78495597f6-cxbl6\" (UID: \"f37f13c8-f48c-4753-b912-eaddfad26793\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"
Jul 14 11:07:33.617278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.617174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-stats-auth\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.617278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.617216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tlhr\" (UniqueName: \"kubernetes.io/projected/77e7b20a-f34d-4c02-96f3-561ed0832cbc-kube-api-access-7tlhr\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.627278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.627259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6w4j\" (UniqueName: \"kubernetes.io/projected/f37f13c8-f48c-4753-b912-eaddfad26793-kube-api-access-b6w4j\") pod \"volume-data-source-validator-78495597f6-cxbl6\" (UID: \"f37f13c8-f48c-4753-b912-eaddfad26793\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"
Jul 14 11:07:33.678153 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.678131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"
Jul 14 11:07:33.718063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.718036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-stats-auth\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.718182 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.718098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tlhr\" (UniqueName: \"kubernetes.io/projected/77e7b20a-f34d-4c02-96f3-561ed0832cbc-kube-api-access-7tlhr\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.718315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.718293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-default-certificate\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.718383 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.718323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.718383 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.718354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.718519 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:33.718440    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 11:07:33.718519 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:33.718490    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:34.218469758 +0000 UTC m=+40.671415628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : configmap references non-existent config key: service-ca.crt
Jul 14 11:07:33.718519 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:33.718512    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:34.218502984 +0000 UTC m=+40.671448846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : secret "router-metrics-certs-default" not found
Jul 14 11:07:33.720470 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.720451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-stats-auth\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.720797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.720780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-default-certificate\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.726367 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.726346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tlhr\" (UniqueName: \"kubernetes.io/projected/77e7b20a-f34d-4c02-96f3-561ed0832cbc-kube-api-access-7tlhr\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:33.816761 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:33.816576    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6"]
Jul 14 11:07:33.819554 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:07:33.819529    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37f13c8_f48c_4753_b912_eaddfad26793.slice/crio-adeb10db740380c623a69280d3a72cfd14181a031a0815db777422cbba25bcae WatchSource:0}: Error finding container adeb10db740380c623a69280d3a72cfd14181a031a0815db777422cbba25bcae: Status 404 returned error can't find the container with id adeb10db740380c623a69280d3a72cfd14181a031a0815db777422cbba25bcae
Jul 14 11:07:34.221557 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:34.221521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:34.221760 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:34.221566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:34.221760 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:34.221675    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 11:07:34.221760 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:34.221687    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:35.2216752 +0000 UTC m=+41.674621069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : configmap references non-existent config key: service-ca.crt
Jul 14 11:07:34.221760 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:34.221736    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:35.221723811 +0000 UTC m=+41.674669666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : secret "router-metrics-certs-default" not found
Jul 14 11:07:34.246990 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:34.246957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6" event={"ID":"f37f13c8-f48c-4753-b912-eaddfad26793","Type":"ContainerStarted","Data":"adeb10db740380c623a69280d3a72cfd14181a031a0815db777422cbba25bcae"}
Jul 14 11:07:35.229581 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:35.229544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:35.229581 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:35.229594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:35.230094 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:35.229713    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 11:07:35.230094 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:35.229762    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:37.229744684 +0000 UTC m=+43.682690540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : configmap references non-existent config key: service-ca.crt
Jul 14 11:07:35.230094 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:35.229789    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:37.229781936 +0000 UTC m=+43.682727792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : secret "router-metrics-certs-default" not found
Jul 14 11:07:36.236925 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:36.236894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:36.237285 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:36.237039    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 11:07:36.237285 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:36.237101    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls podName:7af456ff-1a86-41dc-90f9-6c6566c40355 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:44.237086256 +0000 UTC m=+50.690032111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls") pod "dns-default-8l87r" (UID: "7af456ff-1a86-41dc-90f9-6c6566c40355") : secret "dns-default-metrics-tls" not found
Jul 14 11:07:36.252676 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:36.252649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6" event={"ID":"f37f13c8-f48c-4753-b912-eaddfad26793","Type":"ContainerStarted","Data":"2fd55dc252bce77003a7e7589ee9c09e81a0945128462ed053c54f5f0f5520d0"}
Jul 14 11:07:36.269556 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:36.269518    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cxbl6" podStartSLOduration=1.665674192 podStartE2EDuration="3.26950475s" totalImagesPullingTime="1.603830558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:36.268625098 +0000 UTC m=+42.721570975" watchObservedRunningTime="2026-07-14 11:07:36.26950475 +0000 UTC m=+42.722450625"
Jul 14 11:07:37.243590 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.243552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:37.243946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.243599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:37.243946 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:37.243712    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 11:07:37.243946 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:37.243751    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:41.243733052 +0000 UTC m=+47.696678922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : configmap references non-existent config key: service-ca.crt
Jul 14 11:07:37.243946 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:37.243766    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:41.243760579 +0000 UTC m=+47.696706434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : secret "router-metrics-certs-default" not found
Jul 14 11:07:37.393074 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.393042    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r9wpm"]
Jul 14 11:07:37.412484 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.412454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.422818 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.422798    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 11:07:37.422900 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.422875    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 11:07:37.424135 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.424121    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 11:07:37.424371 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.424356    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 11:07:37.426518 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.426502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r9wpm"]
Jul 14 11:07:37.427437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.427420    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-24zbp\""
Jul 14 11:07:37.546438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.546366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swwcq\" (UniqueName: \"kubernetes.io/projected/0779c170-99ba-4ca7-847e-6defef4ba484-kube-api-access-swwcq\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.546438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.546402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.546438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.546426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.546651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.546509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0779c170-99ba-4ca7-847e-6defef4ba484-data-volume\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.546651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.546552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0779c170-99ba-4ca7-847e-6defef4ba484-crio-socket\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.647859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.647823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.647859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.647859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.648039 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.647915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0779c170-99ba-4ca7-847e-6defef4ba484-data-volume\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.648039 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.647933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0779c170-99ba-4ca7-847e-6defef4ba484-crio-socket\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.648039 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:37.647944    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 11:07:37.648039 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:37.648007    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:38.147989837 +0000 UTC m=+44.600935712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : configmap "kube-rbac-proxy" not found
Jul 14 11:07:37.648214 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:37.648055    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:37.648214 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:37.648107    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:38.148092684 +0000 UTC m=+44.601038539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:37.648214 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.648106    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0779c170-99ba-4ca7-847e-6defef4ba484-crio-socket\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.648214 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.648101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swwcq\" (UniqueName: \"kubernetes.io/projected/0779c170-99ba-4ca7-847e-6defef4ba484-kube-api-access-swwcq\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.648340 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.648321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0779c170-99ba-4ca7-847e-6defef4ba484-data-volume\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:37.657092 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:37.657074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swwcq\" (UniqueName: \"kubernetes.io/projected/0779c170-99ba-4ca7-847e-6defef4ba484-kube-api-access-swwcq\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:38.152585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.152555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:38.152585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.152584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:38.152790 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:38.152670    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 11:07:38.152790 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:38.152682    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:38.152790 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:38.152730    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:39.152714704 +0000 UTC m=+45.605660573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:38.152888 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:38.152806    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:39.152791081 +0000 UTC m=+45.605736949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : configmap "kube-rbac-proxy" not found
Jul 14 11:07:38.618825 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.618789    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"]
Jul 14 11:07:38.645416 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.645392    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"]
Jul 14 11:07:38.645561 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.645502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"
Jul 14 11:07:38.648476 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.648455    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 14 11:07:38.649286 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.649272    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 14 11:07:38.649286 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.649279    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hfq79\""
Jul 14 11:07:38.655430 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.655409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r856b\" (UniqueName: \"kubernetes.io/projected/f51b19a5-ff43-4f70-8354-13b915543ea3-kube-api-access-r856b\") pod \"migrator-7f59b54f6c-mg4mx\" (UID: \"f51b19a5-ff43-4f70-8354-13b915543ea3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"
Jul 14 11:07:38.756499 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.756465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r856b\" (UniqueName: \"kubernetes.io/projected/f51b19a5-ff43-4f70-8354-13b915543ea3-kube-api-access-r856b\") pod \"migrator-7f59b54f6c-mg4mx\" (UID: \"f51b19a5-ff43-4f70-8354-13b915543ea3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"
Jul 14 11:07:38.768438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.768413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r856b\" (UniqueName: \"kubernetes.io/projected/f51b19a5-ff43-4f70-8354-13b915543ea3-kube-api-access-r856b\") pod \"migrator-7f59b54f6c-mg4mx\" (UID: \"f51b19a5-ff43-4f70-8354-13b915543ea3\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"
Jul 14 11:07:38.953607 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:38.953528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"
Jul 14 11:07:39.124297 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:39.124270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx"]
Jul 14 11:07:39.126958 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:07:39.126936    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51b19a5_ff43_4f70_8354_13b915543ea3.slice/crio-62311b10db4e1a3d8249ad8721d2172ef6d113cf06dedb0a263b4755450a866d WatchSource:0}: Error finding container 62311b10db4e1a3d8249ad8721d2172ef6d113cf06dedb0a263b4755450a866d: Status 404 returned error can't find the container with id 62311b10db4e1a3d8249ad8721d2172ef6d113cf06dedb0a263b4755450a866d
Jul 14 11:07:39.165346 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:39.165322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:39.165455 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:39.165353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:39.165455 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:39.165436    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 11:07:39.165455 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:39.165452    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:39.165549 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:39.165497    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:41.165484995 +0000 UTC m=+47.618430851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:39.165549 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:39.165510    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:41.165504609 +0000 UTC m=+47.618450466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : configmap "kube-rbac-proxy" not found
Jul 14 11:07:39.259689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:39.259624    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx" event={"ID":"f51b19a5-ff43-4f70-8354-13b915543ea3","Type":"ContainerStarted","Data":"62311b10db4e1a3d8249ad8721d2172ef6d113cf06dedb0a263b4755450a866d"}
Jul 14 11:07:39.670913 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:39.670889    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wxx9k_484fe3a1-4a30-4b1d-9d4f-5343989fd5e4/dns-node-resolver/0.log"
Jul 14 11:07:40.268949 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:40.268922    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xdmdm_ccf3a373-3d7c-4bbb-86fe-76aed78860f7/node-ca/0.log"
Jul 14 11:07:41.180723 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:41.180698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:41.181069 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:41.180735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:41.181069 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:41.180818    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 11:07:41.181069 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:41.180881    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:45.180863813 +0000 UTC m=+51.633809700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : configmap "kube-rbac-proxy" not found
Jul 14 11:07:41.181069 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:41.180923    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:41.181069 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:41.180968    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:45.180956056 +0000 UTC m=+51.633901924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:41.266381 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:41.266303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx" event={"ID":"f51b19a5-ff43-4f70-8354-13b915543ea3","Type":"ContainerStarted","Data":"6941031cdf930d184bc616e8c115068c46358c097ed92587339717bc13567401"}
Jul 14 11:07:41.266381 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:41.266360    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx" event={"ID":"f51b19a5-ff43-4f70-8354-13b915543ea3","Type":"ContainerStarted","Data":"174ba449875275a0ee18a9c4a8ce7d167860b44d88a4a6973859da8a9e07c5a7"}
Jul 14 11:07:41.267759 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:41.267736    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlqhn_c88130e7-b11f-4ac9-bbbb-6bc55657e978/serve-healthcheck-canary/0.log"
Jul 14 11:07:41.281893 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:41.281846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:41.281893 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:41.281880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:41.282024 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:41.282007    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 11:07:41.282068 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:41.282059    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:49.282046934 +0000 UTC m=+55.734992791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : secret "router-metrics-certs-default" not found
Jul 14 11:07:41.282109 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:41.282074    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:07:49.282068186 +0000 UTC m=+55.735014042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : configmap references non-existent config key: service-ca.crt
Jul 14 11:07:42.285452 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:42.285410    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-mg4mx" podStartSLOduration=2.3823863960000002 podStartE2EDuration="4.285395817s" totalImagesPullingTime="1.903009421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:07:42.284188297 +0000 UTC m=+48.737134174" watchObservedRunningTime="2026-07-14 11:07:42.285395817 +0000 UTC m=+48.738341672"
Jul 14 11:07:44.303989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:44.303956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:07:44.304415 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:44.304118    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 11:07:44.304415 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:44.304190    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls podName:7af456ff-1a86-41dc-90f9-6c6566c40355 nodeName:}" failed. No retries permitted until 2026-07-14 11:08:00.304176035 +0000 UTC m=+66.757121891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls") pod "dns-default-8l87r" (UID: "7af456ff-1a86-41dc-90f9-6c6566c40355") : secret "dns-default-metrics-tls" not found
Jul 14 11:07:45.210496 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:45.210457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:45.210496 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:45.210498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:45.210733 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:45.210586    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 11:07:45.210733 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:45.210666    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:53.210646047 +0000 UTC m=+59.663591920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : configmap "kube-rbac-proxy" not found
Jul 14 11:07:45.210733 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:45.210674    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:45.210733 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:45.210713    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:07:53.210702209 +0000 UTC m=+59.663648081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:49.339418 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:49.339372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:49.339418 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:49.339433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:07:49.339963 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:49.339522    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 11:07:49.339963 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:49.339565    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:08:05.339552534 +0000 UTC m=+71.792498390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : configmap references non-existent config key: service-ca.crt
Jul 14 11:07:49.339963 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:49.339581    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs podName:77e7b20a-f34d-4c02-96f3-561ed0832cbc nodeName:}" failed. No retries permitted until 2026-07-14 11:08:05.339573473 +0000 UTC m=+71.792519330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs") pod "router-default-6fbbc7db94-vdx9z" (UID: "77e7b20a-f34d-4c02-96f3-561ed0832cbc") : secret "router-metrics-certs-default" not found
Jul 14 11:07:53.267208 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:53.267174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:53.267591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:53.267214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:53.267591 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:53.267349    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:53.267591 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:07:53.267399    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls podName:0779c170-99ba-4ca7-847e-6defef4ba484 nodeName:}" failed. No retries permitted until 2026-07-14 11:08:09.267386292 +0000 UTC m=+75.720332148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r9wpm" (UID: "0779c170-99ba-4ca7-847e-6defef4ba484") : secret "insights-runtime-extractor-tls" not found
Jul 14 11:07:53.267726 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:53.267703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0779c170-99ba-4ca7-847e-6defef4ba484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:07:54.210911 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:54.210884    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztpgb"
Jul 14 11:07:59.712437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.712401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:59.712862 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.712453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:59.712862 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.712616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:59.715018 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.715003    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 11:07:59.715968 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.715954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 11:07:59.716015 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.715972    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 11:07:59.725127 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.725097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0c360fc-9142-49aa-91ad-b2f93750c852-original-pull-secret\") pod \"global-pull-secret-syncer-lvmq6\" (UID: \"e0c360fc-9142-49aa-91ad-b2f93750c852\") " pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:59.725127 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.725123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27f979fc-b080-484f-8540-023f1b78e6c5-metrics-certs\") pod \"network-metrics-daemon-pql22\" (UID: \"27f979fc-b080-484f-8540-023f1b78e6c5\") " pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:07:59.725607 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.725593    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 11:07:59.736086 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.736054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wdp\" (UniqueName: \"kubernetes.io/projected/82bd5432-bd78-4c49-b915-b2902756aadb-kube-api-access-h2wdp\") pod \"network-check-target-q7gjd\" (UID: \"82bd5432-bd78-4c49-b915-b2902756aadb\") " pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:59.759475 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.759457    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zjjh4\""
Jul 14 11:07:59.766824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.766807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:07:59.929335 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.929305    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q7gjd"]
Jul 14 11:07:59.932176 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:07:59.932140    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82bd5432_bd78_4c49_b915_b2902756aadb.slice/crio-cbfa1b9d1cf35e4d081d26558ef6c75aa4c94544e59ccf3950c017696ae5580f WatchSource:0}: Error finding container cbfa1b9d1cf35e4d081d26558ef6c75aa4c94544e59ccf3950c017696ae5580f: Status 404 returned error can't find the container with id cbfa1b9d1cf35e4d081d26558ef6c75aa4c94544e59ccf3950c017696ae5580f
Jul 14 11:07:59.964843 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.964796    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bhbfh\""
Jul 14 11:07:59.969029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.969017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmq6"
Jul 14 11:07:59.970605 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:07:59.970589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql22"
Jul 14 11:08:00.124552 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.124531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lvmq6"]
Jul 14 11:08:00.126916 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:00.126886    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c360fc_9142_49aa_91ad_b2f93750c852.slice/crio-2f14894168228ede9713f7f1222a3ca0ef4a7d24a1ef44afedbee5eb454a4ef4 WatchSource:0}: Error finding container 2f14894168228ede9713f7f1222a3ca0ef4a7d24a1ef44afedbee5eb454a4ef4: Status 404 returned error can't find the container with id 2f14894168228ede9713f7f1222a3ca0ef4a7d24a1ef44afedbee5eb454a4ef4
Jul 14 11:08:00.143232 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.143205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pql22"]
Jul 14 11:08:00.145268 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:00.145246    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f979fc_b080_484f_8540_023f1b78e6c5.slice/crio-870633d6da3a4bff74641bcda76b12510c5f52a026e36f20a7107ef341f2e0f4 WatchSource:0}: Error finding container 870633d6da3a4bff74641bcda76b12510c5f52a026e36f20a7107ef341f2e0f4: Status 404 returned error can't find the container with id 870633d6da3a4bff74641bcda76b12510c5f52a026e36f20a7107ef341f2e0f4
Jul 14 11:08:00.316261 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.316232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lvmq6" event={"ID":"e0c360fc-9142-49aa-91ad-b2f93750c852","Type":"ContainerStarted","Data":"2f14894168228ede9713f7f1222a3ca0ef4a7d24a1ef44afedbee5eb454a4ef4"}
Jul 14 11:08:00.316763 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.316745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:08:00.317415 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.317392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q7gjd" event={"ID":"82bd5432-bd78-4c49-b915-b2902756aadb","Type":"ContainerStarted","Data":"cbfa1b9d1cf35e4d081d26558ef6c75aa4c94544e59ccf3950c017696ae5580f"}
Jul 14 11:08:00.318380 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.318360    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pql22" event={"ID":"27f979fc-b080-484f-8540-023f1b78e6c5","Type":"ContainerStarted","Data":"870633d6da3a4bff74641bcda76b12510c5f52a026e36f20a7107ef341f2e0f4"}
Jul 14 11:08:00.319020 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.319005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7af456ff-1a86-41dc-90f9-6c6566c40355-metrics-tls\") pod \"dns-default-8l87r\" (UID: \"7af456ff-1a86-41dc-90f9-6c6566c40355\") " pod="openshift-dns/dns-default-8l87r"
Jul 14 11:08:00.514187 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.514144    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-grcgd\""
Jul 14 11:08:00.522458 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.522434    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8l87r"
Jul 14 11:08:00.679781 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:00.679700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8l87r"]
Jul 14 11:08:00.682617 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:00.682587    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af456ff_1a86_41dc_90f9_6c6566c40355.slice/crio-d4c171c35f77766423add7395cda5f76f4ef82fe364454a19d253e0cf71cb0d1 WatchSource:0}: Error finding container d4c171c35f77766423add7395cda5f76f4ef82fe364454a19d253e0cf71cb0d1: Status 404 returned error can't find the container with id d4c171c35f77766423add7395cda5f76f4ef82fe364454a19d253e0cf71cb0d1
Jul 14 11:08:01.322635 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:01.322568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8l87r" event={"ID":"7af456ff-1a86-41dc-90f9-6c6566c40355","Type":"ContainerStarted","Data":"d4c171c35f77766423add7395cda5f76f4ef82fe364454a19d253e0cf71cb0d1"}
Jul 14 11:08:02.328128 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:02.328078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pql22" event={"ID":"27f979fc-b080-484f-8540-023f1b78e6c5","Type":"ContainerStarted","Data":"a6cce44e41379af2b18bb4708ee20c33411377c74c01fab143f9615d22eb1424"}
Jul 14 11:08:02.328609 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:02.328161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pql22" event={"ID":"27f979fc-b080-484f-8540-023f1b78e6c5","Type":"ContainerStarted","Data":"e9fb59d8357a76f9cb033f8b6ea824c0c68bfd717332d92a7c4ae83f98ea1ac2"}
Jul 14 11:08:02.345129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:02.345065    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pql22" podStartSLOduration=67.81321372 podStartE2EDuration="1m9.345048145s" totalImagesPullingTime="1.531834425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:02.343852979 +0000 UTC m=+68.796798908" watchObservedRunningTime="2026-07-14 11:08:02.345048145 +0000 UTC m=+68.797994031"
Jul 14 11:08:04.846665 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.846623    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"]
Jul 14 11:08:04.848904 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.848883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:04.853823 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.853801    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 11:08:04.854925 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.854905    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 11:08:04.855030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.854951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 14 11:08:04.855211 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.855194    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 11:08:04.873847 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.873818    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"]
Jul 14 11:08:04.948999 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.948972    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-lxkmm"]
Jul 14 11:08:04.951128 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.951107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-lxkmm"
Jul 14 11:08:04.954051 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.954024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 11:08:04.954210 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.954058    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ktvtc\""
Jul 14 11:08:04.954431 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.954412    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 11:08:04.955597 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.955572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/494597e0-2aa4-4583-9589-c54f783f51f3-tmp\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:04.955700 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.955625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/494597e0-2aa4-4583-9589-c54f783f51f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:04.955700 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.955650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6kr6\" (UniqueName: \"kubernetes.io/projected/494597e0-2aa4-4583-9589-c54f783f51f3-kube-api-access-h6kr6\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:04.974300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:04.974277    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-lxkmm"]
Jul 14 11:08:05.056109 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.056075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/494597e0-2aa4-4583-9589-c54f783f51f3-tmp\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:05.056460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.056126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/494597e0-2aa4-4583-9589-c54f783f51f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:05.056460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.056206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6kr6\" (UniqueName: \"kubernetes.io/projected/494597e0-2aa4-4583-9589-c54f783f51f3-kube-api-access-h6kr6\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:05.056460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.056240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926dp\" (UniqueName: \"kubernetes.io/projected/1f299971-fa8c-4de0-a8a3-ad55d920d3f3-kube-api-access-926dp\") pod \"downloads-68c9cbb497-lxkmm\" (UID: \"1f299971-fa8c-4de0-a8a3-ad55d920d3f3\") " pod="openshift-console/downloads-68c9cbb497-lxkmm"
Jul 14 11:08:05.056613 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.056528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/494597e0-2aa4-4583-9589-c54f783f51f3-tmp\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:05.058816 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.058794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/494597e0-2aa4-4583-9589-c54f783f51f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:05.071186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.071164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6kr6\" (UniqueName: \"kubernetes.io/projected/494597e0-2aa4-4583-9589-c54f783f51f3-kube-api-access-h6kr6\") pod \"klusterlet-addon-workmgr-5bf7486f8d-2rffg\" (UID: \"494597e0-2aa4-4583-9589-c54f783f51f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:05.156735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.156713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926dp\" (UniqueName: \"kubernetes.io/projected/1f299971-fa8c-4de0-a8a3-ad55d920d3f3-kube-api-access-926dp\") pod \"downloads-68c9cbb497-lxkmm\" (UID: \"1f299971-fa8c-4de0-a8a3-ad55d920d3f3\") " pod="openshift-console/downloads-68c9cbb497-lxkmm"
Jul 14 11:08:05.160655 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.160469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:05.167710 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.167692    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-926dp\" (UniqueName: \"kubernetes.io/projected/1f299971-fa8c-4de0-a8a3-ad55d920d3f3-kube-api-access-926dp\") pod \"downloads-68c9cbb497-lxkmm\" (UID: \"1f299971-fa8c-4de0-a8a3-ad55d920d3f3\") " pod="openshift-console/downloads-68c9cbb497-lxkmm"
Jul 14 11:08:05.262653 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.262594    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-lxkmm"
Jul 14 11:08:05.344899 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.344684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8l87r" event={"ID":"7af456ff-1a86-41dc-90f9-6c6566c40355","Type":"ContainerStarted","Data":"ebdc513074ee5e9f0bf0a1ef09d73671c0629d9d9c5f914152cd1f74c4d1104d"}
Jul 14 11:08:05.344899 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.344740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8l87r" event={"ID":"7af456ff-1a86-41dc-90f9-6c6566c40355","Type":"ContainerStarted","Data":"60105377ff09bdc6e690243f984b7898fce9ed15bc1501ad1e8d0a93b7e1e259"}
Jul 14 11:08:05.344899 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.344818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8l87r"
Jul 14 11:08:05.346333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.346311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lvmq6" event={"ID":"e0c360fc-9142-49aa-91ad-b2f93750c852","Type":"ContainerStarted","Data":"91c3edf6985d71ba40007efd722c4bea476637f5a73f81a18bd5b2b66b3a30b5"}
Jul 14 11:08:05.348341 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.348299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q7gjd" event={"ID":"82bd5432-bd78-4c49-b915-b2902756aadb","Type":"ContainerStarted","Data":"92bff7985afec71925ff95226191182ad6d4f6c6f480135eb84bc449b3a64a3e"}
Jul 14 11:08:05.348522 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.348487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:08:05.351108 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.351069    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"]
Jul 14 11:08:05.358061 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.358007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:05.358061 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.358036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:05.358645 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.358628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77e7b20a-f34d-4c02-96f3-561ed0832cbc-service-ca-bundle\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:05.360408 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.360385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e7b20a-f34d-4c02-96f3-561ed0832cbc-metrics-certs\") pod \"router-default-6fbbc7db94-vdx9z\" (UID: \"77e7b20a-f34d-4c02-96f3-561ed0832cbc\") " pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:05.373411 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.373346    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8l87r" podStartSLOduration=32.979167616 podStartE2EDuration="37.373330085s" totalImagesPullingTime="4.394162469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:05.373300394 +0000 UTC m=+71.826246274" watchObservedRunningTime="2026-07-14 11:08:05.373330085 +0000 UTC m=+71.826275964"
Jul 14 11:08:05.397394 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.397341    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lvmq6" podStartSLOduration=67.439271578 podStartE2EDuration="1m12.397326165s" totalImagesPullingTime="4.958054587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:05.396201352 +0000 UTC m=+71.849147231" watchObservedRunningTime="2026-07-14 11:08:05.397326165 +0000 UTC m=+71.850272043"
Jul 14 11:08:05.412796 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.412771    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-lxkmm"]
Jul 14 11:08:05.415248 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.415210    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q7gjd" podStartSLOduration=67.273995001 podStartE2EDuration="1m12.415196767s" totalImagesPullingTime="5.141201766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:05.414940841 +0000 UTC m=+71.867886730" watchObservedRunningTime="2026-07-14 11:08:05.415196767 +0000 UTC m=+71.868142644"
Jul 14 11:08:05.416053 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:05.416033    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f299971_fa8c_4de0_a8a3_ad55d920d3f3.slice/crio-e8d700ae58b2f32ce174a68e50a34393302a3c307de0a45fe0c42b9d643b23b6 WatchSource:0}: Error finding container e8d700ae58b2f32ce174a68e50a34393302a3c307de0a45fe0c42b9d643b23b6: Status 404 returned error can't find the container with id e8d700ae58b2f32ce174a68e50a34393302a3c307de0a45fe0c42b9d643b23b6
Jul 14 11:08:05.576340 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.576311    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7d62c\""
Jul 14 11:08:05.584113 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.584093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:05.716845 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:05.716814    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6fbbc7db94-vdx9z"]
Jul 14 11:08:05.719711 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:05.719685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e7b20a_f34d_4c02_96f3_561ed0832cbc.slice/crio-8a85a6c4b5752ad93555e7fc29d4d4d80d2af96a46bf0ea59b78cc7e6709e813 WatchSource:0}: Error finding container 8a85a6c4b5752ad93555e7fc29d4d4d80d2af96a46bf0ea59b78cc7e6709e813: Status 404 returned error can't find the container with id 8a85a6c4b5752ad93555e7fc29d4d4d80d2af96a46bf0ea59b78cc7e6709e813
Jul 14 11:08:06.363640 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:06.363603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z" event={"ID":"77e7b20a-f34d-4c02-96f3-561ed0832cbc","Type":"ContainerStarted","Data":"7b9c5883d8f4136ee17f56aa8449a8f10543c4706d41153d81f4f46ab39624e4"}
Jul 14 11:08:06.364096 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:06.363697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z" event={"ID":"77e7b20a-f34d-4c02-96f3-561ed0832cbc","Type":"ContainerStarted","Data":"8a85a6c4b5752ad93555e7fc29d4d4d80d2af96a46bf0ea59b78cc7e6709e813"}
Jul 14 11:08:06.365652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:06.365592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-lxkmm" event={"ID":"1f299971-fa8c-4de0-a8a3-ad55d920d3f3","Type":"ContainerStarted","Data":"e8d700ae58b2f32ce174a68e50a34393302a3c307de0a45fe0c42b9d643b23b6"}
Jul 14 11:08:06.367635 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:06.366936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg" event={"ID":"494597e0-2aa4-4583-9589-c54f783f51f3","Type":"ContainerStarted","Data":"e4acadd3985fa37d833875af1b001360ebec8670ac88af029fd4c3ec735cb094"}
Jul 14 11:08:06.384698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:06.384654    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z" podStartSLOduration=33.384636936 podStartE2EDuration="33.384636936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:06.383850042 +0000 UTC m=+72.836795946" watchObservedRunningTime="2026-07-14 11:08:06.384636936 +0000 UTC m=+72.837582818"
Jul 14 11:08:06.584971 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:06.584937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:06.588079 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:06.587862    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:07.372230 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:07.372200    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:07.373493 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:07.373470    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6fbbc7db94-vdx9z"
Jul 14 11:08:08.855798 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:08.855768    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"]
Jul 14 11:08:08.858269 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:08.858242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:08.861094 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:08.861073    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 14 11:08:08.861230 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:08.861136    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-927bf\""
Jul 14 11:08:08.869057 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:08.869006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"]
Jul 14 11:08:08.989268 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:08.989227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e07ea80-3034-4a27-86ea-263da767ca1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-h9dv5\" (UID: \"2e07ea80-3034-4a27-86ea-263da767ca1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:09.090739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.090696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e07ea80-3034-4a27-86ea-263da767ca1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-h9dv5\" (UID: \"2e07ea80-3034-4a27-86ea-263da767ca1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:09.090919 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:08:09.090847    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 14 11:08:09.090919 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:08:09.090920    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e07ea80-3034-4a27-86ea-263da767ca1d-tls-certificates podName:2e07ea80-3034-4a27-86ea-263da767ca1d nodeName:}" failed. No retries permitted until 2026-07-14 11:08:09.590899275 +0000 UTC m=+76.043845147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2e07ea80-3034-4a27-86ea-263da767ca1d-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-h9dv5" (UID: "2e07ea80-3034-4a27-86ea-263da767ca1d") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 14 11:08:09.292967 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.292822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:08:09.295750 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.295727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0779c170-99ba-4ca7-847e-6defef4ba484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r9wpm\" (UID: \"0779c170-99ba-4ca7-847e-6defef4ba484\") " pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:08:09.524460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.524400    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-24zbp\""
Jul 14 11:08:09.531966 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.531935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r9wpm"
Jul 14 11:08:09.595266 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.594761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e07ea80-3034-4a27-86ea-263da767ca1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-h9dv5\" (UID: \"2e07ea80-3034-4a27-86ea-263da767ca1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:09.598745 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.598721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2e07ea80-3034-4a27-86ea-263da767ca1d-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-h9dv5\" (UID: \"2e07ea80-3034-4a27-86ea-263da767ca1d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:09.688978 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.688842    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r9wpm"]
Jul 14 11:08:09.691220 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:09.691183    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0779c170_99ba_4ca7_847e_6defef4ba484.slice/crio-377c1172445fc81e42fb7bb9701583c97a7ac224ad4bc08f0736b8837f8d4381 WatchSource:0}: Error finding container 377c1172445fc81e42fb7bb9701583c97a7ac224ad4bc08f0736b8837f8d4381: Status 404 returned error can't find the container with id 377c1172445fc81e42fb7bb9701583c97a7ac224ad4bc08f0736b8837f8d4381
Jul 14 11:08:09.769249 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.769212    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:09.913834 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:09.913803    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"]
Jul 14 11:08:09.916708 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:09.916668    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e07ea80_3034_4a27_86ea_263da767ca1d.slice/crio-2b39deb7a56c3fa1e0ff9381109e4013ac8de891920b4ad4da97ce1cdca14521 WatchSource:0}: Error finding container 2b39deb7a56c3fa1e0ff9381109e4013ac8de891920b4ad4da97ce1cdca14521: Status 404 returned error can't find the container with id 2b39deb7a56c3fa1e0ff9381109e4013ac8de891920b4ad4da97ce1cdca14521
Jul 14 11:08:10.387549 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:10.387405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r9wpm" event={"ID":"0779c170-99ba-4ca7-847e-6defef4ba484","Type":"ContainerStarted","Data":"377c1172445fc81e42fb7bb9701583c97a7ac224ad4bc08f0736b8837f8d4381"}
Jul 14 11:08:10.389746 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:10.389671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg" event={"ID":"494597e0-2aa4-4583-9589-c54f783f51f3","Type":"ContainerStarted","Data":"e2336ff24039a5e02bab9d96e925315a855de5c5769c31d18206f50eb95c9cb2"}
Jul 14 11:08:10.390289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:10.390240    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:10.391641 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:10.391417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5" event={"ID":"2e07ea80-3034-4a27-86ea-263da767ca1d","Type":"ContainerStarted","Data":"2b39deb7a56c3fa1e0ff9381109e4013ac8de891920b4ad4da97ce1cdca14521"}
Jul 14 11:08:10.392305 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:10.392286    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg"
Jul 14 11:08:10.432283 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:10.432230    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bf7486f8d-2rffg" podStartSLOduration=2.178242416 podStartE2EDuration="6.432208283s" totalImagesPullingTime="4.253965867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:10.411267435 +0000 UTC m=+76.864213331" watchObservedRunningTime="2026-07-14 11:08:10.432208283 +0000 UTC m=+76.885154165"
Jul 14 11:08:11.398648 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.398506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5" event={"ID":"2e07ea80-3034-4a27-86ea-263da767ca1d","Type":"ContainerStarted","Data":"e2adec13a38b43fecd43961421a503ddf60d6923ed8a65b34bbe8b5166e48465"}
Jul 14 11:08:11.399066 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.398866    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:11.403788 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.403750    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5"
Jul 14 11:08:11.416702 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.416287    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-h9dv5" podStartSLOduration=2.04830088 podStartE2EDuration="3.416270536s" totalImagesPullingTime="1.367969656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:11.415766552 +0000 UTC m=+77.868712446" watchObservedRunningTime="2026-07-14 11:08:11.416270536 +0000 UTC m=+77.869216413"
Jul 14 11:08:11.917107 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.917049    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hb2dd"]
Jul 14 11:08:11.926649 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.926618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:11.930606 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.930576    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 11:08:11.930739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.930625    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 11:08:11.930739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.930663    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hxcxm\""
Jul 14 11:08:11.930848 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.930576    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 11:08:11.930848 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.930779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 14 11:08:11.930946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.930846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 14 11:08:11.934844 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:11.934797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hb2dd"]
Jul 14 11:08:12.014864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.014833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08c53e81-c8b5-4f91-9a48-63bde39e7f68-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.015022 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.014874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtd7j\" (UniqueName: \"kubernetes.io/projected/08c53e81-c8b5-4f91-9a48-63bde39e7f68-kube-api-access-gtd7j\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.015022 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.014931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08c53e81-c8b5-4f91-9a48-63bde39e7f68-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.015140 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.015043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08c53e81-c8b5-4f91-9a48-63bde39e7f68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.116274 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.116185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08c53e81-c8b5-4f91-9a48-63bde39e7f68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.116453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.116304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08c53e81-c8b5-4f91-9a48-63bde39e7f68-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.116453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.116337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtd7j\" (UniqueName: \"kubernetes.io/projected/08c53e81-c8b5-4f91-9a48-63bde39e7f68-kube-api-access-gtd7j\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.116453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.116367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08c53e81-c8b5-4f91-9a48-63bde39e7f68-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.117526 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.117496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08c53e81-c8b5-4f91-9a48-63bde39e7f68-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.119213 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.119168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08c53e81-c8b5-4f91-9a48-63bde39e7f68-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.119309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.119278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/08c53e81-c8b5-4f91-9a48-63bde39e7f68-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.125443 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.125292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtd7j\" (UniqueName: \"kubernetes.io/projected/08c53e81-c8b5-4f91-9a48-63bde39e7f68-kube-api-access-gtd7j\") pod \"prometheus-operator-64785b6675-hb2dd\" (UID: \"08c53e81-c8b5-4f91-9a48-63bde39e7f68\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:12.238359 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:12.238285    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd"
Jul 14 11:08:14.037131 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:14.036838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hb2dd"]
Jul 14 11:08:14.039566 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:14.039532    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c53e81_c8b5_4f91_9a48_63bde39e7f68.slice/crio-efab57bdb146cdd83bc7db43ded8647d200565b7e4e8919cbb8a4dfd551f456e WatchSource:0}: Error finding container efab57bdb146cdd83bc7db43ded8647d200565b7e4e8919cbb8a4dfd551f456e: Status 404 returned error can't find the container with id efab57bdb146cdd83bc7db43ded8647d200565b7e4e8919cbb8a4dfd551f456e
Jul 14 11:08:14.414232 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:14.414188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r9wpm" event={"ID":"0779c170-99ba-4ca7-847e-6defef4ba484","Type":"ContainerStarted","Data":"c4d9a36455723cd98525a218069b584479b736a787acf3927f82fc2b54f0a8a2"}
Jul 14 11:08:14.415620 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:14.415535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd" event={"ID":"08c53e81-c8b5-4f91-9a48-63bde39e7f68","Type":"ContainerStarted","Data":"efab57bdb146cdd83bc7db43ded8647d200565b7e4e8919cbb8a4dfd551f456e"}
Jul 14 11:08:15.370125 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:15.369990    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8l87r"
Jul 14 11:08:15.425290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:15.425209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r9wpm" event={"ID":"0779c170-99ba-4ca7-847e-6defef4ba484","Type":"ContainerStarted","Data":"69dc2ee273d4d37f52e9ca8721ad165231f30db5d90dbecf7b4d1e3f17a94123"}
Jul 14 11:08:16.431564 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:16.431521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd" event={"ID":"08c53e81-c8b5-4f91-9a48-63bde39e7f68","Type":"ContainerStarted","Data":"389ad941b7955b8c5cc892fca631022d6e0d8cb0136f998d69dc5e000f8870c7"}
Jul 14 11:08:16.432021 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:16.431586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd" event={"ID":"08c53e81-c8b5-4f91-9a48-63bde39e7f68","Type":"ContainerStarted","Data":"c58f731feba244fabd729e640f57c1550489978e917aaafdc384638a49d57535"}
Jul 14 11:08:17.519033 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.518967    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-hb2dd" podStartSLOduration=4.909887841 podStartE2EDuration="6.518945883s" totalImagesPullingTime="1.609058042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:16.452519774 +0000 UTC m=+82.905465653" watchObservedRunningTime="2026-07-14 11:08:17.518945883 +0000 UTC m=+83.971891760"
Jul 14 11:08:17.520191 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.520166    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cd5f7857b-6x8r4"]
Jul 14 11:08:17.523392 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.523370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.527063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.527033    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 11:08:17.527063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.527046    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sk9qm\""
Jul 14 11:08:17.527248 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.527073    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 11:08:17.528497 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.528421    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 11:08:17.528591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.528492    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 11:08:17.528591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.528498    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 11:08:17.531676 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.531613    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 11:08:17.534422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.534399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd5f7857b-6x8r4"]
Jul 14 11:08:17.662752 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.662719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-service-ca\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.662752 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.662762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-oauth-config\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.663005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.662785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5n8m\" (UniqueName: \"kubernetes.io/projected/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-kube-api-access-x5n8m\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.663005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.662846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-oauth-serving-cert\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.663005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.662953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-trusted-ca-bundle\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.663005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.662978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-config\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.663242 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.663024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-serving-cert\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.764039 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-serving-cert\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.764243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-service-ca\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.764243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-oauth-config\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.764243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5n8m\" (UniqueName: \"kubernetes.io/projected/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-kube-api-access-x5n8m\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.764243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-oauth-serving-cert\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.764243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-trusted-ca-bundle\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.764243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-config\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.765048 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.764986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-oauth-serving-cert\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.765048 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.765009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-config\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.765275 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.765111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-trusted-ca-bundle\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.765275 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.765138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-service-ca\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.766847 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.766826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-serving-cert\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.766967 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.766901    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-oauth-config\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.773288 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.773213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5n8m\" (UniqueName: \"kubernetes.io/projected/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-kube-api-access-x5n8m\") pod \"console-7cd5f7857b-6x8r4\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") " pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:17.835098 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:17.835061    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:18.254551 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.254516    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"]
Jul 14 11:08:18.258121 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.258090    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.260849 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.260763    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 11:08:18.261020 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.261002    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 11:08:18.261082 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.261016    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tz489\""
Jul 14 11:08:18.268309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.268290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"]
Jul 14 11:08:18.295466 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.295440    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xsn9q"]
Jul 14 11:08:18.298992 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.298970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.301541 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.301512    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 11:08:18.301824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.301807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 11:08:18.301824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.301816    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 11:08:18.301981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.301863    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m7hgj\""
Jul 14 11:08:18.367610 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-wtmp\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.367775 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11374f1c-49aa-4b35-970c-b7784cda3dd0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.367775 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-textfile\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.367775 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-sys\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.367775 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11374f1c-49aa-4b35-970c-b7784cda3dd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.367775 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11374f1c-49aa-4b35-970c-b7784cda3dd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.368023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-metrics-client-ca\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.368023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.368023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7lqt\" (UniqueName: \"kubernetes.io/projected/11374f1c-49aa-4b35-970c-b7784cda3dd0-kube-api-access-q7lqt\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.368023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-root\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.368023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946j5\" (UniqueName: \"kubernetes.io/projected/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-kube-api-access-946j5\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.368023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.367979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.368023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.368010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-tls\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469130 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469321 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-tls\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469379 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-wtmp\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469421 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11374f1c-49aa-4b35-970c-b7784cda3dd0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.469421 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-textfile\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-sys\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11374f1c-49aa-4b35-970c-b7784cda3dd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.469511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11374f1c-49aa-4b35-970c-b7784cda3dd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.469511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-metrics-client-ca\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-wtmp\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7lqt\" (UniqueName: \"kubernetes.io/projected/11374f1c-49aa-4b35-970c-b7784cda3dd0-kube-api-access-q7lqt\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.469697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-root\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946j5\" (UniqueName: \"kubernetes.io/projected/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-kube-api-access-946j5\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469932 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.469932 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-sys\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.470027 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.469971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-textfile\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.470082 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.470022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-root\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.470082 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.470071    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-metrics-client-ca\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.470227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.470200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11374f1c-49aa-4b35-970c-b7784cda3dd0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.472586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.472540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11374f1c-49aa-4b35-970c-b7784cda3dd0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.472586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.472573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-tls\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.472748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.472580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.472748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.472647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11374f1c-49aa-4b35-970c-b7784cda3dd0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.479578 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.479536    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-946j5\" (UniqueName: \"kubernetes.io/projected/1b77bcc4-9ca1-44fa-a95b-9101e944b3e6-kube-api-access-946j5\") pod \"node-exporter-xsn9q\" (UID: \"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6\") " pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:18.479578 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.479550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7lqt\" (UniqueName: \"kubernetes.io/projected/11374f1c-49aa-4b35-970c-b7784cda3dd0-kube-api-access-q7lqt\") pod \"openshift-state-metrics-84bd68b896-8w7bw\" (UID: \"11374f1c-49aa-4b35-970c-b7784cda3dd0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.569651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.569616    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"
Jul 14 11:08:18.609705 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:18.609671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xsn9q"
Jul 14 11:08:19.361679 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.361639    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:08:19.366280 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.366256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.369950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.369823    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 11:08:19.369950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.369835    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 11:08:19.369950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.369823    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 11:08:19.370241 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.370187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 11:08:19.372213 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.372132    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 11:08:19.372453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.372432    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sc8gg\""
Jul 14 11:08:19.372453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.372446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 11:08:19.372623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.372476    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 11:08:19.372760 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.372743    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 11:08:19.372886 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.372814    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 11:08:19.386825 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.386802    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:08:19.478458 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478628 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478628 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478628 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478777 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478777 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn52l\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-kube-api-access-xn52l\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478777 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-out\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478777 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.478777 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.479055 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.479055 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.479055 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.479055 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.478960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-web-config\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579463 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579463 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-web-config\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn52l\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-kube-api-access-xn52l\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.579963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.579853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-out\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.581356 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.580509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.581356 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.581276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.581716 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.581690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.584063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.583619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.584063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.583973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.584743 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.584717    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.585882 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.585846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-web-config\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.586414 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.586389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.586505 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.586441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.586505 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.586445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.586690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.586646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-out\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.586841 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.586820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.596256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.596219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn52l\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-kube-api-access-xn52l\") pod \"alertmanager-main-0\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:19.678314 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:19.678227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:08:23.065448 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.065419    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"]
Jul 14 11:08:23.116996 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.116958    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd5f7857b-6x8r4"]
Jul 14 11:08:23.117186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.117006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"]
Jul 14 11:08:23.117186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.117119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.119846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.119824    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 11:08:23.119959 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.119937    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5kjsw\""
Jul 14 11:08:23.210513 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.210481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfg9m\" (UniqueName: \"kubernetes.io/projected/30c47a78-7933-4521-8e39-5a623083cb6b-kube-api-access-lfg9m\") pod \"monitoring-plugin-5f68df7f58-gwppw\" (UID: \"30c47a78-7933-4521-8e39-5a623083cb6b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.210712 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.210533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30c47a78-7933-4521-8e39-5a623083cb6b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gwppw\" (UID: \"30c47a78-7933-4521-8e39-5a623083cb6b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.311990 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.311952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfg9m\" (UniqueName: \"kubernetes.io/projected/30c47a78-7933-4521-8e39-5a623083cb6b-kube-api-access-lfg9m\") pod \"monitoring-plugin-5f68df7f58-gwppw\" (UID: \"30c47a78-7933-4521-8e39-5a623083cb6b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.312194 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.312001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30c47a78-7933-4521-8e39-5a623083cb6b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gwppw\" (UID: \"30c47a78-7933-4521-8e39-5a623083cb6b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.315030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.314999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30c47a78-7933-4521-8e39-5a623083cb6b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-gwppw\" (UID: \"30c47a78-7933-4521-8e39-5a623083cb6b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.324919 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.324866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfg9m\" (UniqueName: \"kubernetes.io/projected/30c47a78-7933-4521-8e39-5a623083cb6b-kube-api-access-lfg9m\") pod \"monitoring-plugin-5f68df7f58-gwppw\" (UID: \"30c47a78-7933-4521-8e39-5a623083cb6b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.429208 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.429167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:23.503634 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.503601    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8464f65bd-5z2lv"]
Jul 14 11:08:23.546068 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.546028    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8464f65bd-5z2lv"]
Jul 14 11:08:23.546242 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.546177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.549017 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.548921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 14 11:08:23.549017 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.548995    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 14 11:08:23.549235 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.549019    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 14 11:08:23.549235 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.549079    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 14 11:08:23.549515 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.549456    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d2ss4\""
Jul 14 11:08:23.549627 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.549523    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 14 11:08:23.554331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.554188    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 14 11:08:23.715959 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.715881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-serving-certs-ca-bundle\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.715959 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.715930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-telemeter-client-tls\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.716204 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.716005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-metrics-client-ca\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.716204 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.716061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.716204 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.716088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64c5j\" (UniqueName: \"kubernetes.io/projected/c773a67d-224f-4a39-b1db-9d766f0a600f-kube-api-access-64c5j\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.716204 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.716117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-federate-client-tls\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.716373 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.716238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-secret-telemeter-client\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.716373 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.716271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.816787 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-telemeter-client-tls\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.816963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-metrics-client-ca\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.816963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.816963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64c5j\" (UniqueName: \"kubernetes.io/projected/c773a67d-224f-4a39-b1db-9d766f0a600f-kube-api-access-64c5j\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.816963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-federate-client-tls\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.816963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-secret-telemeter-client\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.816963 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.817272 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.816992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-serving-certs-ca-bundle\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.817653 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.817603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-metrics-client-ca\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.817879 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.817827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-serving-certs-ca-bundle\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.818068 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.818045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c773a67d-224f-4a39-b1db-9d766f0a600f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.819961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.819939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.820058 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.819975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-telemeter-client-tls\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.820058 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.820042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-secret-telemeter-client\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.820176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.820094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c773a67d-224f-4a39-b1db-9d766f0a600f-federate-client-tls\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.825627 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.825607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64c5j\" (UniqueName: \"kubernetes.io/projected/c773a67d-224f-4a39-b1db-9d766f0a600f-kube-api-access-64c5j\") pod \"telemeter-client-8464f65bd-5z2lv\" (UID: \"c773a67d-224f-4a39-b1db-9d766f0a600f\") " pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:23.857842 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:23.857819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv"
Jul 14 11:08:24.564416 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.564385    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:08:24.582444 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.582408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.586657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.586405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 11:08:24.586788 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.586674    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 11:08:24.587536 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.587498    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 11:08:24.587651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.587600    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 11:08:24.591276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.589700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 11:08:24.591276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.590184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 11:08:24.591276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.590685    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 11:08:24.591276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.590804    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 11:08:24.591276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.591202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 11:08:24.591276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.591257    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 11:08:24.592834 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.591903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cuuatuj4iq635\""
Jul 14 11:08:24.592834 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.592024    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 11:08:24.594351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.594278    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 11:08:24.594674 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.594623    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r4bpv\""
Jul 14 11:08:24.595812 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.595444    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 11:08:24.596585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.596562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:08:24.598234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.598216    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 11:08:24.600111 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.599596    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 11:08:24.724900 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.724866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725059 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.724918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725059 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.724948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725059 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.724966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725059 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-web-config\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config-out\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6hfg\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-kube-api-access-j6hfg\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.725456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.725452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827048 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.826964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-web-config\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827048 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config-out\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827048 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6hfg\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-kube-api-access-j6hfg\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.827741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.828115 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.827957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.828434 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.828302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.828823 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.828598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.828823 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.828597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.828823 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.828622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.829118 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.829094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.829220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.829139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.831527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.831505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.831957 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.831610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.832093 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.831614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.832505 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.832444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.833096 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.832980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.833403 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.833335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.833945 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.833592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.833945 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.833895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config-out\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.833945 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.833910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-web-config\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.833945 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.833931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.834469 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.834446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.835183 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.835134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.837090 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.837069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6hfg\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-kube-api-access-j6hfg\") pod \"prometheus-k8s-0\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.898495 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:24.898464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:24.907293 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:24.907075    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b77bcc4_9ca1_44fa_a95b_9101e944b3e6.slice/crio-01348a50b130e463b4e0ba606a413e2532239f3ec5cebe035294e35d8cb2081c WatchSource:0}: Error finding container 01348a50b130e463b4e0ba606a413e2532239f3ec5cebe035294e35d8cb2081c: Status 404 returned error can't find the container with id 01348a50b130e463b4e0ba606a413e2532239f3ec5cebe035294e35d8cb2081c
Jul 14 11:08:25.111313 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.111285    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"]
Jul 14 11:08:25.112899 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:25.112847    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c47a78_7933_4521_8e39_5a623083cb6b.slice/crio-f3f1a3981df6296dfd725aa9c48a71fbda11647776f04206533fdcf0a629347a WatchSource:0}: Error finding container f3f1a3981df6296dfd725aa9c48a71fbda11647776f04206533fdcf0a629347a: Status 404 returned error can't find the container with id f3f1a3981df6296dfd725aa9c48a71fbda11647776f04206533fdcf0a629347a
Jul 14 11:08:25.349658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.349354    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd5f7857b-6x8r4"]
Jul 14 11:08:25.352124 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.352079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8464f65bd-5z2lv"]
Jul 14 11:08:25.354653 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:25.354623    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75255372_b1d2_4d1a_b90d_f4b10dcc9e7b.slice/crio-f81b465575943c64543a5756fb567a0ac64c4bea90e89797effe6f982212f96c WatchSource:0}: Error finding container f81b465575943c64543a5756fb567a0ac64c4bea90e89797effe6f982212f96c: Status 404 returned error can't find the container with id f81b465575943c64543a5756fb567a0ac64c4bea90e89797effe6f982212f96c
Jul 14 11:08:25.356760 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.356739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:08:25.364284 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:25.364256    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7ad897_b865_4c14_84ce_3a3ac7414483.slice/crio-f262e816a590d241a5f5b58eecaec9d7a46734fc1fdfc99732dfd03cdbbb4f59 WatchSource:0}: Error finding container f262e816a590d241a5f5b58eecaec9d7a46734fc1fdfc99732dfd03cdbbb4f59: Status 404 returned error can't find the container with id f262e816a590d241a5f5b58eecaec9d7a46734fc1fdfc99732dfd03cdbbb4f59
Jul 14 11:08:25.386196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.385995    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw"]
Jul 14 11:08:25.389986 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:25.389958    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11374f1c_49aa_4b35_970c_b7784cda3dd0.slice/crio-c5d3c8a4b8a06e9fa6e5ec2ff0237ea456a3d1a55787e9959b45d905bf107d8f WatchSource:0}: Error finding container c5d3c8a4b8a06e9fa6e5ec2ff0237ea456a3d1a55787e9959b45d905bf107d8f: Status 404 returned error can't find the container with id c5d3c8a4b8a06e9fa6e5ec2ff0237ea456a3d1a55787e9959b45d905bf107d8f
Jul 14 11:08:25.397304 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.396602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:08:25.399692 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:08:25.399662    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69667847_fe78_47ad_81f0_2c0e4fd5dde4.slice/crio-3f111d2f5113ee15b68a8a3a8ccbc0f0280fc1abf6b756a4d7ce2c98e3274148 WatchSource:0}: Error finding container 3f111d2f5113ee15b68a8a3a8ccbc0f0280fc1abf6b756a4d7ce2c98e3274148: Status 404 returned error can't find the container with id 3f111d2f5113ee15b68a8a3a8ccbc0f0280fc1abf6b756a4d7ce2c98e3274148
Jul 14 11:08:25.469240 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.469208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerStarted","Data":"3f111d2f5113ee15b68a8a3a8ccbc0f0280fc1abf6b756a4d7ce2c98e3274148"}
Jul 14 11:08:25.472361 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.472333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw" event={"ID":"30c47a78-7933-4521-8e39-5a623083cb6b","Type":"ContainerStarted","Data":"f3f1a3981df6296dfd725aa9c48a71fbda11647776f04206533fdcf0a629347a"}
Jul 14 11:08:25.474609 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.474511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerStarted","Data":"f262e816a590d241a5f5b58eecaec9d7a46734fc1fdfc99732dfd03cdbbb4f59"}
Jul 14 11:08:25.476960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.476906    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd5f7857b-6x8r4" event={"ID":"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b","Type":"ContainerStarted","Data":"f81b465575943c64543a5756fb567a0ac64c4bea90e89797effe6f982212f96c"}
Jul 14 11:08:25.487688 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.486823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r9wpm" event={"ID":"0779c170-99ba-4ca7-847e-6defef4ba484","Type":"ContainerStarted","Data":"84322eb3fe88b6998bd99ed49ed89186f29fb561696681dc2a80e580caf23b60"}
Jul 14 11:08:25.492905 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.492881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw" event={"ID":"11374f1c-49aa-4b35-970c-b7784cda3dd0","Type":"ContainerStarted","Data":"d44d5697313c99419fc74c0c44469c982350429f8e60fea338f325d4efd8519d"}
Jul 14 11:08:25.493069 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.493052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw" event={"ID":"11374f1c-49aa-4b35-970c-b7784cda3dd0","Type":"ContainerStarted","Data":"c5d3c8a4b8a06e9fa6e5ec2ff0237ea456a3d1a55787e9959b45d905bf107d8f"}
Jul 14 11:08:25.498517 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.498492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xsn9q" event={"ID":"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6","Type":"ContainerStarted","Data":"01348a50b130e463b4e0ba606a413e2532239f3ec5cebe035294e35d8cb2081c"}
Jul 14 11:08:25.500091 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.500064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv" event={"ID":"c773a67d-224f-4a39-b1db-9d766f0a600f","Type":"ContainerStarted","Data":"8465e4b8d4ecc2f73e73f870cfd06fefa49b62bf3d4ee0602e2e09cdc6da8519"}
Jul 14 11:08:25.501867 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.501845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-lxkmm" event={"ID":"1f299971-fa8c-4de0-a8a3-ad55d920d3f3","Type":"ContainerStarted","Data":"20fd7b10bfbf3eaca46472bce7180812bb889ee237faeb46a3a3ca227a1e550b"}
Jul 14 11:08:25.502489 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.502475    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-lxkmm"
Jul 14 11:08:25.506671 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.506605    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r9wpm" podStartSLOduration=33.345271679 podStartE2EDuration="48.506581169s" totalImagesPullingTime="15.16130949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:07:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:25.505382127 +0000 UTC m=+91.958328006" watchObservedRunningTime="2026-07-14 11:08:25.506581169 +0000 UTC m=+91.959527047"
Jul 14 11:08:25.508686 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.508625    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-lxkmm"
Jul 14 11:08:25.521724 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:25.521621    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-lxkmm" podStartSLOduration=1.966041393 podStartE2EDuration="21.521602639s" totalImagesPullingTime="19.555561246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:25.520670767 +0000 UTC m=+91.973616646" watchObservedRunningTime="2026-07-14 11:08:25.521602639 +0000 UTC m=+91.974548529"
Jul 14 11:08:26.510825 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:26.510288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw" event={"ID":"11374f1c-49aa-4b35-970c-b7784cda3dd0","Type":"ContainerStarted","Data":"6a823e8e171fb75f77886e62fa02859d005cfb5b1ebc957623aec2cc7d753ee0"}
Jul 14 11:08:28.522115 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:28.522034    2581 generic.go:356] "Generic (PLEG): container finished" podID="1b77bcc4-9ca1-44fa-a95b-9101e944b3e6" containerID="44482eede82b701b037b42fc3cfb2d46a535e6e264c74a5b3f857c80099d7a6f" exitCode=0
Jul 14 11:08:28.522115 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:28.522084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xsn9q" event={"ID":"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6","Type":"ContainerDied","Data":"44482eede82b701b037b42fc3cfb2d46a535e6e264c74a5b3f857c80099d7a6f"}
Jul 14 11:08:32.546660 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.546611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw" event={"ID":"11374f1c-49aa-4b35-970c-b7784cda3dd0","Type":"ContainerStarted","Data":"3543121cc69aad98b075a6286dd6bd9e7b85cb991a4b2d7dfbd5c0025438eee2"}
Jul 14 11:08:32.549167 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.549125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xsn9q" event={"ID":"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6","Type":"ContainerStarted","Data":"397ded414bf8ab46bcf3a1479cf0451e60ed96cdd9718e1e61e5bff4a078d0b2"}
Jul 14 11:08:32.549282 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.549199    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xsn9q" event={"ID":"1b77bcc4-9ca1-44fa-a95b-9101e944b3e6","Type":"ContainerStarted","Data":"fdd4f0c512813b24bc44ca25fcb09361e3b0eb8a56631c81e56e8017a911800b"}
Jul 14 11:08:32.551785 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.551759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv" event={"ID":"c773a67d-224f-4a39-b1db-9d766f0a600f","Type":"ContainerStarted","Data":"bdada722c14e444623f7530c9e8ed0ec84424270de7b24dcbb234a640e56d62b"}
Jul 14 11:08:32.551889 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.551816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv" event={"ID":"c773a67d-224f-4a39-b1db-9d766f0a600f","Type":"ContainerStarted","Data":"030ff5194f351b5c191f81fd1ff9b9788a29e33a5700cc0b3f513a8e0f62bb95"}
Jul 14 11:08:32.551889 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.551843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv" event={"ID":"c773a67d-224f-4a39-b1db-9d766f0a600f","Type":"ContainerStarted","Data":"d02d00ab5357334c61783ee7dbf765923ab97a7ab64dc4917d30ee1d79fae40c"}
Jul 14 11:08:32.553495 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.553469    2581 generic.go:356] "Generic (PLEG): container finished" podID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73" exitCode=0
Jul 14 11:08:32.553590 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.553548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"}
Jul 14 11:08:32.560360 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.560330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw" event={"ID":"30c47a78-7933-4521-8e39-5a623083cb6b","Type":"ContainerStarted","Data":"8f2b9904d192b3a956fabca79ee1e60e6c9a3743b116bbe9bbf585376917f18d"}
Jul 14 11:08:32.560538 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.560519    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:32.567885 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.567848    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerID="5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db" exitCode=0
Jul 14 11:08:32.567981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.567910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db"}
Jul 14 11:08:32.568045 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.567989    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8w7bw" podStartSLOduration=8.538718249 podStartE2EDuration="14.567975162s" totalImagesPullingTime="6.029256913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:32.566748594 +0000 UTC m=+99.019694473" watchObservedRunningTime="2026-07-14 11:08:32.567975162 +0000 UTC m=+99.020921039"
Jul 14 11:08:32.570827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.570688    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw"
Jul 14 11:08:32.571438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.571413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd5f7857b-6x8r4" event={"ID":"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b","Type":"ContainerStarted","Data":"f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f"}
Jul 14 11:08:32.587673 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.587627    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-gwppw" podStartSLOduration=3.192144662 podStartE2EDuration="9.58761411s" totalImagesPullingTime="6.395469448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:32.58525351 +0000 UTC m=+99.038199392" watchObservedRunningTime="2026-07-14 11:08:32.58761411 +0000 UTC m=+99.040559988"
Jul 14 11:08:32.628230 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.628117    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xsn9q" podStartSLOduration=11.639961755 podStartE2EDuration="14.628102306s" totalImagesPullingTime="2.880222564s" totalInitContainerRuntime="107.917987ms" isStatefulPod=true podCreationTimestamp="2026-07-14 11:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:32.626782212 +0000 UTC m=+99.079728093" watchObservedRunningTime="2026-07-14 11:08:32.628102306 +0000 UTC m=+99.081048184"
Jul 14 11:08:32.647177 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.647098    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8464f65bd-5z2lv" podStartSLOduration=3.415090764 podStartE2EDuration="9.64708137s" totalImagesPullingTime="6.231990606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:32.645626188 +0000 UTC m=+99.098572067" watchObservedRunningTime="2026-07-14 11:08:32.64708137 +0000 UTC m=+99.100027251"
Jul 14 11:08:32.663860 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:32.663811    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cd5f7857b-6x8r4" podStartSLOduration=9.435585504 podStartE2EDuration="15.663791865s" totalImagesPullingTime="6.228206361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:32.662052182 +0000 UTC m=+99.114998065" watchObservedRunningTime="2026-07-14 11:08:32.663791865 +0000 UTC m=+99.116737744"
Jul 14 11:08:36.370578 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:36.370555    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q7gjd"
Jul 14 11:08:36.594976 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:36.594904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerStarted","Data":"10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c"}
Jul 14 11:08:37.602858 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:37.602794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerStarted","Data":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"}
Jul 14 11:08:37.603492 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:37.602885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerStarted","Data":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"}
Jul 14 11:08:37.608135 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:37.608110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerStarted","Data":"3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e"}
Jul 14 11:08:37.608258 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:37.608186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerStarted","Data":"b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f"}
Jul 14 11:08:37.608258 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:37.608213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerStarted","Data":"3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb"}
Jul 14 11:08:37.608352 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:37.608238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerStarted","Data":"60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736"}
Jul 14 11:08:37.835715 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:37.835675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:39.619468 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:39.619412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerStarted","Data":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"}
Jul 14 11:08:39.619972 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:39.619490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerStarted","Data":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"}
Jul 14 11:08:39.622946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:39.622925    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerStarted","Data":"55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013"}
Jul 14 11:08:39.655418 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:39.655361    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.696001683 podStartE2EDuration="20.655340218s" totalImagesPullingTime="11.928351843s" totalInitContainerRuntime="30.986692ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:39.651957006 +0000 UTC m=+106.104902905" watchObservedRunningTime="2026-07-14 11:08:39.655340218 +0000 UTC m=+106.108286097"
Jul 14 11:08:40.630632 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:40.630589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerStarted","Data":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"}
Jul 14 11:08:40.631221 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:40.630669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerStarted","Data":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"}
Jul 14 11:08:40.663445 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:40.663396    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.893353226 podStartE2EDuration="16.663378687s" totalImagesPullingTime="12.725355023s" totalInitContainerRuntime="44.670438ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:08:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:08:40.662087409 +0000 UTC m=+107.115033289" watchObservedRunningTime="2026-07-14 11:08:40.663378687 +0000 UTC m=+107.116324564"
Jul 14 11:08:44.899624 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:44.899584    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:08:57.597343 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.597299    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cd5f7857b-6x8r4" podUID="75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" containerName="console" containerID="cri-o://f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f" gracePeriod=15
Jul 14 11:08:57.874254 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.874186    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:57.931264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5n8m\" (UniqueName: \"kubernetes.io/projected/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-kube-api-access-x5n8m\") pod \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") "
Jul 14 11:08:57.931264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931266    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-serving-cert\") pod \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") "
Jul 14 11:08:57.931490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931295    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-config\") pod \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") "
Jul 14 11:08:57.931490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-oauth-serving-cert\") pod \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") "
Jul 14 11:08:57.931490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931462    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-service-ca\") pod \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") "
Jul 14 11:08:57.931638 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931553    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-trusted-ca-bundle\") pod \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") "
Jul 14 11:08:57.931638 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931600    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-oauth-config\") pod \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\" (UID: \"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b\") "
Jul 14 11:08:57.931752 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931718    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-config" (OuterVolumeSpecName: "console-config") pod "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" (UID: "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:08:57.931871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931728    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" (UID: "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:08:57.931871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931858    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" (UID: "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:08:57.931995 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.931921    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" (UID: "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:08:57.932051 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.932003    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:08:57.932051 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.932017    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-trusted-ca-bundle\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:08:57.932051 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.932027    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-config\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:08:57.932051 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.932035    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-oauth-serving-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:08:57.933655 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.933623    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" (UID: "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:08:57.933751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.933699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-kube-api-access-x5n8m" (OuterVolumeSpecName: "kube-api-access-x5n8m") pod "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" (UID: "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b"). InnerVolumeSpecName "kube-api-access-x5n8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:08:57.933751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:57.933704    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" (UID: "75255372-b1d2-4d1a-b90d-f4b10dcc9e7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:08:58.033303 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.033274    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-oauth-config\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:08:58.033303 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.033301    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5n8m\" (UniqueName: \"kubernetes.io/projected/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-kube-api-access-x5n8m\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:08:58.033303 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.033312    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b-console-serving-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:08:58.701801 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.701768    2581 generic.go:356] "Generic (PLEG): container finished" podID="75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" containerID="f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f" exitCode=0
Jul 14 11:08:58.702232 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.701813    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd5f7857b-6x8r4"
Jul 14 11:08:58.702232 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.701820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd5f7857b-6x8r4" event={"ID":"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b","Type":"ContainerDied","Data":"f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f"}
Jul 14 11:08:58.702232 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.701859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd5f7857b-6x8r4" event={"ID":"75255372-b1d2-4d1a-b90d-f4b10dcc9e7b","Type":"ContainerDied","Data":"f81b465575943c64543a5756fb567a0ac64c4bea90e89797effe6f982212f96c"}
Jul 14 11:08:58.702232 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.701880    2581 scope.go:117] "RemoveContainer" containerID="f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f"
Jul 14 11:08:58.710085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.710069    2581 scope.go:117] "RemoveContainer" containerID="f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f"
Jul 14 11:08:58.710354 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:08:58.710335    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f\": container with ID starting with f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f not found: ID does not exist" containerID="f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f"
Jul 14 11:08:58.710431 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.710361    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f"} err="failed to get container status \"f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f\": rpc error: code = NotFound desc = could not find container \"f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f\": container with ID starting with f2eae43165d859c9b875fa2dfd470b90cf278510cf2d1582c35c609fce19515f not found: ID does not exist"
Jul 14 11:08:58.720039 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.720003    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd5f7857b-6x8r4"]
Jul 14 11:08:58.721779 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:08:58.721761    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cd5f7857b-6x8r4"]
Jul 14 11:09:00.050851 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:00.050816    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" path="/var/lib/kubelet/pods/75255372-b1d2-4d1a-b90d-f4b10dcc9e7b/volumes"
Jul 14 11:09:24.899463 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:24.899434    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:24.914889 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:24.914864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:25.841844 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:25.841821    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:38.811130 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:38.811096    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:09:38.811728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:38.811401    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="alertmanager" containerID="cri-o://10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c" gracePeriod=120
Jul 14 11:09:38.811728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:38.811490    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="prom-label-proxy" containerID="cri-o://55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013" gracePeriod=120
Jul 14 11:09:38.811728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:38.811537    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy" containerID="cri-o://b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f" gracePeriod=120
Jul 14 11:09:38.811728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:38.811547    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-web" containerID="cri-o://3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb" gracePeriod=120
Jul 14 11:09:38.811728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:38.811580    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="config-reloader" containerID="cri-o://60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736" gracePeriod=120
Jul 14 11:09:38.811728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:38.811472    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-metric" containerID="cri-o://3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e" gracePeriod=120
Jul 14 11:09:39.888649 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888624    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerID="55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013" exitCode=0
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888651    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerID="3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e" exitCode=0
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888660    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerID="b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f" exitCode=0
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888669    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerID="60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736" exitCode=0
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888677    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerID="10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c" exitCode=0
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013"}
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e"}
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f"}
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736"}
Jul 14 11:09:39.888947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:39.888916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c"}
Jul 14 11:09:40.063712 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.063688    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:40.092422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-out\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-main-tls\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092451    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-volume\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-trusted-ca-bundle\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092499    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092519    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092559    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-metrics-client-ca\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092590    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn52l\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-kube-api-access-xn52l\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092615    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-tls-assets\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092653    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-cluster-tls-config\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.092697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092690    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-web-config\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.093131 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092719    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-web\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.093131 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092754    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-main-db\") pod \"9f7ad897-b865-4c14-84ce-3a3ac7414483\" (UID: \"9f7ad897-b865-4c14-84ce-3a3ac7414483\") "
Jul 14 11:09:40.093131 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.092911    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:40.093322 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.093175    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.094731 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.094367    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:09:40.094731 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.094688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:40.095333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.095306    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:40.096144 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.096115    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-volume" (OuterVolumeSpecName: "config-volume") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:40.096409 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.096372    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-kube-api-access-xn52l" (OuterVolumeSpecName: "kube-api-access-xn52l") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "kube-api-access-xn52l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:09:40.096496 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.096410    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:40.096645 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.096618    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-out" (OuterVolumeSpecName: "config-out") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:09:40.096747 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.096675    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:09:40.096945 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.096915    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:40.097119 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.097089    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:40.102426 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.102389    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:40.108479 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.108448    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-web-config" (OuterVolumeSpecName: "web-config") pod "9f7ad897-b865-4c14-84ce-3a3ac7414483" (UID: "9f7ad897-b865-4c14-84ce-3a3ac7414483"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.193950    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7ad897-b865-4c14-84ce-3a3ac7414483-metrics-client-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.193981    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn52l\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-kube-api-access-xn52l\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.193992    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f7ad897-b865-4c14-84ce-3a3ac7414483-tls-assets\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194002    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-cluster-tls-config\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194011    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-web-config\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194022    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194030    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-alertmanager-main-db\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194040    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-out\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194407 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194048    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-main-tls\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194407 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194056    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-config-volume\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194407 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194066    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.194407 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.194074    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f7ad897-b865-4c14-84ce-3a3ac7414483-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:40.895866 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.895837    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerID="3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb" exitCode=0
Jul 14 11:09:40.896267 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.895918    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:40.896267 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.895914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb"}
Jul 14 11:09:40.896267 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.896049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f7ad897-b865-4c14-84ce-3a3ac7414483","Type":"ContainerDied","Data":"f262e816a590d241a5f5b58eecaec9d7a46734fc1fdfc99732dfd03cdbbb4f59"}
Jul 14 11:09:40.896267 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.896084    2581 scope.go:117] "RemoveContainer" containerID="55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013"
Jul 14 11:09:40.904895 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.904878    2581 scope.go:117] "RemoveContainer" containerID="3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e"
Jul 14 11:09:40.911924 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.911908    2581 scope.go:117] "RemoveContainer" containerID="b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f"
Jul 14 11:09:40.919232 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.919213    2581 scope.go:117] "RemoveContainer" containerID="3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb"
Jul 14 11:09:40.920212 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.920194    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:09:40.924140 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.924122    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:09:40.926894 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.926750    2581 scope.go:117] "RemoveContainer" containerID="60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736"
Jul 14 11:09:40.933758 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.933741    2581 scope.go:117] "RemoveContainer" containerID="10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c"
Jul 14 11:09:40.940902 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.940886    2581 scope.go:117] "RemoveContainer" containerID="5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db"
Jul 14 11:09:40.948548 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948480    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:09:40.948613 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948594    2581 scope.go:117] "RemoveContainer" containerID="55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013"
Jul 14 11:09:40.948813 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948800    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" containerName="console"
Jul 14 11:09:40.948855 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948815    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" containerName="console"
Jul 14 11:09:40.948855 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948828    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="prom-label-proxy"
Jul 14 11:09:40.948919 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948874    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="prom-label-proxy"
Jul 14 11:09:40.948919 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948894    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-web"
Jul 14 11:09:40.948919 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:40.948893    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013\": container with ID starting with 55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013 not found: ID does not exist" containerID="55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948918    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013"} err="failed to get container status \"55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013\": rpc error: code = NotFound desc = could not find container \"55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013\": container with ID starting with 55cac741555ae27a2cefe16a8ce371cc7f7caee9a758eadff4fab2fab2500013 not found: ID does not exist"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948939    2581 scope.go:117] "RemoveContainer" containerID="3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948902    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-web"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948981    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-metric"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.948990    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-metric"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949004    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="config-reloader"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949011    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="config-reloader"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949020    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy"
Jul 14 11:09:40.949029 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949026    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949035    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="init-config-reloader"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949042    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="init-config-reloader"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949053    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="alertmanager"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949060    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="alertmanager"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:40.949181    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e\": container with ID starting with 3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e not found: ID does not exist" containerID="3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949206    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e"} err="failed to get container status \"3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e\": rpc error: code = NotFound desc = could not find container \"3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e\": container with ID starting with 3e3d8ff7b08dc44e3d64b5e4baf70b72f372ad7cda08625f5e285ad08388213e not found: ID does not exist"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949224    2581 scope.go:117] "RemoveContainer" containerID="b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949268    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="alertmanager"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949280    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="75255372-b1d2-4d1a-b90d-f4b10dcc9e7b" containerName="console"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949288    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="config-reloader"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949298    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="prom-label-proxy"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949305    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-metric"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949313    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy-web"
Jul 14 11:09:40.949351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949319    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" containerName="kube-rbac-proxy"
Jul 14 11:09:40.949806 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:40.949468    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f\": container with ID starting with b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f not found: ID does not exist" containerID="b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f"
Jul 14 11:09:40.949806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949483    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f"} err="failed to get container status \"b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f\": rpc error: code = NotFound desc = could not find container \"b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f\": container with ID starting with b80ab974a95b1514e194022a31ecba1cf85d6a28a24feeae7707ab746cd1ba7f not found: ID does not exist"
Jul 14 11:09:40.949806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949495    2581 scope.go:117] "RemoveContainer" containerID="3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb"
Jul 14 11:09:40.949806 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:40.949693    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb\": container with ID starting with 3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb not found: ID does not exist" containerID="3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb"
Jul 14 11:09:40.949806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949711    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb"} err="failed to get container status \"3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb\": rpc error: code = NotFound desc = could not find container \"3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb\": container with ID starting with 3d32c6c92e8d361bf604509cc253deeea927755b43f0494322f75104349a03bb not found: ID does not exist"
Jul 14 11:09:40.949806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949724    2581 scope.go:117] "RemoveContainer" containerID="60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736"
Jul 14 11:09:40.950006 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:40.949901    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736\": container with ID starting with 60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736 not found: ID does not exist" containerID="60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736"
Jul 14 11:09:40.950006 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949919    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736"} err="failed to get container status \"60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736\": rpc error: code = NotFound desc = could not find container \"60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736\": container with ID starting with 60ffee373be98a81e757270da08ced9f1666704ff07844c997a9e911b810b736 not found: ID does not exist"
Jul 14 11:09:40.950006 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.949930    2581 scope.go:117] "RemoveContainer" containerID="10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c"
Jul 14 11:09:40.950126 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:40.950106    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c\": container with ID starting with 10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c not found: ID does not exist" containerID="10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c"
Jul 14 11:09:40.950126 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.950121    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c"} err="failed to get container status \"10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c\": rpc error: code = NotFound desc = could not find container \"10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c\": container with ID starting with 10cf57df90648de3119f0230aaf01b7b74fb80ab0f827fbdffe17f6b6dbfd97c not found: ID does not exist"
Jul 14 11:09:40.950243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.950133    2581 scope.go:117] "RemoveContainer" containerID="5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db"
Jul 14 11:09:40.950386 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:40.950369    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db\": container with ID starting with 5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db not found: ID does not exist" containerID="5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db"
Jul 14 11:09:40.950426 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.950390    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db"} err="failed to get container status \"5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db\": rpc error: code = NotFound desc = could not find container \"5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db\": container with ID starting with 5661ea6ddceaeb586e31b2a6bd9a6407c1e4fef123594d54b42cedafab52a7db not found: ID does not exist"
Jul 14 11:09:40.951904 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.951890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:40.954724 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.954535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.954785    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.955000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.955058    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sc8gg\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.955259    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.955371    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.955428    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.956645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 11:09:40.957137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.956824    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 11:09:40.960513 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.960494    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 11:09:40.967389 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:40.967367    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:09:41.000857 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.000826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc169ec4-029a-464e-a7ff-f547c722fc5b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.000857 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.000860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001062 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.000880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc169ec4-029a-464e-a7ff-f547c722fc5b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001062 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.000976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001062 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001062 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc169ec4-029a-464e-a7ff-f547c722fc5b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001062 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc169ec4-029a-464e-a7ff-f547c722fc5b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc169ec4-029a-464e-a7ff-f547c722fc5b-config-out\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-web-config\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-584bs\" (UniqueName: \"kubernetes.io/projected/fc169ec4-029a-464e-a7ff-f547c722fc5b-kube-api-access-584bs\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001358 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.001358 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.001313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.102327 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.102288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-584bs\" (UniqueName: \"kubernetes.io/projected/fc169ec4-029a-464e-a7ff-f547c722fc5b-kube-api-access-584bs\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.102491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.102341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.102491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.102373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.102491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.102415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc169ec4-029a-464e-a7ff-f547c722fc5b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.102491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.102459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc169ec4-029a-464e-a7ff-f547c722fc5b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc169ec4-029a-464e-a7ff-f547c722fc5b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc169ec4-029a-464e-a7ff-f547c722fc5b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc169ec4-029a-464e-a7ff-f547c722fc5b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc169ec4-029a-464e-a7ff-f547c722fc5b-config-out\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-web-config\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.105395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.103706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.106079 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.106053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.106414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc169ec4-029a-464e-a7ff-f547c722fc5b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.106848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.107188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc169ec4-029a-464e-a7ff-f547c722fc5b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.107655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.108632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.108981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc169ec4-029a-464e-a7ff-f547c722fc5b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.109407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-web-config\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.111806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.109856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc169ec4-029a-464e-a7ff-f547c722fc5b-config-out\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.112303 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.111952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.112871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.112841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc169ec4-029a-464e-a7ff-f547c722fc5b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.113991 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.113973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-584bs\" (UniqueName: \"kubernetes.io/projected/fc169ec4-029a-464e-a7ff-f547c722fc5b-kube-api-access-584bs\") pod \"alertmanager-main-0\" (UID: \"fc169ec4-029a-464e-a7ff-f547c722fc5b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.263403 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.263311    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 11:09:41.399836 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.399809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 11:09:41.403308 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:09:41.403277    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc169ec4_029a_464e_a7ff_f547c722fc5b.slice/crio-e8f78aabd2a462623cb2e67b466d4231b585dd347f57808d350ee21527c2712d WatchSource:0}: Error finding container e8f78aabd2a462623cb2e67b466d4231b585dd347f57808d350ee21527c2712d: Status 404 returned error can't find the container with id e8f78aabd2a462623cb2e67b466d4231b585dd347f57808d350ee21527c2712d
Jul 14 11:09:41.903590 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.903555    2581 generic.go:356] "Generic (PLEG): container finished" podID="fc169ec4-029a-464e-a7ff-f547c722fc5b" containerID="489804a285a5a998638b361744076fc3ccfae550d501ccada0a840f71b2a767f" exitCode=0
Jul 14 11:09:41.904064 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.903634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerDied","Data":"489804a285a5a998638b361744076fc3ccfae550d501ccada0a840f71b2a767f"}
Jul 14 11:09:41.904064 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:41.903710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerStarted","Data":"e8f78aabd2a462623cb2e67b466d4231b585dd347f57808d350ee21527c2712d"}
Jul 14 11:09:42.051478 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.051450    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7ad897-b865-4c14-84ce-3a3ac7414483" path="/var/lib/kubelet/pods/9f7ad897-b865-4c14-84ce-3a3ac7414483/volumes"
Jul 14 11:09:42.912908 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.912872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerStarted","Data":"db3e280649a6ba233d4e0c5556a191af677355ed75f4385c6b476391dfdf7f43"}
Jul 14 11:09:42.913298 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.912936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerStarted","Data":"fd7082a9a1bd95bc77858aeccd344e1d3034a3263733d9dbbe8cab934ab480c5"}
Jul 14 11:09:42.913298 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.912962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerStarted","Data":"fe067a853d536fb151d23aa065373297279b9b3ae32855d7cf8f4cdbbd013ccb"}
Jul 14 11:09:42.913298 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.912987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerStarted","Data":"0145e8dd1250ce859b83f363af2e2f71be139ce7661de107835bfc67857ae1c1"}
Jul 14 11:09:42.913298 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.913012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerStarted","Data":"323519f0317dbc96291e9006b7f85f301f25aa426a11b27c33a2251fd653054c"}
Jul 14 11:09:42.913298 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.913035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc169ec4-029a-464e-a7ff-f547c722fc5b","Type":"ContainerStarted","Data":"0020e7dff5721200f0bd580a42c6c47a82a9022352e5b3d8d77f1a8f6f89c0a7"}
Jul 14 11:09:42.940068 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:42.940020    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9213440630000003 podStartE2EDuration="2.940002302s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.658239ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:09:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:09:42.938581255 +0000 UTC m=+169.391527135" watchObservedRunningTime="2026-07-14 11:09:42.940002302 +0000 UTC m=+169.392948180"
Jul 14 11:09:43.001327 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.001285    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:09:43.001698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.001666    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="prometheus" containerID="cri-o://632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba" gracePeriod=600
Jul 14 11:09:43.001898 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.001876    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d" gracePeriod=600
Jul 14 11:09:43.002524 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.002016    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy" containerID="cri-o://b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7" gracePeriod=600
Jul 14 11:09:43.002524 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.002100    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-web" containerID="cri-o://d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2" gracePeriod=600
Jul 14 11:09:43.002524 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.002191    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="thanos-sidecar" containerID="cri-o://3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9" gracePeriod=600
Jul 14 11:09:43.002524 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.002271    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="config-reloader" containerID="cri-o://003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d" gracePeriod=600
Jul 14 11:09:43.267492 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.267466    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:43.320142 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320107    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-kubelet-serving-ca-bundle\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320176    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-web-config\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320212    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-metrics-client-ca\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320250    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-2\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-1\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-serving-certs-ca-bundle\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-grpc-tls\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320407    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-0\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-tls\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320469    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-kube-rbac-proxy\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320524    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-thanos-prometheus-http-client-file\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320606    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-db\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config-out\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.320657 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320654    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.321114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320677    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-trusted-ca-bundle\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.321114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-tls-assets\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.321114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-metrics-client-certs\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.321114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320767    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6hfg\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-kube-api-access-j6hfg\") pod \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\" (UID: \"69667847-fe78-47ad-81f0-2c0e4fd5dde4\") "
Jul 14 11:09:43.321114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.320886    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:43.321114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.321052    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.322200 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.321634    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:43.322594 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.321790    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:43.322713 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.322175    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:43.322792 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.322347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:09:43.324302 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.324256    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:43.324415 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.324368    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:43.324529 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.324491    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:09:43.324875 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.324849    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.324968 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.324885    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-kube-api-access-j6hfg" (OuterVolumeSpecName: "kube-api-access-j6hfg") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "kube-api-access-j6hfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:09:43.325600 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.325565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.325766 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.325728    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.326352 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.326311    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.326576 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.326552    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config" (OuterVolumeSpecName: "config") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.326811 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.326787    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config-out" (OuterVolumeSpecName: "config-out") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:09:43.326980 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.326952    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.327105 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.327085    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.327771 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.327748    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:09:43.327940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.327922    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.339496 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.339468    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-web-config" (OuterVolumeSpecName: "web-config") pod "69667847-fe78-47ad-81f0-2c0e4fd5dde4" (UID: "69667847-fe78-47ad-81f0-2c0e4fd5dde4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:09:43.421947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.421893    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.421947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.421941    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.421947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.421954    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-grpc-tls\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.421947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.421965    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.421978    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.421990    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-kube-rbac-proxy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422000    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422008    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422016    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-db\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422024    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config-out\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422032    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-config\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422040    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422048    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-tls-assets\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422061    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-secret-metrics-client-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422074    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6hfg\" (UniqueName: \"kubernetes.io/projected/69667847-fe78-47ad-81f0-2c0e4fd5dde4-kube-api-access-j6hfg\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422082    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69667847-fe78-47ad-81f0-2c0e4fd5dde4-web-config\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422091    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-configmap-metrics-client-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422099    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.422257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.422109    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69667847-fe78-47ad-81f0-2c0e4fd5dde4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:09:43.919585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919555    2581 generic.go:356] "Generic (PLEG): container finished" podID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d" exitCode=0
Jul 14 11:09:43.919585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919580    2581 generic.go:356] "Generic (PLEG): container finished" podID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7" exitCode=0
Jul 14 11:09:43.919585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919588    2581 generic.go:356] "Generic (PLEG): container finished" podID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2" exitCode=0
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919596    2581 generic.go:356] "Generic (PLEG): container finished" podID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9" exitCode=0
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919601    2581 generic.go:356] "Generic (PLEG): container finished" podID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d" exitCode=0
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919607    2581 generic.go:356] "Generic (PLEG): container finished" podID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba" exitCode=0
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919626    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"}
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"}
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"}
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"}
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919812    2581 scope.go:117] "RemoveContainer" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"}
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"}
Jul 14 11:09:43.920023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.919901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69667847-fe78-47ad-81f0-2c0e4fd5dde4","Type":"ContainerDied","Data":"3f111d2f5113ee15b68a8a3a8ccbc0f0280fc1abf6b756a4d7ce2c98e3274148"}
Jul 14 11:09:43.927957 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.927938    2581 scope.go:117] "RemoveContainer" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.934906 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.934888    2581 scope.go:117] "RemoveContainer" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.941618 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.941597    2581 scope.go:117] "RemoveContainer" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.943753 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.943731    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:09:43.949302 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.949285    2581 scope.go:117] "RemoveContainer" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.949540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.949518    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:09:43.955708 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.955693    2581 scope.go:117] "RemoveContainer" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.962504 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.962489    2581 scope.go:117] "RemoveContainer" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.968881 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.968864    2581 scope.go:117] "RemoveContainer" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.969172 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:43.969137    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": container with ID starting with 9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d not found: ID does not exist" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.969234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969180    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"} err="failed to get container status \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": rpc error: code = NotFound desc = could not find container \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": container with ID starting with 9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d not found: ID does not exist"
Jul 14 11:09:43.969234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969199    2581 scope.go:117] "RemoveContainer" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.969418 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:43.969403    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": container with ID starting with b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7 not found: ID does not exist" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.969454 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969424    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"} err="failed to get container status \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": rpc error: code = NotFound desc = could not find container \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": container with ID starting with b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7 not found: ID does not exist"
Jul 14 11:09:43.969454 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969439    2581 scope.go:117] "RemoveContainer" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.969652 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:43.969638    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": container with ID starting with d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2 not found: ID does not exist" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.969690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969656    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"} err="failed to get container status \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": rpc error: code = NotFound desc = could not find container \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": container with ID starting with d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2 not found: ID does not exist"
Jul 14 11:09:43.969690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969669    2581 scope.go:117] "RemoveContainer" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.969865 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:43.969851    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": container with ID starting with 3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9 not found: ID does not exist" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.969908 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969867    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"} err="failed to get container status \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": rpc error: code = NotFound desc = could not find container \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": container with ID starting with 3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9 not found: ID does not exist"
Jul 14 11:09:43.969908 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.969878    2581 scope.go:117] "RemoveContainer" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.970117 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:43.970100    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": container with ID starting with 003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d not found: ID does not exist" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.970174 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970123    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"} err="failed to get container status \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": rpc error: code = NotFound desc = could not find container \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": container with ID starting with 003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d not found: ID does not exist"
Jul 14 11:09:43.970174 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970138    2581 scope.go:117] "RemoveContainer" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.970413 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:43.970398    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": container with ID starting with 632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba not found: ID does not exist" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.970450 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970419    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"} err="failed to get container status \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": rpc error: code = NotFound desc = could not find container \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": container with ID starting with 632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba not found: ID does not exist"
Jul 14 11:09:43.970450 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970431    2581 scope.go:117] "RemoveContainer" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.970655 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:09:43.970638    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": container with ID starting with 157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73 not found: ID does not exist" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.970750 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970671    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"} err="failed to get container status \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": rpc error: code = NotFound desc = could not find container \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": container with ID starting with 157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73 not found: ID does not exist"
Jul 14 11:09:43.970750 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970692    2581 scope.go:117] "RemoveContainer" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.970928 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970908    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"} err="failed to get container status \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": rpc error: code = NotFound desc = could not find container \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": container with ID starting with 9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d not found: ID does not exist"
Jul 14 11:09:43.970928 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.970927    2581 scope.go:117] "RemoveContainer" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.971130 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971114    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"} err="failed to get container status \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": rpc error: code = NotFound desc = could not find container \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": container with ID starting with b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7 not found: ID does not exist"
Jul 14 11:09:43.971193 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971130    2581 scope.go:117] "RemoveContainer" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.971397 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971375    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"} err="failed to get container status \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": rpc error: code = NotFound desc = could not find container \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": container with ID starting with d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2 not found: ID does not exist"
Jul 14 11:09:43.971442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971399    2581 scope.go:117] "RemoveContainer" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.971631 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971616    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"} err="failed to get container status \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": rpc error: code = NotFound desc = could not find container \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": container with ID starting with 3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9 not found: ID does not exist"
Jul 14 11:09:43.971631 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971630    2581 scope.go:117] "RemoveContainer" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.971852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971835    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"} err="failed to get container status \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": rpc error: code = NotFound desc = could not find container \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": container with ID starting with 003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d not found: ID does not exist"
Jul 14 11:09:43.971919 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.971856    2581 scope.go:117] "RemoveContainer" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.972072 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972056    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"} err="failed to get container status \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": rpc error: code = NotFound desc = could not find container \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": container with ID starting with 632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba not found: ID does not exist"
Jul 14 11:09:43.972128 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972073    2581 scope.go:117] "RemoveContainer" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.972297 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972278    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"} err="failed to get container status \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": rpc error: code = NotFound desc = could not find container \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": container with ID starting with 157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73 not found: ID does not exist"
Jul 14 11:09:43.972342 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972297    2581 scope.go:117] "RemoveContainer" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.972483 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972468    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"} err="failed to get container status \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": rpc error: code = NotFound desc = could not find container \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": container with ID starting with 9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d not found: ID does not exist"
Jul 14 11:09:43.972523 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972484    2581 scope.go:117] "RemoveContainer" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.972698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972675    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"} err="failed to get container status \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": rpc error: code = NotFound desc = could not find container \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": container with ID starting with b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7 not found: ID does not exist"
Jul 14 11:09:43.972698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972698    2581 scope.go:117] "RemoveContainer" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.972926 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972910    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"} err="failed to get container status \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": rpc error: code = NotFound desc = could not find container \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": container with ID starting with d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2 not found: ID does not exist"
Jul 14 11:09:43.973018 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.972926    2581 scope.go:117] "RemoveContainer" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.973196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.973177    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"} err="failed to get container status \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": rpc error: code = NotFound desc = could not find container \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": container with ID starting with 3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9 not found: ID does not exist"
Jul 14 11:09:43.973196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.973196    2581 scope.go:117] "RemoveContainer" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.973501 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.973467    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"} err="failed to get container status \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": rpc error: code = NotFound desc = could not find container \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": container with ID starting with 003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d not found: ID does not exist"
Jul 14 11:09:43.973501 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.973494    2581 scope.go:117] "RemoveContainer" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.973813 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.973791    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"} err="failed to get container status \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": rpc error: code = NotFound desc = could not find container \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": container with ID starting with 632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba not found: ID does not exist"
Jul 14 11:09:43.973876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.973814    2581 scope.go:117] "RemoveContainer" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.974065 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.974041    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"} err="failed to get container status \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": rpc error: code = NotFound desc = could not find container \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": container with ID starting with 157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73 not found: ID does not exist"
Jul 14 11:09:43.974136 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.974067    2581 scope.go:117] "RemoveContainer" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.975136 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975116    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:09:43.975447 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975435    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="prometheus"
Jul 14 11:09:43.975491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975450    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="prometheus"
Jul 14 11:09:43.975491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975459    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="init-config-reloader"
Jul 14 11:09:43.975491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975465    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="init-config-reloader"
Jul 14 11:09:43.975491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975478    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-thanos"
Jul 14 11:09:43.975491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975484    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-thanos"
Jul 14 11:09:43.975491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975491    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="config-reloader"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975496    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="config-reloader"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975506    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="thanos-sidecar"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975512    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="thanos-sidecar"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975518    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975523    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975535    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-web"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975541    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-web"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975590    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-thanos"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975598    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="thanos-sidecar"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975606    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975612    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="prometheus"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975619    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="kube-rbac-proxy-web"
Jul 14 11:09:43.975672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.975625    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" containerName="config-reloader"
Jul 14 11:09:43.976195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976141    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"} err="failed to get container status \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": rpc error: code = NotFound desc = could not find container \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": container with ID starting with 9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d not found: ID does not exist"
Jul 14 11:09:43.976195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976179    2581 scope.go:117] "RemoveContainer" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.976429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976406    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"} err="failed to get container status \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": rpc error: code = NotFound desc = could not find container \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": container with ID starting with b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7 not found: ID does not exist"
Jul 14 11:09:43.976429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976426    2581 scope.go:117] "RemoveContainer" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.976650 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976625    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"} err="failed to get container status \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": rpc error: code = NotFound desc = could not find container \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": container with ID starting with d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2 not found: ID does not exist"
Jul 14 11:09:43.976699 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976662    2581 scope.go:117] "RemoveContainer" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.976876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976856    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"} err="failed to get container status \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": rpc error: code = NotFound desc = could not find container \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": container with ID starting with 3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9 not found: ID does not exist"
Jul 14 11:09:43.976876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.976876    2581 scope.go:117] "RemoveContainer" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.977126 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977108    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"} err="failed to get container status \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": rpc error: code = NotFound desc = could not find container \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": container with ID starting with 003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d not found: ID does not exist"
Jul 14 11:09:43.977207 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977128    2581 scope.go:117] "RemoveContainer" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.977371 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977353    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"} err="failed to get container status \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": rpc error: code = NotFound desc = could not find container \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": container with ID starting with 632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba not found: ID does not exist"
Jul 14 11:09:43.977430 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977374    2581 scope.go:117] "RemoveContainer" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.977587 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977569    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"} err="failed to get container status \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": rpc error: code = NotFound desc = could not find container \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": container with ID starting with 157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73 not found: ID does not exist"
Jul 14 11:09:43.977660 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977588    2581 scope.go:117] "RemoveContainer" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.977844 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977818    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"} err="failed to get container status \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": rpc error: code = NotFound desc = could not find container \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": container with ID starting with 9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d not found: ID does not exist"
Jul 14 11:09:43.977904 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.977845    2581 scope.go:117] "RemoveContainer" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.978069 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978049    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"} err="failed to get container status \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": rpc error: code = NotFound desc = could not find container \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": container with ID starting with b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7 not found: ID does not exist"
Jul 14 11:09:43.978139 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978071    2581 scope.go:117] "RemoveContainer" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.978271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978245    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"} err="failed to get container status \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": rpc error: code = NotFound desc = could not find container \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": container with ID starting with d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2 not found: ID does not exist"
Jul 14 11:09:43.978271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978263    2581 scope.go:117] "RemoveContainer" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.978532 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978512    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"} err="failed to get container status \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": rpc error: code = NotFound desc = could not find container \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": container with ID starting with 3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9 not found: ID does not exist"
Jul 14 11:09:43.978532 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978529    2581 scope.go:117] "RemoveContainer" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.978812 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978794    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"} err="failed to get container status \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": rpc error: code = NotFound desc = could not find container \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": container with ID starting with 003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d not found: ID does not exist"
Jul 14 11:09:43.978873 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.978812    2581 scope.go:117] "RemoveContainer" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.979066 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.979046    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"} err="failed to get container status \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": rpc error: code = NotFound desc = could not find container \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": container with ID starting with 632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba not found: ID does not exist"
Jul 14 11:09:43.979066 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.979064    2581 scope.go:117] "RemoveContainer" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.979347 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.979320    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"} err="failed to get container status \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": rpc error: code = NotFound desc = could not find container \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": container with ID starting with 157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73 not found: ID does not exist"
Jul 14 11:09:43.979347 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.979347    2581 scope.go:117] "RemoveContainer" containerID="9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"
Jul 14 11:09:43.979627 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.979603    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d"} err="failed to get container status \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": rpc error: code = NotFound desc = could not find container \"9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d\": container with ID starting with 9c877bfd74af335ce6e35839fbc9d966ed80e2a6bb25adcc016df9460fa84d1d not found: ID does not exist"
Jul 14 11:09:43.979694 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.979628    2581 scope.go:117] "RemoveContainer" containerID="b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"
Jul 14 11:09:43.979744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.979696    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:43.980130 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980011    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7"} err="failed to get container status \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": rpc error: code = NotFound desc = could not find container \"b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7\": container with ID starting with b89d518ac8f836867122e865208283cb464865bd329c709a81bdc78f252f49d7 not found: ID does not exist"
Jul 14 11:09:43.980130 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980040    2581 scope.go:117] "RemoveContainer" containerID="d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"
Jul 14 11:09:43.980453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980429    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2"} err="failed to get container status \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": rpc error: code = NotFound desc = could not find container \"d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2\": container with ID starting with d04a63dbb5d5f728c6cee984f0cedacd9cc19dd3d5f0b746b8bd72a9933b96d2 not found: ID does not exist"
Jul 14 11:09:43.980453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980446    2581 scope.go:117] "RemoveContainer" containerID="3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"
Jul 14 11:09:43.980697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980673    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9"} err="failed to get container status \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": rpc error: code = NotFound desc = could not find container \"3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9\": container with ID starting with 3a156ef85669969d1ca26dcbde572aefbb412d81b33582b82ff9c8e302358fb9 not found: ID does not exist"
Jul 14 11:09:43.980697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980698    2581 scope.go:117] "RemoveContainer" containerID="003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"
Jul 14 11:09:43.980930 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980910    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d"} err="failed to get container status \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": rpc error: code = NotFound desc = could not find container \"003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d\": container with ID starting with 003e11b703e23a8ad5bbb125328a651702eb903010bb038194e3ad86ae58ba5d not found: ID does not exist"
Jul 14 11:09:43.980993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.980932    2581 scope.go:117] "RemoveContainer" containerID="632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"
Jul 14 11:09:43.981218 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.981173    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba"} err="failed to get container status \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": rpc error: code = NotFound desc = could not find container \"632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba\": container with ID starting with 632e4354a1916c273a4665d33e326a1c701bc26cc5a82c4d18ad977db8d642ba not found: ID does not exist"
Jul 14 11:09:43.981303 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.981220    2581 scope.go:117] "RemoveContainer" containerID="157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"
Jul 14 11:09:43.981494 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.981462    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73"} err="failed to get container status \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": rpc error: code = NotFound desc = could not find container \"157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73\": container with ID starting with 157321bb77424638851252a3930636b7e28125ebae6c42d4e6a8e6c8eede6a73 not found: ID does not exist"
Jul 14 11:09:43.983001 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.982983    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 11:09:43.983122 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 11:09:43.983122 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983026    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 11:09:43.983122 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983048    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 11:09:43.983122 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983056    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 11:09:43.983396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983144    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 11:09:43.983396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 11:09:43.983396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983376    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 11:09:43.983553 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cuuatuj4iq635\""
Jul 14 11:09:43.983599 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983588    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 11:09:43.983653 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983588    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r4bpv\""
Jul 14 11:09:43.983804 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.983788    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 11:09:43.984458 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.984438    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 11:09:43.984759 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.984536    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 11:09:43.984880 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.984861    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 11:09:43.986361 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.986343    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 11:09:43.990083 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.989909    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 11:09:43.995546 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:43.995529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:09:44.025527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-config-out\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-config\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7gwh\" (UniqueName: \"kubernetes.io/projected/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-kube-api-access-z7gwh\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.025871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.026133 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.025904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.026133 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.026050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.026133 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.026124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.026264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.026177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.026264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.026200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.026264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.026219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.026442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.026425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-web-config\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.054697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.052820    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69667847-fe78-47ad-81f0-2c0e4fd5dde4" path="/var/lib/kubelet/pods/69667847-fe78-47ad-81f0-2c0e4fd5dde4/volumes"
Jul 14 11:09:44.127205 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127205 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-config-out\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127509 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127648 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-config\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.127876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7gwh\" (UniqueName: \"kubernetes.io/projected/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-kube-api-access-z7gwh\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.127998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.128024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.128054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128421 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.128087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-web-config\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128421 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.128115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128421 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.128239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.128689 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.128660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.129370 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.129346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.129756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.129735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.130571 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.130181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-config-out\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.130571 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.130318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.130571 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.130443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.130997 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.130882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-config\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.131543 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.131520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.132028 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.132004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.132455 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.132432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.132584 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.132480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.132685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.132655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.132779 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.132731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.133032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.133010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.133129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.133108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.133236 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.133218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.133442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.133427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-web-config\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.137873 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.137829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7gwh\" (UniqueName: \"kubernetes.io/projected/34021b3b-8c28-4364-9fc9-2b8ad7c93df9-kube-api-access-z7gwh\") pod \"prometheus-k8s-0\" (UID: \"34021b3b-8c28-4364-9fc9-2b8ad7c93df9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.292238 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.292208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:09:44.428073 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.428048    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 11:09:44.430022 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:09:44.429994    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34021b3b_8c28_4364_9fc9_2b8ad7c93df9.slice/crio-976289e18e66800d13af03e7c6a930adc91ab9099b3b4d1786c64153055786a4 WatchSource:0}: Error finding container 976289e18e66800d13af03e7c6a930adc91ab9099b3b4d1786c64153055786a4: Status 404 returned error can't find the container with id 976289e18e66800d13af03e7c6a930adc91ab9099b3b4d1786c64153055786a4
Jul 14 11:09:44.926024 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.925984    2581 generic.go:356] "Generic (PLEG): container finished" podID="34021b3b-8c28-4364-9fc9-2b8ad7c93df9" containerID="9cc039c73592c7aaf5333ecc36b03b7235ef0572cd03fe5fbdcbcf1d87ea86ee" exitCode=0
Jul 14 11:09:44.926470 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.926029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerDied","Data":"9cc039c73592c7aaf5333ecc36b03b7235ef0572cd03fe5fbdcbcf1d87ea86ee"}
Jul 14 11:09:44.926470 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:44.926097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerStarted","Data":"976289e18e66800d13af03e7c6a930adc91ab9099b3b4d1786c64153055786a4"}
Jul 14 11:09:45.934990 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:45.934951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerStarted","Data":"baa028e7700e9487ccdfd7e75c043af671af229e9bc75e1d12033787269f5a6b"}
Jul 14 11:09:45.935363 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:45.935012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerStarted","Data":"e572f987d07c83f55a80b6a49fe0ca5bc205ee2b7cc351eccf452b35e24da672"}
Jul 14 11:09:45.935363 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:45.935038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerStarted","Data":"c9c52dd8047d6b34c4d1601f5093f95ca2f2e5125a1bb6bb8b695902f1463409"}
Jul 14 11:09:45.935363 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:45.935066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerStarted","Data":"21a1d447a9dc7b273ae34c9494cd51cd1f851153541824021a52ee77b444f85c"}
Jul 14 11:09:45.935363 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:45.935089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerStarted","Data":"fe1bdf5de2ec4761d437fa9ef4f415c218cd26a0d348d5724548acd1101929b4"}
Jul 14 11:09:45.935363 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:45.935119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34021b3b-8c28-4364-9fc9-2b8ad7c93df9","Type":"ContainerStarted","Data":"3ef7b00f990b3b15f7d6b728b2107cc9ee321de70b67bb16d74457faea569110"}
Jul 14 11:09:45.964042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:45.963983    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9470958659999997 podStartE2EDuration="2.963964124s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.868258ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:09:45.962191998 +0000 UTC m=+172.415137874" watchObservedRunningTime="2026-07-14 11:09:45.963964124 +0000 UTC m=+172.416910003"
Jul 14 11:09:49.293034 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:09:49.292989    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:10:44.292872 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:10:44.292838    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:10:44.308775 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:10:44.308748    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:10:45.174512 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:10:45.174484    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 11:11:47.023156 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.023128    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"]
Jul 14 11:11:47.026077 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.026062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.031137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.031104    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 11:11:47.031278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.031180    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 11:11:47.031278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.031193    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 11:11:47.037784 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.037770    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 11:11:47.037986 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.037974    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzl9m\""
Jul 14 11:11:47.118512 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.118487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ddd1523-609a-437c-909b-5ce510b549d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.118627 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.118527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ddd1523-609a-437c-909b-5ce510b549d1-tmp\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.118627 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.118576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ddd1523-609a-437c-909b-5ce510b549d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.118627 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.118619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ddd1523-609a-437c-909b-5ce510b549d1-manifests\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.118742 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.118659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd4rv\" (UniqueName: \"kubernetes.io/projected/4ddd1523-609a-437c-909b-5ce510b549d1-kube-api-access-zd4rv\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.120540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.120515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"]
Jul 14 11:11:47.219246 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.219218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ddd1523-609a-437c-909b-5ce510b549d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.219387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.219265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ddd1523-609a-437c-909b-5ce510b549d1-manifests\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.219387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.219302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd4rv\" (UniqueName: \"kubernetes.io/projected/4ddd1523-609a-437c-909b-5ce510b549d1-kube-api-access-zd4rv\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.219387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.219344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ddd1523-609a-437c-909b-5ce510b549d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.219387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.219372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ddd1523-609a-437c-909b-5ce510b549d1-tmp\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.219793 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.219764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ddd1523-609a-437c-909b-5ce510b549d1-manifests\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.221750 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.221730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ddd1523-609a-437c-909b-5ce510b549d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.221885 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.221870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ddd1523-609a-437c-909b-5ce510b549d1-tmp\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.221932 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.221867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ddd1523-609a-437c-909b-5ce510b549d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.234045 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.234021    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd4rv\" (UniqueName: \"kubernetes.io/projected/4ddd1523-609a-437c-909b-5ce510b549d1-kube-api-access-zd4rv\") pod \"opendatahub-operator-controller-manager-7ff488f585-hc7fc\" (UID: \"4ddd1523-609a-437c-909b-5ce510b549d1\") " pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.335696 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.335669    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:47.510236 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:47.510212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"]
Jul 14 11:11:47.512253 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:11:47.512226    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddd1523_609a_437c_909b_5ce510b549d1.slice/crio-4b5156116af842c4748ef5b44c707c8e61052486c9fa204a4f0bf4df71df60de WatchSource:0}: Error finding container 4b5156116af842c4748ef5b44c707c8e61052486c9fa204a4f0bf4df71df60de: Status 404 returned error can't find the container with id 4b5156116af842c4748ef5b44c707c8e61052486c9fa204a4f0bf4df71df60de
Jul 14 11:11:48.406200 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:48.406138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc" event={"ID":"4ddd1523-609a-437c-909b-5ce510b549d1","Type":"ContainerStarted","Data":"4b5156116af842c4748ef5b44c707c8e61052486c9fa204a4f0bf4df71df60de"}
Jul 14 11:11:51.420732 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:51.420698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc" event={"ID":"4ddd1523-609a-437c-909b-5ce510b549d1","Type":"ContainerStarted","Data":"13b0a869a37b4efbe7afb78056864d9013275d5f25c8653832e2f591b5a855b7"}
Jul 14 11:11:52.426214 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:52.426176    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ddd1523-609a-437c-909b-5ce510b549d1" containerID="13b0a869a37b4efbe7afb78056864d9013275d5f25c8653832e2f591b5a855b7" exitCode=0
Jul 14 11:11:52.426597 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:52.426257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc" event={"ID":"4ddd1523-609a-437c-909b-5ce510b549d1","Type":"ContainerDied","Data":"13b0a869a37b4efbe7afb78056864d9013275d5f25c8653832e2f591b5a855b7"}
Jul 14 11:11:53.431942 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:53.431906    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc" event={"ID":"4ddd1523-609a-437c-909b-5ce510b549d1","Type":"ContainerStarted","Data":"39d66e5123c34d514d9a004dddf3ab5c8619a0ffa4eaa88b584eaa7e59414d8f"}
Jul 14 11:11:53.432330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:53.432054    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:11:53.470442 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:53.470397    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc" podStartSLOduration=3.17719132 podStartE2EDuration="7.470382362s" totalImagesPullingTime="3.20277977s" totalInitContainerRuntime="1.090411272s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:53.470292745 +0000 UTC m=+299.923238624" watchObservedRunningTime="2026-07-14 11:11:53.470382362 +0000 UTC m=+299.923328239"
Jul 14 11:11:53.924890 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:11:53.924867    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 11:12:04.439092 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:04.439059    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7ff488f585-hc7fc"
Jul 14 11:12:06.109408 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.109376    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"]
Jul 14 11:12:06.111683 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.111667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.115885 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.115857    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 11:12:06.115999 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.115932    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 11:12:06.115999 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.115952    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 11:12:06.116115 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.116025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 11:12:06.116185 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.116166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 11:12:06.116272 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.116257    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d7gxs\""
Jul 14 11:12:06.141136 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.141109    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"]
Jul 14 11:12:06.157450 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.157428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84f7a80f-131a-4411-88b8-cbb9f60a83d5-cert\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.157839 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.157815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/84f7a80f-131a-4411-88b8-cbb9f60a83d5-manager-config\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.158075 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.158047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q2c7\" (UniqueName: \"kubernetes.io/projected/84f7a80f-131a-4411-88b8-cbb9f60a83d5-kube-api-access-8q2c7\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.158276 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.158249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/84f7a80f-131a-4411-88b8-cbb9f60a83d5-metrics-cert\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.258905 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.258872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84f7a80f-131a-4411-88b8-cbb9f60a83d5-cert\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.259081 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.258938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/84f7a80f-131a-4411-88b8-cbb9f60a83d5-manager-config\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.259081 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.258961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q2c7\" (UniqueName: \"kubernetes.io/projected/84f7a80f-131a-4411-88b8-cbb9f60a83d5-kube-api-access-8q2c7\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.259081 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.258991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/84f7a80f-131a-4411-88b8-cbb9f60a83d5-metrics-cert\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.259660 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.259639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/84f7a80f-131a-4411-88b8-cbb9f60a83d5-manager-config\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.261358 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.261332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84f7a80f-131a-4411-88b8-cbb9f60a83d5-cert\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.261451 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.261371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/84f7a80f-131a-4411-88b8-cbb9f60a83d5-metrics-cert\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.275848 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.275824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q2c7\" (UniqueName: \"kubernetes.io/projected/84f7a80f-131a-4411-88b8-cbb9f60a83d5-kube-api-access-8q2c7\") pod \"lws-controller-manager-7d84b86c7f-xccbw\" (UID: \"84f7a80f-131a-4411-88b8-cbb9f60a83d5\") " pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.420573 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.420504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:06.573031 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.573008    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"]
Jul 14 11:12:06.575175 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:12:06.575136    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f7a80f_131a_4411_88b8_cbb9f60a83d5.slice/crio-edca26b19635568f8ea9364efa8d79b1c51bc689655f8e80cc730e163d33ccaa WatchSource:0}: Error finding container edca26b19635568f8ea9364efa8d79b1c51bc689655f8e80cc730e163d33ccaa: Status 404 returned error can't find the container with id edca26b19635568f8ea9364efa8d79b1c51bc689655f8e80cc730e163d33ccaa
Jul 14 11:12:06.576952 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:06.576937    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 11:12:07.494308 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:07.494275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw" event={"ID":"84f7a80f-131a-4411-88b8-cbb9f60a83d5","Type":"ContainerStarted","Data":"edca26b19635568f8ea9364efa8d79b1c51bc689655f8e80cc730e163d33ccaa"}
Jul 14 11:12:09.505613 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:09.505576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw" event={"ID":"84f7a80f-131a-4411-88b8-cbb9f60a83d5","Type":"ContainerStarted","Data":"fe2a119005fdff92ce9cb4ec4d80797d93972bb578aacc0b8e63bc7fac695b11"}
Jul 14 11:12:09.506017 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:09.505731    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:12:09.599752 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:09.599703    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw" podStartSLOduration=1.6138527630000001 podStartE2EDuration="3.599687357s" totalImagesPullingTime="1.985834594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:09.599428157 +0000 UTC m=+316.052374037" watchObservedRunningTime="2026-07-14 11:12:09.599687357 +0000 UTC m=+316.052633264"
Jul 14 11:12:11.423718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.423679    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"]
Jul 14 11:12:11.426577 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.426556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.434181 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.434139    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 11:12:11.434181 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.434169    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 11:12:11.434539 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.434277    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7phsh\""
Jul 14 11:12:11.446220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.446194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"]
Jul 14 11:12:11.506916 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.506885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fdfw\" (UniqueName: \"kubernetes.io/projected/571648b5-5085-4e89-9f52-70668da030d1-kube-api-access-5fdfw\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.507063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.506930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571648b5-5085-4e89-9f52-70668da030d1-tls-certs\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.507063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.506979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/571648b5-5085-4e89-9f52-70668da030d1-tmp\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.608089 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.608056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fdfw\" (UniqueName: \"kubernetes.io/projected/571648b5-5085-4e89-9f52-70668da030d1-kube-api-access-5fdfw\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.608250 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.608103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571648b5-5085-4e89-9f52-70668da030d1-tls-certs\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.608250 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:12:11.608215    2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 14 11:12:11.608250 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.608215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/571648b5-5085-4e89-9f52-70668da030d1-tmp\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.608368 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:12:11.608261    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/571648b5-5085-4e89-9f52-70668da030d1-tls-certs podName:571648b5-5085-4e89-9f52-70668da030d1 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:12.108246627 +0000 UTC m=+318.561192483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/571648b5-5085-4e89-9f52-70668da030d1-tls-certs") pod "kube-auth-proxy-7f79597649-9vmd4" (UID: "571648b5-5085-4e89-9f52-70668da030d1") : secret "kube-auth-proxy-tls" not found
Jul 14 11:12:11.610364 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.610340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/571648b5-5085-4e89-9f52-70668da030d1-tmp\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:11.619019 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:11.619000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fdfw\" (UniqueName: \"kubernetes.io/projected/571648b5-5085-4e89-9f52-70668da030d1-kube-api-access-5fdfw\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:12.112839 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:12.112812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571648b5-5085-4e89-9f52-70668da030d1-tls-certs\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:12.115181 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:12.115142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571648b5-5085-4e89-9f52-70668da030d1-tls-certs\") pod \"kube-auth-proxy-7f79597649-9vmd4\" (UID: \"571648b5-5085-4e89-9f52-70668da030d1\") " pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:12.335744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:12.335710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"
Jul 14 11:12:12.480960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:12.480937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f79597649-9vmd4"]
Jul 14 11:12:12.482426 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:12:12.482404    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571648b5_5085_4e89_9f52_70668da030d1.slice/crio-6c4f6dde7d89c68c53cd6f9017595c11bd3f2371e27ce06842686ad0fcd17674 WatchSource:0}: Error finding container 6c4f6dde7d89c68c53cd6f9017595c11bd3f2371e27ce06842686ad0fcd17674: Status 404 returned error can't find the container with id 6c4f6dde7d89c68c53cd6f9017595c11bd3f2371e27ce06842686ad0fcd17674
Jul 14 11:12:12.518580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:12.518553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4" event={"ID":"571648b5-5085-4e89-9f52-70668da030d1","Type":"ContainerStarted","Data":"6c4f6dde7d89c68c53cd6f9017595c11bd3f2371e27ce06842686ad0fcd17674"}
Jul 14 11:12:16.539691 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:16.539613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4" event={"ID":"571648b5-5085-4e89-9f52-70668da030d1","Type":"ContainerStarted","Data":"15371a0a8dd2416ec6a16e8c3d7d1ccceedd667988ce0899e704290029ce821d"}
Jul 14 11:12:16.562247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:16.562199    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f79597649-9vmd4" podStartSLOduration=1.9339039059999998 podStartE2EDuration="5.562185032s" totalImagesPullingTime="3.628281126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:16.561249505 +0000 UTC m=+323.014195386" watchObservedRunningTime="2026-07-14 11:12:16.562185032 +0000 UTC m=+323.015130910"
Jul 14 11:12:20.511478 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:12:20.511451    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d84b86c7f-xccbw"
Jul 14 11:13:37.801539 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.801508    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97699c468-hxwhd"]
Jul 14 11:13:37.803827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.803810    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.807801 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.807777    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sk9qm\""
Jul 14 11:13:37.808928 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.808904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 11:13:37.809032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.808948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 11:13:37.809256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.809225    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 11:13:37.809420 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.809391    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 11:13:37.819229 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.819210    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 11:13:37.822265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.822247    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 11:13:37.825241 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.825214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97699c468-hxwhd"]
Jul 14 11:13:37.842314 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.842291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-console-config\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.842404 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.842333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d708581-1884-43f9-80c6-aa26352e91c7-console-oauth-config\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.842404 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.842354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-oauth-serving-cert\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.842481 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.842428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-service-ca\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.842516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.842478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d708581-1884-43f9-80c6-aa26352e91c7-console-serving-cert\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.842516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.842506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-trusted-ca-bundle\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.842574 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.842532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz48s\" (UniqueName: \"kubernetes.io/projected/7d708581-1884-43f9-80c6-aa26352e91c7-kube-api-access-nz48s\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.942882 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.942854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-trusted-ca-bundle\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.942885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz48s\" (UniqueName: \"kubernetes.io/projected/7d708581-1884-43f9-80c6-aa26352e91c7-kube-api-access-nz48s\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.942909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-console-config\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.942949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d708581-1884-43f9-80c6-aa26352e91c7-console-oauth-config\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.942976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-oauth-serving-cert\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.943019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-service-ca\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943364 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.943172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d708581-1884-43f9-80c6-aa26352e91c7-console-serving-cert\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943705 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.943678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-console-config\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943818 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.943805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-service-ca\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943880 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.943803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-oauth-serving-cert\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.943880 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.943861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d708581-1884-43f9-80c6-aa26352e91c7-trusted-ca-bundle\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.945420 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.945389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d708581-1884-43f9-80c6-aa26352e91c7-console-oauth-config\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.945420 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.945411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d708581-1884-43f9-80c6-aa26352e91c7-console-serving-cert\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:37.958347 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:37.958327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz48s\" (UniqueName: \"kubernetes.io/projected/7d708581-1884-43f9-80c6-aa26352e91c7-kube-api-access-nz48s\") pod \"console-97699c468-hxwhd\" (UID: \"7d708581-1884-43f9-80c6-aa26352e91c7\") " pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:38.113242 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:38.113172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:38.246108 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:38.245960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97699c468-hxwhd"]
Jul 14 11:13:38.248373 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:13:38.248348    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d708581_1884_43f9_80c6_aa26352e91c7.slice/crio-abf02610c6f9f248640ac7ec403c9c6dc708f0537c61d3c1c7de814548548c9d WatchSource:0}: Error finding container abf02610c6f9f248640ac7ec403c9c6dc708f0537c61d3c1c7de814548548c9d: Status 404 returned error can't find the container with id abf02610c6f9f248640ac7ec403c9c6dc708f0537c61d3c1c7de814548548c9d
Jul 14 11:13:38.894781 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:38.894749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97699c468-hxwhd" event={"ID":"7d708581-1884-43f9-80c6-aa26352e91c7","Type":"ContainerStarted","Data":"8e59679129c17c90de5033fcfbe20aaa0b6f34ddd21bae6f77c9cdfab6dfae41"}
Jul 14 11:13:38.895215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:38.894795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97699c468-hxwhd" event={"ID":"7d708581-1884-43f9-80c6-aa26352e91c7","Type":"ContainerStarted","Data":"abf02610c6f9f248640ac7ec403c9c6dc708f0537c61d3c1c7de814548548c9d"}
Jul 14 11:13:38.917061 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:38.917016    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97699c468-hxwhd" podStartSLOduration=1.917001227 podStartE2EDuration="1.917001227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:13:38.915597121 +0000 UTC m=+405.368542998" watchObservedRunningTime="2026-07-14 11:13:38.917001227 +0000 UTC m=+405.369947106"
Jul 14 11:13:48.113759 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:48.113723    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:48.114103 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:48.113785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:48.118372 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:48.118349    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:48.941372 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:48.941342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97699c468-hxwhd"
Jul 14 11:13:59.651159 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.651114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"]
Jul 14 11:13:59.653414 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.653396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.658762 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.658739    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 11:13:59.658884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.658855    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hr6wg\""
Jul 14 11:13:59.659307 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.659293    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 11:13:59.660046 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.659764    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 14 11:13:59.660046 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.659768    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 14 11:13:59.677949 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.677927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"]
Jul 14 11:13:59.735806 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.735777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwvsg\" (UniqueName: \"kubernetes.io/projected/eff9ce3a-0f66-4e43-b999-b396963921a7-kube-api-access-nwvsg\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.735927 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.735823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eff9ce3a-0f66-4e43-b999-b396963921a7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.735927 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.735851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eff9ce3a-0f66-4e43-b999-b396963921a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.836366 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.836331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eff9ce3a-0f66-4e43-b999-b396963921a7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.836535 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.836370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eff9ce3a-0f66-4e43-b999-b396963921a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.836535 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.836469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwvsg\" (UniqueName: \"kubernetes.io/projected/eff9ce3a-0f66-4e43-b999-b396963921a7-kube-api-access-nwvsg\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.836605 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:13:59.836542    2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 14 11:13:59.836637 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:13:59.836615    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff9ce3a-0f66-4e43-b999-b396963921a7-plugin-serving-cert podName:eff9ce3a-0f66-4e43-b999-b396963921a7 nodeName:}" failed. No retries permitted until 2026-07-14 11:14:00.336599334 +0000 UTC m=+426.789545190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/eff9ce3a-0f66-4e43-b999-b396963921a7-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-m8mzx" (UID: "eff9ce3a-0f66-4e43-b999-b396963921a7") : secret "plugin-serving-cert" not found
Jul 14 11:13:59.837081 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.837062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eff9ce3a-0f66-4e43-b999-b396963921a7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:13:59.864931 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:13:59.864910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwvsg\" (UniqueName: \"kubernetes.io/projected/eff9ce3a-0f66-4e43-b999-b396963921a7-kube-api-access-nwvsg\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:14:00.340779 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:00.340746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eff9ce3a-0f66-4e43-b999-b396963921a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:14:00.343118 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:00.343100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eff9ce3a-0f66-4e43-b999-b396963921a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-m8mzx\" (UID: \"eff9ce3a-0f66-4e43-b999-b396963921a7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:14:00.576604 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:00.576569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"
Jul 14 11:14:00.721294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:00.721267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx"]
Jul 14 11:14:00.723335 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:14:00.723306    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeff9ce3a_0f66_4e43_b999_b396963921a7.slice/crio-e3d26ad37967261e158d6ec8c086fd4ce242f9988d95bea351c0ca57b8417ebf WatchSource:0}: Error finding container e3d26ad37967261e158d6ec8c086fd4ce242f9988d95bea351c0ca57b8417ebf: Status 404 returned error can't find the container with id e3d26ad37967261e158d6ec8c086fd4ce242f9988d95bea351c0ca57b8417ebf
Jul 14 11:14:00.993368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:00.993283    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx" event={"ID":"eff9ce3a-0f66-4e43-b999-b396963921a7","Type":"ContainerStarted","Data":"e3d26ad37967261e158d6ec8c086fd4ce242f9988d95bea351c0ca57b8417ebf"}
Jul 14 11:14:26.129322 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:26.129284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx" event={"ID":"eff9ce3a-0f66-4e43-b999-b396963921a7","Type":"ContainerStarted","Data":"260e78153ee79d3c028cdb4b41cf761dc0b87642c6ecd252272bff3a2195a03e"}
Jul 14 11:14:26.146525 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:26.146474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-m8mzx" podStartSLOduration=2.63629857 podStartE2EDuration="27.14645919s" totalImagesPullingTime="24.51016062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:14:26.146126853 +0000 UTC m=+452.599072730" watchObservedRunningTime="2026-07-14 11:14:26.14645919 +0000 UTC m=+452.599405068"
Jul 14 11:14:41.951895 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:41.951862    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"]
Jul 14 11:14:41.976530 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:41.976494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"]
Jul 14 11:14:41.976708 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:41.976592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:41.979384 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:41.979361    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 11:14:42.015118 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.015084    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"]
Jul 14 11:14:42.125414 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.125381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1f833cb-e865-4b4f-833b-76f8b43a6a22-config-file\") pod \"limitador-limitador-64c94fd64f-mhrpp\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:42.125575 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.125456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszhf\" (UniqueName: \"kubernetes.io/projected/b1f833cb-e865-4b4f-833b-76f8b43a6a22-kube-api-access-bszhf\") pod \"limitador-limitador-64c94fd64f-mhrpp\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:42.225937 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.225864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1f833cb-e865-4b4f-833b-76f8b43a6a22-config-file\") pod \"limitador-limitador-64c94fd64f-mhrpp\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:42.226068 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.226016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bszhf\" (UniqueName: \"kubernetes.io/projected/b1f833cb-e865-4b4f-833b-76f8b43a6a22-kube-api-access-bszhf\") pod \"limitador-limitador-64c94fd64f-mhrpp\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:42.226537 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.226520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1f833cb-e865-4b4f-833b-76f8b43a6a22-config-file\") pod \"limitador-limitador-64c94fd64f-mhrpp\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:42.233856 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.233824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszhf\" (UniqueName: \"kubernetes.io/projected/b1f833cb-e865-4b4f-833b-76f8b43a6a22-kube-api-access-bszhf\") pod \"limitador-limitador-64c94fd64f-mhrpp\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:42.287870 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.287836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:42.422180 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.422141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"]
Jul 14 11:14:42.424177 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:14:42.424133    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f833cb_e865_4b4f_833b_76f8b43a6a22.slice/crio-f00548fca60ce83d6aacc87beb643430f748ad22d920fa6afb3e3f817cdbfd6f WatchSource:0}: Error finding container f00548fca60ce83d6aacc87beb643430f748ad22d920fa6afb3e3f817cdbfd6f: Status 404 returned error can't find the container with id f00548fca60ce83d6aacc87beb643430f748ad22d920fa6afb3e3f817cdbfd6f
Jul 14 11:14:42.970807 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.970771    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lmc9h"]
Jul 14 11:14:42.973798 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.973775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lmc9h"
Jul 14 11:14:42.976846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.976829    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4mzdq\""
Jul 14 11:14:42.983744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:42.983725    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lmc9h"]
Jul 14 11:14:43.136079 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:43.135532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2knqh\" (UniqueName: \"kubernetes.io/projected/4e9faee2-bbbc-44f9-9feb-88abfb5db747-kube-api-access-2knqh\") pod \"authorino-75d556bd77-lmc9h\" (UID: \"4e9faee2-bbbc-44f9-9feb-88abfb5db747\") " pod="kuadrant-system/authorino-75d556bd77-lmc9h"
Jul 14 11:14:43.204178 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:43.204126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp" event={"ID":"b1f833cb-e865-4b4f-833b-76f8b43a6a22","Type":"ContainerStarted","Data":"f00548fca60ce83d6aacc87beb643430f748ad22d920fa6afb3e3f817cdbfd6f"}
Jul 14 11:14:43.237347 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:43.236959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2knqh\" (UniqueName: \"kubernetes.io/projected/4e9faee2-bbbc-44f9-9feb-88abfb5db747-kube-api-access-2knqh\") pod \"authorino-75d556bd77-lmc9h\" (UID: \"4e9faee2-bbbc-44f9-9feb-88abfb5db747\") " pod="kuadrant-system/authorino-75d556bd77-lmc9h"
Jul 14 11:14:43.248626 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:43.248573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2knqh\" (UniqueName: \"kubernetes.io/projected/4e9faee2-bbbc-44f9-9feb-88abfb5db747-kube-api-access-2knqh\") pod \"authorino-75d556bd77-lmc9h\" (UID: \"4e9faee2-bbbc-44f9-9feb-88abfb5db747\") " pod="kuadrant-system/authorino-75d556bd77-lmc9h"
Jul 14 11:14:43.283852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:43.283820    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lmc9h"
Jul 14 11:14:43.449216 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:43.448909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lmc9h"]
Jul 14 11:14:44.212523 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:44.212487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lmc9h" event={"ID":"4e9faee2-bbbc-44f9-9feb-88abfb5db747","Type":"ContainerStarted","Data":"b07522b7ce9fcb8ab5a626b78361149c586264df352fb334c3ebad7babd863eb"}
Jul 14 11:14:47.228783 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:47.228685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp" event={"ID":"b1f833cb-e865-4b4f-833b-76f8b43a6a22","Type":"ContainerStarted","Data":"015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5"}
Jul 14 11:14:47.229227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:47.228802    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:47.230057 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:47.230036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lmc9h" event={"ID":"4e9faee2-bbbc-44f9-9feb-88abfb5db747","Type":"ContainerStarted","Data":"8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba"}
Jul 14 11:14:47.253713 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:47.253666    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp" podStartSLOduration=1.744404611 podStartE2EDuration="6.253652058s" totalImagesPullingTime="4.509247447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:14:47.252229548 +0000 UTC m=+473.705175426" watchObservedRunningTime="2026-07-14 11:14:47.253652058 +0000 UTC m=+473.706597936"
Jul 14 11:14:47.275776 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:47.275729    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lmc9h" podStartSLOduration=1.7921672530000001 podStartE2EDuration="5.275715326s" totalImagesPullingTime="3.483548073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:14:47.274312921 +0000 UTC m=+473.727258799" watchObservedRunningTime="2026-07-14 11:14:47.275715326 +0000 UTC m=+473.728661204"
Jul 14 11:14:58.236047 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:58.236020    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:58.932386 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:58.932356    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"]
Jul 14 11:14:58.932572 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:58.932527    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp" podUID="b1f833cb-e865-4b4f-833b-76f8b43a6a22" containerName="limitador" containerID="cri-o://015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5" gracePeriod=30
Jul 14 11:14:59.489659 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:59.489634    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:14:59.579739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:59.579692    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bszhf\" (UniqueName: \"kubernetes.io/projected/b1f833cb-e865-4b4f-833b-76f8b43a6a22-kube-api-access-bszhf\") pod \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") "
Jul 14 11:14:59.579907 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:59.579800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1f833cb-e865-4b4f-833b-76f8b43a6a22-config-file\") pod \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\" (UID: \"b1f833cb-e865-4b4f-833b-76f8b43a6a22\") "
Jul 14 11:14:59.580125 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:59.580103    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f833cb-e865-4b4f-833b-76f8b43a6a22-config-file" (OuterVolumeSpecName: "config-file") pod "b1f833cb-e865-4b4f-833b-76f8b43a6a22" (UID: "b1f833cb-e865-4b4f-833b-76f8b43a6a22"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:14:59.581772 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:59.581745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f833cb-e865-4b4f-833b-76f8b43a6a22-kube-api-access-bszhf" (OuterVolumeSpecName: "kube-api-access-bszhf") pod "b1f833cb-e865-4b4f-833b-76f8b43a6a22" (UID: "b1f833cb-e865-4b4f-833b-76f8b43a6a22"). InnerVolumeSpecName "kube-api-access-bszhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:14:59.681045 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:59.681016    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bszhf\" (UniqueName: \"kubernetes.io/projected/b1f833cb-e865-4b4f-833b-76f8b43a6a22-kube-api-access-bszhf\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:14:59.681045 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:14:59.681041    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b1f833cb-e865-4b4f-833b-76f8b43a6a22-config-file\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:15:00.286227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.286188    2581 generic.go:356] "Generic (PLEG): container finished" podID="b1f833cb-e865-4b4f-833b-76f8b43a6a22" containerID="015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5" exitCode=0
Jul 14 11:15:00.286389 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.286255    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"
Jul 14 11:15:00.286389 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.286286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp" event={"ID":"b1f833cb-e865-4b4f-833b-76f8b43a6a22","Type":"ContainerDied","Data":"015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5"}
Jul 14 11:15:00.286389 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.286347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mhrpp" event={"ID":"b1f833cb-e865-4b4f-833b-76f8b43a6a22","Type":"ContainerDied","Data":"f00548fca60ce83d6aacc87beb643430f748ad22d920fa6afb3e3f817cdbfd6f"}
Jul 14 11:15:00.286389 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.286369    2581 scope.go:117] "RemoveContainer" containerID="015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5"
Jul 14 11:15:00.294584 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.294566    2581 scope.go:117] "RemoveContainer" containerID="015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5"
Jul 14 11:15:00.294861 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:15:00.294839    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5\": container with ID starting with 015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5 not found: ID does not exist" containerID="015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5"
Jul 14 11:15:00.294905 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.294872    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5"} err="failed to get container status \"015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5\": rpc error: code = NotFound desc = could not find container \"015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5\": container with ID starting with 015459e5d2c2587b256dd9df62ce03f296b91a6c2ec1e18346511c28a5af69b5 not found: ID does not exist"
Jul 14 11:15:00.303093 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.303071    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"]
Jul 14 11:15:00.306360 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:00.306340    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mhrpp"]
Jul 14 11:15:02.051765 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:02.051736    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f833cb-e865-4b4f-833b-76f8b43a6a22" path="/var/lib/kubelet/pods/b1f833cb-e865-4b4f-833b-76f8b43a6a22/volumes"
Jul 14 11:15:16.705182 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.705131    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-779b477f48-npmld"]
Jul 14 11:15:16.705690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.705487    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f833cb-e865-4b4f-833b-76f8b43a6a22" containerName="limitador"
Jul 14 11:15:16.705690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.705499    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f833cb-e865-4b4f-833b-76f8b43a6a22" containerName="limitador"
Jul 14 11:15:16.705690 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.705605    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f833cb-e865-4b4f-833b-76f8b43a6a22" containerName="limitador"
Jul 14 11:15:16.708881 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.708864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779b477f48-npmld"
Jul 14 11:15:16.717708 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.717683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-779b477f48-npmld"]
Jul 14 11:15:16.793846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.793814    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-779b477f48-npmld"]
Jul 14 11:15:16.794080 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:15:16.794061    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h6jm6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-779b477f48-npmld" podUID="91458fc3-15e3-4d33-ae31-e9cf755f03ac"
Jul 14 11:15:16.820730 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.820706    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56dc8fb7cb-9jq45"]
Jul 14 11:15:16.823467 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.823446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6jm6\" (UniqueName: \"kubernetes.io/projected/91458fc3-15e3-4d33-ae31-e9cf755f03ac-kube-api-access-h6jm6\") pod \"authorino-779b477f48-npmld\" (UID: \"91458fc3-15e3-4d33-ae31-e9cf755f03ac\") " pod="kuadrant-system/authorino-779b477f48-npmld"
Jul 14 11:15:16.823792 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.823777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:16.826327 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.826307    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 11:15:16.831847 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.831826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56dc8fb7cb-9jq45"]
Jul 14 11:15:16.924199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.924169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf8kh\" (UniqueName: \"kubernetes.io/projected/c4ad2f13-0072-47d6-8063-6693527c1683-kube-api-access-wf8kh\") pod \"authorino-56dc8fb7cb-9jq45\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") " pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:16.924332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.924226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6jm6\" (UniqueName: \"kubernetes.io/projected/91458fc3-15e3-4d33-ae31-e9cf755f03ac-kube-api-access-h6jm6\") pod \"authorino-779b477f48-npmld\" (UID: \"91458fc3-15e3-4d33-ae31-e9cf755f03ac\") " pod="kuadrant-system/authorino-779b477f48-npmld"
Jul 14 11:15:16.924332 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.924319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4ad2f13-0072-47d6-8063-6693527c1683-tls-cert\") pod \"authorino-56dc8fb7cb-9jq45\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") " pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:16.932520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:16.932495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6jm6\" (UniqueName: \"kubernetes.io/projected/91458fc3-15e3-4d33-ae31-e9cf755f03ac-kube-api-access-h6jm6\") pod \"authorino-779b477f48-npmld\" (UID: \"91458fc3-15e3-4d33-ae31-e9cf755f03ac\") " pod="kuadrant-system/authorino-779b477f48-npmld"
Jul 14 11:15:17.025552 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.025473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4ad2f13-0072-47d6-8063-6693527c1683-tls-cert\") pod \"authorino-56dc8fb7cb-9jq45\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") " pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:17.025552 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.025519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf8kh\" (UniqueName: \"kubernetes.io/projected/c4ad2f13-0072-47d6-8063-6693527c1683-kube-api-access-wf8kh\") pod \"authorino-56dc8fb7cb-9jq45\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") " pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:17.027728 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.027704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4ad2f13-0072-47d6-8063-6693527c1683-tls-cert\") pod \"authorino-56dc8fb7cb-9jq45\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") " pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:17.034390 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.034367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf8kh\" (UniqueName: \"kubernetes.io/projected/c4ad2f13-0072-47d6-8063-6693527c1683-kube-api-access-wf8kh\") pod \"authorino-56dc8fb7cb-9jq45\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") " pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:17.133088 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.133060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:15:17.263042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.263017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56dc8fb7cb-9jq45"]
Jul 14 11:15:17.265430 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:15:17.265403    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4ad2f13_0072_47d6_8063_6693527c1683.slice/crio-7d793abc56cd4816234b32e1c9c3e4f1aca572a17074ec21b9db38133a3cbf7a WatchSource:0}: Error finding container 7d793abc56cd4816234b32e1c9c3e4f1aca572a17074ec21b9db38133a3cbf7a: Status 404 returned error can't find the container with id 7d793abc56cd4816234b32e1c9c3e4f1aca572a17074ec21b9db38133a3cbf7a
Jul 14 11:15:17.361456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.361437    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779b477f48-npmld"
Jul 14 11:15:17.361583 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.361476    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45" event={"ID":"c4ad2f13-0072-47d6-8063-6693527c1683","Type":"ContainerStarted","Data":"7d793abc56cd4816234b32e1c9c3e4f1aca572a17074ec21b9db38133a3cbf7a"}
Jul 14 11:15:17.370730 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.370712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779b477f48-npmld"
Jul 14 11:15:17.429082 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.429052    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6jm6\" (UniqueName: \"kubernetes.io/projected/91458fc3-15e3-4d33-ae31-e9cf755f03ac-kube-api-access-h6jm6\") pod \"91458fc3-15e3-4d33-ae31-e9cf755f03ac\" (UID: \"91458fc3-15e3-4d33-ae31-e9cf755f03ac\") "
Jul 14 11:15:17.431046 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.431016    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91458fc3-15e3-4d33-ae31-e9cf755f03ac-kube-api-access-h6jm6" (OuterVolumeSpecName: "kube-api-access-h6jm6") pod "91458fc3-15e3-4d33-ae31-e9cf755f03ac" (UID: "91458fc3-15e3-4d33-ae31-e9cf755f03ac"). InnerVolumeSpecName "kube-api-access-h6jm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:15:17.530239 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:17.530208    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6jm6\" (UniqueName: \"kubernetes.io/projected/91458fc3-15e3-4d33-ae31-e9cf755f03ac-kube-api-access-h6jm6\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:15:18.367687 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.367645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45" event={"ID":"c4ad2f13-0072-47d6-8063-6693527c1683","Type":"ContainerStarted","Data":"72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b"}
Jul 14 11:15:18.367687 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.367679    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-779b477f48-npmld"
Jul 14 11:15:18.384523 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.384479    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45" podStartSLOduration=1.980587278 podStartE2EDuration="2.38446568s" totalImagesPullingTime="403.878402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:18.383549269 +0000 UTC m=+504.836495148" watchObservedRunningTime="2026-07-14 11:15:18.38446568 +0000 UTC m=+504.837411557"
Jul 14 11:15:18.409284 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.409256    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-779b477f48-npmld"]
Jul 14 11:15:18.413873 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.413850    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lmc9h"]
Jul 14 11:15:18.414048 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.414028    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lmc9h" podUID="4e9faee2-bbbc-44f9-9feb-88abfb5db747" containerName="authorino" containerID="cri-o://8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba" gracePeriod=30
Jul 14 11:15:18.416295 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.416273    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-779b477f48-npmld"]
Jul 14 11:15:18.659961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.659940    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lmc9h"
Jul 14 11:15:18.740289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.740262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2knqh\" (UniqueName: \"kubernetes.io/projected/4e9faee2-bbbc-44f9-9feb-88abfb5db747-kube-api-access-2knqh\") pod \"4e9faee2-bbbc-44f9-9feb-88abfb5db747\" (UID: \"4e9faee2-bbbc-44f9-9feb-88abfb5db747\") "
Jul 14 11:15:18.742278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.742257    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e9faee2-bbbc-44f9-9feb-88abfb5db747-kube-api-access-2knqh" (OuterVolumeSpecName: "kube-api-access-2knqh") pod "4e9faee2-bbbc-44f9-9feb-88abfb5db747" (UID: "4e9faee2-bbbc-44f9-9feb-88abfb5db747"). InnerVolumeSpecName "kube-api-access-2knqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:15:18.840929 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:18.840894    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2knqh\" (UniqueName: \"kubernetes.io/projected/4e9faee2-bbbc-44f9-9feb-88abfb5db747-kube-api-access-2knqh\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:15:19.373489 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.373457    2581 generic.go:356] "Generic (PLEG): container finished" podID="4e9faee2-bbbc-44f9-9feb-88abfb5db747" containerID="8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba" exitCode=0
Jul 14 11:15:19.373912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.373495    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lmc9h"
Jul 14 11:15:19.373912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.373534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lmc9h" event={"ID":"4e9faee2-bbbc-44f9-9feb-88abfb5db747","Type":"ContainerDied","Data":"8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba"}
Jul 14 11:15:19.373912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.373569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lmc9h" event={"ID":"4e9faee2-bbbc-44f9-9feb-88abfb5db747","Type":"ContainerDied","Data":"b07522b7ce9fcb8ab5a626b78361149c586264df352fb334c3ebad7babd863eb"}
Jul 14 11:15:19.373912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.373585    2581 scope.go:117] "RemoveContainer" containerID="8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba"
Jul 14 11:15:19.385275 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.385248    2581 scope.go:117] "RemoveContainer" containerID="8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba"
Jul 14 11:15:19.385615 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:15:19.385594    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba\": container with ID starting with 8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba not found: ID does not exist" containerID="8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba"
Jul 14 11:15:19.385706 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.385624    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba"} err="failed to get container status \"8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba\": rpc error: code = NotFound desc = could not find container \"8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba\": container with ID starting with 8dca6573ab9e5103bf4d7433a4fa39a9af9cac1ba5e9b61f3a2405ddaf8146ba not found: ID does not exist"
Jul 14 11:15:19.405033 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.405010    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lmc9h"]
Jul 14 11:15:19.408676 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:19.408656    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lmc9h"]
Jul 14 11:15:20.052481 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:20.052447    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e9faee2-bbbc-44f9-9feb-88abfb5db747" path="/var/lib/kubelet/pods/4e9faee2-bbbc-44f9-9feb-88abfb5db747/volumes"
Jul 14 11:15:20.052751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:20.052738    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91458fc3-15e3-4d33-ae31-e9cf755f03ac" path="/var/lib/kubelet/pods/91458fc3-15e3-4d33-ae31-e9cf755f03ac/volumes"
Jul 14 11:15:23.646928 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.646897    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b5db96ffd-2gt2z"]
Jul 14 11:15:23.647299 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.647262    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e9faee2-bbbc-44f9-9feb-88abfb5db747" containerName="authorino"
Jul 14 11:15:23.647299 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.647273    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e9faee2-bbbc-44f9-9feb-88abfb5db747" containerName="authorino"
Jul 14 11:15:23.647376 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.647339    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e9faee2-bbbc-44f9-9feb-88abfb5db747" containerName="authorino"
Jul 14 11:15:23.651606 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.651590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:23.654543 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.654517    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 11:15:23.654688 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.654585    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 11:15:23.654688 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.654612    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mg5nb\""
Jul 14 11:15:23.662181 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.662140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b5db96ffd-2gt2z"]
Jul 14 11:15:23.784833 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.784803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzlmd\" (UniqueName: \"kubernetes.io/projected/f9ebb75b-5130-4aba-b004-3ab65d20f313-kube-api-access-pzlmd\") pod \"maas-controller-6b5db96ffd-2gt2z\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") " pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:23.784984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.784862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert\") pod \"maas-controller-6b5db96ffd-2gt2z\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") " pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:23.846923 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.846893    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5794fb4596-mm2w9"]
Jul 14 11:15:23.849159 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.849131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:23.860987 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.860968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5794fb4596-mm2w9"]
Jul 14 11:15:23.886031 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.886006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzlmd\" (UniqueName: \"kubernetes.io/projected/f9ebb75b-5130-4aba-b004-3ab65d20f313-kube-api-access-pzlmd\") pod \"maas-controller-6b5db96ffd-2gt2z\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") " pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:23.886135 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.886062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert\") pod \"maas-controller-6b5db96ffd-2gt2z\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") " pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:23.886212 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:15:23.886181    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 14 11:15:23.886254 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:15:23.886227    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert podName:f9ebb75b-5130-4aba-b004-3ab65d20f313 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:24.386213347 +0000 UTC m=+510.839159202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert") pod "maas-controller-6b5db96ffd-2gt2z" (UID: "f9ebb75b-5130-4aba-b004-3ab65d20f313") : secret "maas-controller-webhook-cert" not found
Jul 14 11:15:23.897586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.897533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzlmd\" (UniqueName: \"kubernetes.io/projected/f9ebb75b-5130-4aba-b004-3ab65d20f313-kube-api-access-pzlmd\") pod \"maas-controller-6b5db96ffd-2gt2z\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") " pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:23.986780 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.986751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35a5002-35de-4015-9c09-bb85a1e64147-webhook-cert\") pod \"maas-controller-5794fb4596-mm2w9\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") " pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:23.986892 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:23.986816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnlk\" (UniqueName: \"kubernetes.io/projected/a35a5002-35de-4015-9c09-bb85a1e64147-kube-api-access-wqnlk\") pod \"maas-controller-5794fb4596-mm2w9\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") " pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:24.088226 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.088197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnlk\" (UniqueName: \"kubernetes.io/projected/a35a5002-35de-4015-9c09-bb85a1e64147-kube-api-access-wqnlk\") pod \"maas-controller-5794fb4596-mm2w9\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") " pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:24.088387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.088305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35a5002-35de-4015-9c09-bb85a1e64147-webhook-cert\") pod \"maas-controller-5794fb4596-mm2w9\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") " pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:24.090731 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.090713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35a5002-35de-4015-9c09-bb85a1e64147-webhook-cert\") pod \"maas-controller-5794fb4596-mm2w9\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") " pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:24.096722 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.096704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnlk\" (UniqueName: \"kubernetes.io/projected/a35a5002-35de-4015-9c09-bb85a1e64147-kube-api-access-wqnlk\") pod \"maas-controller-5794fb4596-mm2w9\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") " pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:24.158988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.158917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:24.291183 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.291138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5794fb4596-mm2w9"]
Jul 14 11:15:24.292284 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:15:24.292259    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35a5002_35de_4015_9c09_bb85a1e64147.slice/crio-671c47e2aa330307c0a522212080a3fc32d658efc912a9b9ad305960cc266ab2 WatchSource:0}: Error finding container 671c47e2aa330307c0a522212080a3fc32d658efc912a9b9ad305960cc266ab2: Status 404 returned error can't find the container with id 671c47e2aa330307c0a522212080a3fc32d658efc912a9b9ad305960cc266ab2
Jul 14 11:15:24.391103 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.391074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert\") pod \"maas-controller-6b5db96ffd-2gt2z\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") " pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:24.393358 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.393334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert\") pod \"maas-controller-6b5db96ffd-2gt2z\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") " pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:24.398462 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.398437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794fb4596-mm2w9" event={"ID":"a35a5002-35de-4015-9c09-bb85a1e64147","Type":"ContainerStarted","Data":"671c47e2aa330307c0a522212080a3fc32d658efc912a9b9ad305960cc266ab2"}
Jul 14 11:15:24.561808 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.561781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:24.686272 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:24.686249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b5db96ffd-2gt2z"]
Jul 14 11:15:24.687786 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:15:24.687761    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ebb75b_5130_4aba_b004_3ab65d20f313.slice/crio-fdccb27189460d8cfc58614fefb215b532345a6ee38d0c903a271ef59d0666a6 WatchSource:0}: Error finding container fdccb27189460d8cfc58614fefb215b532345a6ee38d0c903a271ef59d0666a6: Status 404 returned error can't find the container with id fdccb27189460d8cfc58614fefb215b532345a6ee38d0c903a271ef59d0666a6
Jul 14 11:15:25.408228 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:25.408087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z" event={"ID":"f9ebb75b-5130-4aba-b004-3ab65d20f313","Type":"ContainerStarted","Data":"fdccb27189460d8cfc58614fefb215b532345a6ee38d0c903a271ef59d0666a6"}
Jul 14 11:15:27.419924 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:27.419834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794fb4596-mm2w9" event={"ID":"a35a5002-35de-4015-9c09-bb85a1e64147","Type":"ContainerStarted","Data":"f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca"}
Jul 14 11:15:27.420355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:27.419992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:27.421247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:27.421224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z" event={"ID":"f9ebb75b-5130-4aba-b004-3ab65d20f313","Type":"ContainerStarted","Data":"a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0"}
Jul 14 11:15:27.421351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:27.421341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:27.456857 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:27.456810    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5794fb4596-mm2w9" podStartSLOduration=1.658339276 podStartE2EDuration="4.456798649s" totalImagesPullingTime="2.798459373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:27.455940334 +0000 UTC m=+513.908886213" watchObservedRunningTime="2026-07-14 11:15:27.456798649 +0000 UTC m=+513.909744527"
Jul 14 11:15:27.499538 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:27.499492    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z" podStartSLOduration=2.09259691 podStartE2EDuration="4.49947767s" totalImagesPullingTime="2.40688076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:27.498440759 +0000 UTC m=+513.951386649" watchObservedRunningTime="2026-07-14 11:15:27.49947767 +0000 UTC m=+513.952423548"
Jul 14 11:15:38.427864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.427831    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:38.428312 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.427917    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:15:38.492052 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.492021    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b5db96ffd-2gt2z"]
Jul 14 11:15:38.492248 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.492223    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z" podUID="f9ebb75b-5130-4aba-b004-3ab65d20f313" containerName="manager" containerID="cri-o://a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0" gracePeriod=30
Jul 14 11:15:38.733601 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.733574    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:38.815095 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.815063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzlmd\" (UniqueName: \"kubernetes.io/projected/f9ebb75b-5130-4aba-b004-3ab65d20f313-kube-api-access-pzlmd\") pod \"f9ebb75b-5130-4aba-b004-3ab65d20f313\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") "
Jul 14 11:15:38.815293 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.815142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert\") pod \"f9ebb75b-5130-4aba-b004-3ab65d20f313\" (UID: \"f9ebb75b-5130-4aba-b004-3ab65d20f313\") "
Jul 14 11:15:38.817355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.817324    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9ebb75b-5130-4aba-b004-3ab65d20f313-kube-api-access-pzlmd" (OuterVolumeSpecName: "kube-api-access-pzlmd") pod "f9ebb75b-5130-4aba-b004-3ab65d20f313" (UID: "f9ebb75b-5130-4aba-b004-3ab65d20f313"). InnerVolumeSpecName "kube-api-access-pzlmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:15:38.817355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.817322    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f9ebb75b-5130-4aba-b004-3ab65d20f313" (UID: "f9ebb75b-5130-4aba-b004-3ab65d20f313"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:15:38.916336 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.916290    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzlmd\" (UniqueName: \"kubernetes.io/projected/f9ebb75b-5130-4aba-b004-3ab65d20f313-kube-api-access-pzlmd\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:15:38.916336 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:38.916331    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9ebb75b-5130-4aba-b004-3ab65d20f313-webhook-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:15:39.478829 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.478793    2581 generic.go:356] "Generic (PLEG): container finished" podID="f9ebb75b-5130-4aba-b004-3ab65d20f313" containerID="a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0" exitCode=0
Jul 14 11:15:39.479351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.478835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z" event={"ID":"f9ebb75b-5130-4aba-b004-3ab65d20f313","Type":"ContainerDied","Data":"a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0"}
Jul 14 11:15:39.479351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.478882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z" event={"ID":"f9ebb75b-5130-4aba-b004-3ab65d20f313","Type":"ContainerDied","Data":"fdccb27189460d8cfc58614fefb215b532345a6ee38d0c903a271ef59d0666a6"}
Jul 14 11:15:39.479351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.478913    2581 scope.go:117] "RemoveContainer" containerID="a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0"
Jul 14 11:15:39.479351 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.478839    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b5db96ffd-2gt2z"
Jul 14 11:15:39.487869 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.487841    2581 scope.go:117] "RemoveContainer" containerID="a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0"
Jul 14 11:15:39.488099 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:15:39.488081    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0\": container with ID starting with a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0 not found: ID does not exist" containerID="a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0"
Jul 14 11:15:39.488181 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.488111    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0"} err="failed to get container status \"a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0\": rpc error: code = NotFound desc = could not find container \"a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0\": container with ID starting with a0cf404c92981b0ba73189a9c9217661a11d89e81778fd148cd90bfb1edc2be0 not found: ID does not exist"
Jul 14 11:15:39.505246 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.505222    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b5db96ffd-2gt2z"]
Jul 14 11:15:39.507997 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:39.507977    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b5db96ffd-2gt2z"]
Jul 14 11:15:40.052910 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:15:40.052881    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9ebb75b-5130-4aba-b004-3ab65d20f313" path="/var/lib/kubelet/pods/f9ebb75b-5130-4aba-b004-3ab65d20f313/volumes"
Jul 14 11:16:01.544789 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.544752    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"]
Jul 14 11:16:01.545184 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.545121    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9ebb75b-5130-4aba-b004-3ab65d20f313" containerName="manager"
Jul 14 11:16:01.545184 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.545135    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9ebb75b-5130-4aba-b004-3ab65d20f313" containerName="manager"
Jul 14 11:16:01.545306 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.545230    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9ebb75b-5130-4aba-b004-3ab65d20f313" containerName="manager"
Jul 14 11:16:01.549899 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.549879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.553444 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.553427    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-msfx8\""
Jul 14 11:16:01.553823 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.553805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 11:16:01.560321 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.560298    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"]
Jul 14 11:16:01.566734 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.566715    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"]
Jul 14 11:16:01.569118 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.569103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:01.588656 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.588634    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"]
Jul 14 11:16:01.603968 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.603945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zcm\" (UniqueName: \"kubernetes.io/projected/d605f0a6-194d-46b9-87cc-50ee23f39df7-kube-api-access-s7zcm\") pod \"payload-processing-f9b8d9b9b-z5kr8\" (UID: \"d605f0a6-194d-46b9-87cc-50ee23f39df7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:01.604071 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.603986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7z4f\" (UniqueName: \"kubernetes.io/projected/64185333-d171-469c-beb3-861211f468bc-kube-api-access-j7z4f\") pod \"payload-pre-processing-74584bb9f8-tng2s\" (UID: \"64185333-d171-469c-beb3-861211f468bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.604071 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.604050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d605f0a6-194d-46b9-87cc-50ee23f39df7-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-z5kr8\" (UID: \"d605f0a6-194d-46b9-87cc-50ee23f39df7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:01.604223 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.604199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64185333-d171-469c-beb3-861211f468bc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-tng2s\" (UID: \"64185333-d171-469c-beb3-861211f468bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.705287 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.705248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64185333-d171-469c-beb3-861211f468bc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-tng2s\" (UID: \"64185333-d171-469c-beb3-861211f468bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.705466 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.705335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zcm\" (UniqueName: \"kubernetes.io/projected/d605f0a6-194d-46b9-87cc-50ee23f39df7-kube-api-access-s7zcm\") pod \"payload-processing-f9b8d9b9b-z5kr8\" (UID: \"d605f0a6-194d-46b9-87cc-50ee23f39df7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:01.705466 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.705377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7z4f\" (UniqueName: \"kubernetes.io/projected/64185333-d171-469c-beb3-861211f468bc-kube-api-access-j7z4f\") pod \"payload-pre-processing-74584bb9f8-tng2s\" (UID: \"64185333-d171-469c-beb3-861211f468bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.705580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.705442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d605f0a6-194d-46b9-87cc-50ee23f39df7-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-z5kr8\" (UID: \"d605f0a6-194d-46b9-87cc-50ee23f39df7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:01.706018 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.705993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64185333-d171-469c-beb3-861211f468bc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-tng2s\" (UID: \"64185333-d171-469c-beb3-861211f468bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.706236 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.706215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d605f0a6-194d-46b9-87cc-50ee23f39df7-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-z5kr8\" (UID: \"d605f0a6-194d-46b9-87cc-50ee23f39df7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:01.719203 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.719179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zcm\" (UniqueName: \"kubernetes.io/projected/d605f0a6-194d-46b9-87cc-50ee23f39df7-kube-api-access-s7zcm\") pod \"payload-processing-f9b8d9b9b-z5kr8\" (UID: \"d605f0a6-194d-46b9-87cc-50ee23f39df7\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:01.719301 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.719219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7z4f\" (UniqueName: \"kubernetes.io/projected/64185333-d171-469c-beb3-861211f468bc-kube-api-access-j7z4f\") pod \"payload-pre-processing-74584bb9f8-tng2s\" (UID: \"64185333-d171-469c-beb3-861211f468bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.860764 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.860729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:01.878907 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:01.878880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:02.005873 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:02.005843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"]
Jul 14 11:16:02.008091 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:16:02.008051    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64185333_d171_469c_beb3_861211f468bc.slice/crio-27333187c2a6861c3e926574a9370b703ebd27e94807c3826d2b11e98a981ec2 WatchSource:0}: Error finding container 27333187c2a6861c3e926574a9370b703ebd27e94807c3826d2b11e98a981ec2: Status 404 returned error can't find the container with id 27333187c2a6861c3e926574a9370b703ebd27e94807c3826d2b11e98a981ec2
Jul 14 11:16:02.030016 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:02.029991    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"]
Jul 14 11:16:02.031517 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:16:02.031492    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd605f0a6_194d_46b9_87cc_50ee23f39df7.slice/crio-0ea3994bd82aa4b87fabc10bae0ac76b0a9f3febef14802d4bbea213bdaf8d55 WatchSource:0}: Error finding container 0ea3994bd82aa4b87fabc10bae0ac76b0a9f3febef14802d4bbea213bdaf8d55: Status 404 returned error can't find the container with id 0ea3994bd82aa4b87fabc10bae0ac76b0a9f3febef14802d4bbea213bdaf8d55
Jul 14 11:16:02.589204 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:02.589167    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s" event={"ID":"64185333-d171-469c-beb3-861211f468bc","Type":"ContainerStarted","Data":"27333187c2a6861c3e926574a9370b703ebd27e94807c3826d2b11e98a981ec2"}
Jul 14 11:16:02.593133 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:02.593103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8" event={"ID":"d605f0a6-194d-46b9-87cc-50ee23f39df7","Type":"ContainerStarted","Data":"0ea3994bd82aa4b87fabc10bae0ac76b0a9f3febef14802d4bbea213bdaf8d55"}
Jul 14 11:16:03.599833 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:03.599793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8" event={"ID":"d605f0a6-194d-46b9-87cc-50ee23f39df7","Type":"ContainerStarted","Data":"73d524e14c614cf1132eee8249bde38de3f09d39957ee4d61cbfcc0e50170b25"}
Jul 14 11:16:03.600282 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:03.599892    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:03.601290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:03.601260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s" event={"ID":"64185333-d171-469c-beb3-861211f468bc","Type":"ContainerStarted","Data":"d5b88ba250aa5bb4102f1d6f5a8aa58cf8ad95d3e73093759a2a73706abdc946"}
Jul 14 11:16:03.601394 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:03.601323    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:03.616989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:03.616933    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8" podStartSLOduration=1.267097824 podStartE2EDuration="2.616917345s" totalImagesPullingTime="1.349819521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:03.615748382 +0000 UTC m=+550.068694361" watchObservedRunningTime="2026-07-14 11:16:03.616917345 +0000 UTC m=+550.069863200"
Jul 14 11:16:03.631685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:03.631609    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s" podStartSLOduration=1.256540063 podStartE2EDuration="2.631595979s" totalImagesPullingTime="1.375055916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:03.631139792 +0000 UTC m=+550.084085669" watchObservedRunningTime="2026-07-14 11:16:03.631595979 +0000 UTC m=+550.084541889"
Jul 14 11:16:14.608241 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:14.608213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-z5kr8"
Jul 14 11:16:14.608614 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:14.608483    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tng2s"
Jul 14 11:16:27.726715 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.726682    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"]
Jul 14 11:16:27.732410 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.732369    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.736107 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.736081    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 11:16:27.737015 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.736998    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 11:16:27.737115 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.737016    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 11:16:27.737115 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.737036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ln5z2\""
Jul 14 11:16:27.741620 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.741599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"]
Jul 14 11:16:27.833379 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.833349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.833588 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.833408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.833588 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.833429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.833588 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.833553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.833731 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.833593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d429d75-eb35-40c6-8e76-59804903c58a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.833731 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.833641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xrz6\" (UniqueName: \"kubernetes.io/projected/5d429d75-eb35-40c6-8e76-59804903c58a-kube-api-access-4xrz6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.934918 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.934884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.934918 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.934921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.935176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.934961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.935176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.934991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d429d75-eb35-40c6-8e76-59804903c58a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.935176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.935020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xrz6\" (UniqueName: \"kubernetes.io/projected/5d429d75-eb35-40c6-8e76-59804903c58a-kube-api-access-4xrz6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.935176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.935075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.935509 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.935483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.935593 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.935535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.935593 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.935569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.937295 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.937274    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d429d75-eb35-40c6-8e76-59804903c58a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.937465 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.937448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d429d75-eb35-40c6-8e76-59804903c58a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:27.944143 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:27.944121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xrz6\" (UniqueName: \"kubernetes.io/projected/5d429d75-eb35-40c6-8e76-59804903c58a-kube-api-access-4xrz6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm\" (UID: \"5d429d75-eb35-40c6-8e76-59804903c58a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:28.045590 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:28.045513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:28.193414 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:28.193379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"]
Jul 14 11:16:28.194920 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:16:28.194894    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d429d75_eb35_40c6_8e76_59804903c58a.slice/crio-2c64b4396a939e97aaa4bbba27f1bdd005d935faa5451dc082d94952c2f1d2ee WatchSource:0}: Error finding container 2c64b4396a939e97aaa4bbba27f1bdd005d935faa5451dc082d94952c2f1d2ee: Status 404 returned error can't find the container with id 2c64b4396a939e97aaa4bbba27f1bdd005d935faa5451dc082d94952c2f1d2ee
Jul 14 11:16:28.721816 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:28.721740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm" event={"ID":"5d429d75-eb35-40c6-8e76-59804903c58a","Type":"ContainerStarted","Data":"2c64b4396a939e97aaa4bbba27f1bdd005d935faa5451dc082d94952c2f1d2ee"}
Jul 14 11:16:29.728247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:29.728137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm" event={"ID":"5d429d75-eb35-40c6-8e76-59804903c58a","Type":"ContainerStarted","Data":"6fd89d9993839c1ad815338a3e40eb5e55aa026ec634da7d44bbcbcb14161a7e"}
Jul 14 11:16:29.753030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:29.752979    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm" podStartSLOduration=1.6157343530000001 podStartE2EDuration="2.75296291s" totalImagesPullingTime="1.137228557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:29.750478997 +0000 UTC m=+576.203424875" watchObservedRunningTime="2026-07-14 11:16:29.75296291 +0000 UTC m=+576.205908787"
Jul 14 11:16:38.046399 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:38.046358    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:38.046964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:38.046420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:38.059225 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:38.059200    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:38.784025 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:38.783994    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm"
Jul 14 11:16:56.849299 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.849259    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"]
Jul 14 11:16:56.853012 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.852989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:56.857022 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.857000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 14 11:16:56.866897 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.866870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"]
Jul 14 11:16:56.901142 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.901109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdk66\" (UniqueName: \"kubernetes.io/projected/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-kube-api-access-wdk66\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:56.901336 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.901166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:56.901336 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.901259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:56.901336 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.901305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:56.901336 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.901327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:56.901486 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:56.901405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.002659 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.002607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.002835 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.002693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.002835 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.002731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.002835 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.002756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.002835 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.002805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.003040 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.002918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdk66\" (UniqueName: \"kubernetes.io/projected/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-kube-api-access-wdk66\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.003115 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.003084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.003196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.003166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.003394 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.003371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.005197 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.005138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.005455 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.005432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.012677 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.012652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdk66\" (UniqueName: \"kubernetes.io/projected/bc703cdc-09b3-4ee3-9f79-f85432e01d4d-kube-api-access-wdk66\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltn78\" (UID: \"bc703cdc-09b3-4ee3-9f79-f85432e01d4d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.162985 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.162897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:16:57.294841 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.294810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"]
Jul 14 11:16:57.296130 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:16:57.296102    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc703cdc_09b3_4ee3_9f79_f85432e01d4d.slice/crio-3a332c376a45e04cd4abf2bea5ee73a744fb263deb5c2d118946f88f4c504f45 WatchSource:0}: Error finding container 3a332c376a45e04cd4abf2bea5ee73a744fb263deb5c2d118946f88f4c504f45: Status 404 returned error can't find the container with id 3a332c376a45e04cd4abf2bea5ee73a744fb263deb5c2d118946f88f4c504f45
Jul 14 11:16:57.859476 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.859441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78" event={"ID":"bc703cdc-09b3-4ee3-9f79-f85432e01d4d","Type":"ContainerStarted","Data":"b9d47e7685c4ca27738e0ed86f2e3e85d56368bffb71a84ab8c2c0b0c8fa95b1"}
Jul 14 11:16:57.859878 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.859493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78" event={"ID":"bc703cdc-09b3-4ee3-9f79-f85432e01d4d","Type":"ContainerStarted","Data":"3a332c376a45e04cd4abf2bea5ee73a744fb263deb5c2d118946f88f4c504f45"}
Jul 14 11:16:57.887493 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:16:57.887437    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78" podStartSLOduration=1.646078827 podStartE2EDuration="1.887419872s" totalImagesPullingTime="241.341045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:57.885705138 +0000 UTC m=+604.338651019" watchObservedRunningTime="2026-07-14 11:16:57.887419872 +0000 UTC m=+604.340365758"
Jul 14 11:17:07.163645 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:17:07.163599    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:17:07.166013 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:17:07.163716    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:17:07.176246 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:17:07.176224    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:17:07.913834 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:17:07.913805    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltn78"
Jul 14 11:18:41.061675 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.061631    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56dc8fb7cb-9jq45"]
Jul 14 11:18:41.062229 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.061814    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45" podUID="c4ad2f13-0072-47d6-8063-6693527c1683" containerName="authorino" containerID="cri-o://72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b" gracePeriod=30
Jul 14 11:18:41.311393 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.311370    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:18:41.351005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.350946    2581 generic.go:356] "Generic (PLEG): container finished" podID="c4ad2f13-0072-47d6-8063-6693527c1683" containerID="72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b" exitCode=0
Jul 14 11:18:41.351005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.350985    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45"
Jul 14 11:18:41.351169 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.351028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45" event={"ID":"c4ad2f13-0072-47d6-8063-6693527c1683","Type":"ContainerDied","Data":"72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b"}
Jul 14 11:18:41.351169 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.351065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dc8fb7cb-9jq45" event={"ID":"c4ad2f13-0072-47d6-8063-6693527c1683","Type":"ContainerDied","Data":"7d793abc56cd4816234b32e1c9c3e4f1aca572a17074ec21b9db38133a3cbf7a"}
Jul 14 11:18:41.351169 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.351082    2581 scope.go:117] "RemoveContainer" containerID="72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b"
Jul 14 11:18:41.360796 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.360777    2581 scope.go:117] "RemoveContainer" containerID="72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b"
Jul 14 11:18:41.361053 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:18:41.361037    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b\": container with ID starting with 72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b not found: ID does not exist" containerID="72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b"
Jul 14 11:18:41.361161 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.361062    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b"} err="failed to get container status \"72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b\": rpc error: code = NotFound desc = could not find container \"72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b\": container with ID starting with 72416303a2eb207825ef57ff526546baacadee03beab12d1a35d03ecfa245d3b not found: ID does not exist"
Jul 14 11:18:41.432715 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.432689    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf8kh\" (UniqueName: \"kubernetes.io/projected/c4ad2f13-0072-47d6-8063-6693527c1683-kube-api-access-wf8kh\") pod \"c4ad2f13-0072-47d6-8063-6693527c1683\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") "
Jul 14 11:18:41.432828 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.432792    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4ad2f13-0072-47d6-8063-6693527c1683-tls-cert\") pod \"c4ad2f13-0072-47d6-8063-6693527c1683\" (UID: \"c4ad2f13-0072-47d6-8063-6693527c1683\") "
Jul 14 11:18:41.434753 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.434728    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ad2f13-0072-47d6-8063-6693527c1683-kube-api-access-wf8kh" (OuterVolumeSpecName: "kube-api-access-wf8kh") pod "c4ad2f13-0072-47d6-8063-6693527c1683" (UID: "c4ad2f13-0072-47d6-8063-6693527c1683"). InnerVolumeSpecName "kube-api-access-wf8kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:18:41.442564 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.442540    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4ad2f13-0072-47d6-8063-6693527c1683-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c4ad2f13-0072-47d6-8063-6693527c1683" (UID: "c4ad2f13-0072-47d6-8063-6693527c1683"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:18:41.534710 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.534682    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c4ad2f13-0072-47d6-8063-6693527c1683-tls-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:18:41.534710 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.534705    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf8kh\" (UniqueName: \"kubernetes.io/projected/c4ad2f13-0072-47d6-8063-6693527c1683-kube-api-access-wf8kh\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:18:41.699334 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.699303    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56dc8fb7cb-9jq45"]
Jul 14 11:18:41.712779 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:41.712752    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56dc8fb7cb-9jq45"]
Jul 14 11:18:42.052967 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:18:42.052936    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ad2f13-0072-47d6-8063-6693527c1683" path="/var/lib/kubelet/pods/c4ad2f13-0072-47d6-8063-6693527c1683/volumes"
Jul 14 11:19:54.155491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.155461    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5794fb4596-mm2w9"]
Jul 14 11:19:54.155942 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.155634    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5794fb4596-mm2w9" podUID="a35a5002-35de-4015-9c09-bb85a1e64147" containerName="manager" containerID="cri-o://f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca" gracePeriod=30
Jul 14 11:19:54.403064 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.403036    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:19:54.483387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.483308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqnlk\" (UniqueName: \"kubernetes.io/projected/a35a5002-35de-4015-9c09-bb85a1e64147-kube-api-access-wqnlk\") pod \"a35a5002-35de-4015-9c09-bb85a1e64147\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") "
Jul 14 11:19:54.483387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.483354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35a5002-35de-4015-9c09-bb85a1e64147-webhook-cert\") pod \"a35a5002-35de-4015-9c09-bb85a1e64147\" (UID: \"a35a5002-35de-4015-9c09-bb85a1e64147\") "
Jul 14 11:19:54.485391 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.485362    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a35a5002-35de-4015-9c09-bb85a1e64147-kube-api-access-wqnlk" (OuterVolumeSpecName: "kube-api-access-wqnlk") pod "a35a5002-35de-4015-9c09-bb85a1e64147" (UID: "a35a5002-35de-4015-9c09-bb85a1e64147"). InnerVolumeSpecName "kube-api-access-wqnlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:19:54.485498 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.485411    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a35a5002-35de-4015-9c09-bb85a1e64147-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a35a5002-35de-4015-9c09-bb85a1e64147" (UID: "a35a5002-35de-4015-9c09-bb85a1e64147"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 11:19:54.583932 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.583904    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqnlk\" (UniqueName: \"kubernetes.io/projected/a35a5002-35de-4015-9c09-bb85a1e64147-kube-api-access-wqnlk\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:19:54.583932 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.583929    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a35a5002-35de-4015-9c09-bb85a1e64147-webhook-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:19:54.684663 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.684622    2581 generic.go:356] "Generic (PLEG): container finished" podID="a35a5002-35de-4015-9c09-bb85a1e64147" containerID="f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca" exitCode=0
Jul 14 11:19:54.684827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.684697    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794fb4596-mm2w9"
Jul 14 11:19:54.684827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.684711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794fb4596-mm2w9" event={"ID":"a35a5002-35de-4015-9c09-bb85a1e64147","Type":"ContainerDied","Data":"f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca"}
Jul 14 11:19:54.684827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.684803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794fb4596-mm2w9" event={"ID":"a35a5002-35de-4015-9c09-bb85a1e64147","Type":"ContainerDied","Data":"671c47e2aa330307c0a522212080a3fc32d658efc912a9b9ad305960cc266ab2"}
Jul 14 11:19:54.684939 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.684832    2581 scope.go:117] "RemoveContainer" containerID="f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca"
Jul 14 11:19:54.693762 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.693745    2581 scope.go:117] "RemoveContainer" containerID="f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca"
Jul 14 11:19:54.693998 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:19:54.693982    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca\": container with ID starting with f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca not found: ID does not exist" containerID="f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca"
Jul 14 11:19:54.694070 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.694009    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca"} err="failed to get container status \"f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca\": rpc error: code = NotFound desc = could not find container \"f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca\": container with ID starting with f41ae8f77daed2f80d70ec7b5ddf5c2d931396a5cd7dc770727efe4615f0c2ca not found: ID does not exist"
Jul 14 11:19:54.706422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.706403    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5794fb4596-mm2w9"]
Jul 14 11:19:54.710522 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:54.710504    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5794fb4596-mm2w9"]
Jul 14 11:19:55.527859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.527830    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5794fb4596-lvfpk"]
Jul 14 11:19:55.528212 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.528200    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a35a5002-35de-4015-9c09-bb85a1e64147" containerName="manager"
Jul 14 11:19:55.528265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.528214    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a35a5002-35de-4015-9c09-bb85a1e64147" containerName="manager"
Jul 14 11:19:55.528265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.528241    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ad2f13-0072-47d6-8063-6693527c1683" containerName="authorino"
Jul 14 11:19:55.528265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.528246    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ad2f13-0072-47d6-8063-6693527c1683" containerName="authorino"
Jul 14 11:19:55.528370 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.528300    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ad2f13-0072-47d6-8063-6693527c1683" containerName="authorino"
Jul 14 11:19:55.528370 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.528307    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a35a5002-35de-4015-9c09-bb85a1e64147" containerName="manager"
Jul 14 11:19:55.531264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.531244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.533901 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.533880    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mg5nb\""
Jul 14 11:19:55.534362 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.534348    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 11:19:55.534977 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.534962    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 11:19:55.553633 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.553608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5794fb4596-lvfpk"]
Jul 14 11:19:55.591559 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.591531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64-webhook-cert\") pod \"maas-controller-5794fb4596-lvfpk\" (UID: \"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64\") " pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.591677 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.591636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h588n\" (UniqueName: \"kubernetes.io/projected/56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64-kube-api-access-h588n\") pod \"maas-controller-5794fb4596-lvfpk\" (UID: \"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64\") " pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.692207 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.692182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h588n\" (UniqueName: \"kubernetes.io/projected/56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64-kube-api-access-h588n\") pod \"maas-controller-5794fb4596-lvfpk\" (UID: \"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64\") " pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.692333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.692234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64-webhook-cert\") pod \"maas-controller-5794fb4596-lvfpk\" (UID: \"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64\") " pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.694489 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.694469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64-webhook-cert\") pod \"maas-controller-5794fb4596-lvfpk\" (UID: \"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64\") " pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.702878 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.702849    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h588n\" (UniqueName: \"kubernetes.io/projected/56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64-kube-api-access-h588n\") pod \"maas-controller-5794fb4596-lvfpk\" (UID: \"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64\") " pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.841081 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.841047    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:55.984195 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:19:55.984166    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ab2a02_57f7_4d1e_b8b0_d1d84f42ec64.slice/crio-776aecbe68b6045a9b95345e64246fe02d44b0458eda39978cfbab2a830b4bd9 WatchSource:0}: Error finding container 776aecbe68b6045a9b95345e64246fe02d44b0458eda39978cfbab2a830b4bd9: Status 404 returned error can't find the container with id 776aecbe68b6045a9b95345e64246fe02d44b0458eda39978cfbab2a830b4bd9
Jul 14 11:19:55.985604 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.985580    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 11:19:55.985947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:55.985908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5794fb4596-lvfpk"]
Jul 14 11:19:56.051641 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:56.051609    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a35a5002-35de-4015-9c09-bb85a1e64147" path="/var/lib/kubelet/pods/a35a5002-35de-4015-9c09-bb85a1e64147/volumes"
Jul 14 11:19:56.695373 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:56.695337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794fb4596-lvfpk" event={"ID":"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64","Type":"ContainerStarted","Data":"776aecbe68b6045a9b95345e64246fe02d44b0458eda39978cfbab2a830b4bd9"}
Jul 14 11:19:57.701609 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:57.701564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5794fb4596-lvfpk" event={"ID":"56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64","Type":"ContainerStarted","Data":"bccd6e5d936ce694fa0e82a485dabb47a0c19fed7c019a132a079675edfe41d8"}
Jul 14 11:19:57.701982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:57.701623    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:19:57.722342 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:19:57.722298    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5794fb4596-lvfpk" podStartSLOduration=2.008947591 podStartE2EDuration="2.72228499s" totalImagesPullingTime="713.337399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:19:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:19:57.72074696 +0000 UTC m=+784.173692851" watchObservedRunningTime="2026-07-14 11:19:57.72228499 +0000 UTC m=+784.175230928"
Jul 14 11:20:08.708261 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:20:08.708227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5794fb4596-lvfpk"
Jul 14 11:30:00.168761 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.168725    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d"]
Jul 14 11:30:00.171986 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.171969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d"
Jul 14 11:30:00.174509 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.174489    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:30:00.181812 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.181794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d"
Jul 14 11:30:00.191478 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.191457    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d"]
Jul 14 11:30:00.318891 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.318868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d"]
Jul 14 11:30:00.320828 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:30:00.320803    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11455530_3cb0_4e38_a1c2_9cc4f2761466.slice/crio-ce3e25b2212615104b6beb9fd8eb26a7b107452d2e560be097bc9f84132efd11 WatchSource:0}: Error finding container ce3e25b2212615104b6beb9fd8eb26a7b107452d2e560be097bc9f84132efd11: Status 404 returned error can't find the container with id ce3e25b2212615104b6beb9fd8eb26a7b107452d2e560be097bc9f84132efd11
Jul 14 11:30:00.322857 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.322836    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 11:30:00.508894 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:00.508811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d" event={"ID":"11455530-3cb0-4e38-a1c2-9cc4f2761466","Type":"ContainerStarted","Data":"ce3e25b2212615104b6beb9fd8eb26a7b107452d2e560be097bc9f84132efd11"}
Jul 14 11:30:03.526324 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:03.526286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d" event={"ID":"11455530-3cb0-4e38-a1c2-9cc4f2761466","Type":"ContainerStarted","Data":"7e56f00cc0bcc554f469b234a44c0e98b727de32f418b0f600cfd22df5fb5ad7"}
Jul 14 11:30:03.543828 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:03.543769    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d" podStartSLOduration=1.104486371 podStartE2EDuration="3.54375478s" totalImagesPullingTime="2.439268409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:30:03.54187235 +0000 UTC m=+1389.994818229" watchObservedRunningTime="2026-07-14 11:30:03.54375478 +0000 UTC m=+1389.996700658"
Jul 14 11:30:04.532560 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:04.532520    2581 generic.go:356] "Generic (PLEG): container finished" podID="11455530-3cb0-4e38-a1c2-9cc4f2761466" containerID="7e56f00cc0bcc554f469b234a44c0e98b727de32f418b0f600cfd22df5fb5ad7" exitCode=0
Jul 14 11:30:04.532967 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:04.532600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d" event={"ID":"11455530-3cb0-4e38-a1c2-9cc4f2761466","Type":"ContainerDied","Data":"7e56f00cc0bcc554f469b234a44c0e98b727de32f418b0f600cfd22df5fb5ad7"}
Jul 14 11:30:05.671500 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:05.671475    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d"
Jul 14 11:30:06.544989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:06.544911    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d"
Jul 14 11:30:06.544989 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:06.544950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-g6z9d" event={"ID":"11455530-3cb0-4e38-a1c2-9cc4f2761466","Type":"ContainerDied","Data":"ce3e25b2212615104b6beb9fd8eb26a7b107452d2e560be097bc9f84132efd11"}
Jul 14 11:30:06.545190 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:30:06.545002    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce3e25b2212615104b6beb9fd8eb26a7b107452d2e560be097bc9f84132efd11"
Jul 14 11:32:16.091820 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.091735    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"]
Jul 14 11:32:16.092399 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.092216    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11455530-3cb0-4e38-a1c2-9cc4f2761466" containerName="cleanup"
Jul 14 11:32:16.092399 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.092231    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11455530-3cb0-4e38-a1c2-9cc4f2761466" containerName="cleanup"
Jul 14 11:32:16.092399 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.092321    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11455530-3cb0-4e38-a1c2-9cc4f2761466" containerName="cleanup"
Jul 14 11:32:16.095459 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.095442    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.098744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.098721    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-02a04895-openshift-default-dockercfg-slw2m\""
Jul 14 11:32:16.098929 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.098910    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 11:32:16.119198 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.119177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"]
Jul 14 11:32:16.176396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-socket\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-credential-socket\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istiod-ca-cert\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv62c\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-kube-api-access-gv62c\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-envoy\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-token\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-podinfo\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-data\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.176751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.176652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-certs\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278214 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-socket\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278214 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-credential-socket\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istiod-ca-cert\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv62c\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-kube-api-access-gv62c\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-envoy\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278539 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-token\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278539 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-podinfo\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278539 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-data\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-certs\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-credential-socket\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.278964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-certs\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.279036 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.278969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-data\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.279079 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.279037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-socket\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.279079 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.279062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istiod-ca-cert\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.280632 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.280612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-envoy\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.280910 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.280891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-podinfo\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.286855 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.286834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-token\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.287246 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.287229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv62c\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-kube-api-access-gv62c\") pod \"e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") " pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.406325 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.406239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:16.547854 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:16.547821    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"]
Jul 14 11:32:16.549170 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:32:16.549128    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8646c1df_9d95_4a4b_bf9a_f58b4a7a7bda.slice/crio-40bde00a12209274a69600edbb855d65f9a68a413da22eac861ba186ffda0bdb WatchSource:0}: Error finding container 40bde00a12209274a69600edbb855d65f9a68a413da22eac861ba186ffda0bdb: Status 404 returned error can't find the container with id 40bde00a12209274a69600edbb855d65f9a68a413da22eac861ba186ffda0bdb
Jul 14 11:32:17.198852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:17.198818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" event={"ID":"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda","Type":"ContainerStarted","Data":"40bde00a12209274a69600edbb855d65f9a68a413da22eac861ba186ffda0bdb"}
Jul 14 11:32:19.309090 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:19.309049    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:32:19.309443 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:19.309128    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:32:19.309443 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:19.309176    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:32:20.216262 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:20.216228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" event={"ID":"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda","Type":"ContainerStarted","Data":"ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a"}
Jul 14 11:32:20.237913 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:20.237858    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" podStartSLOduration=1.480628796 podStartE2EDuration="4.237844444s" totalImagesPullingTime="2.757215648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:32:20.237814991 +0000 UTC m=+1526.690760868" watchObservedRunningTime="2026-07-14 11:32:20.237844444 +0000 UTC m=+1526.690790321"
Jul 14 11:32:20.406712 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:20.406672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:20.411213 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:20.411190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:21.221067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:21.221036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:21.221903 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:21.221883    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:22.348683 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.348650    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"]
Jul 14 11:32:22.352439 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.352422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"
Jul 14 11:32:22.355251 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.355226    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:32:22.355371 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.355276    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:32:22.362198 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.362166    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"]
Jul 14 11:32:22.438128 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.438087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b92a26-9462-433f-b4f5-289f06860221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02a04895-pf5dg\" (UID: \"87b92a26-9462-433f-b4f5-289f06860221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"
Jul 14 11:32:22.539055 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.539023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b92a26-9462-433f-b4f5-289f06860221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02a04895-pf5dg\" (UID: \"87b92a26-9462-433f-b4f5-289f06860221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"
Jul 14 11:32:22.539681 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.539651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b92a26-9462-433f-b4f5-289f06860221-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02a04895-pf5dg\" (UID: \"87b92a26-9462-433f-b4f5-289f06860221\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"
Jul 14 11:32:22.663952 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.663872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"
Jul 14 11:32:22.799921 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:22.799900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"]
Jul 14 11:32:22.802507 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:32:22.802483    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b92a26_9462_433f_b4f5_289f06860221.slice/crio-543b6127c097c9019308d492d7679f8647f6ceae42056daeb0fc15ce44da2fe1 WatchSource:0}: Error finding container 543b6127c097c9019308d492d7679f8647f6ceae42056daeb0fc15ce44da2fe1: Status 404 returned error can't find the container with id 543b6127c097c9019308d492d7679f8647f6ceae42056daeb0fc15ce44da2fe1
Jul 14 11:32:23.230951 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:23.230920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" event={"ID":"87b92a26-9462-433f-b4f5-289f06860221","Type":"ContainerStarted","Data":"82588436bd5aa456f6d1b5f1b5c061ab934045d3b8bc2eda1216af052bc4e6b7"}
Jul 14 11:32:23.231132 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:23.230970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" event={"ID":"87b92a26-9462-433f-b4f5-289f06860221","Type":"ContainerStarted","Data":"543b6127c097c9019308d492d7679f8647f6ceae42056daeb0fc15ce44da2fe1"}
Jul 14 11:32:23.251991 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:23.251935    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" podStartSLOduration=1.2519211590000001 podStartE2EDuration="1.251921159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:32:23.250312571 +0000 UTC m=+1529.703258462" watchObservedRunningTime="2026-07-14 11:32:23.251921159 +0000 UTC m=+1529.704867036"
Jul 14 11:32:24.236633 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:24.236598    2581 generic.go:356] "Generic (PLEG): container finished" podID="87b92a26-9462-433f-b4f5-289f06860221" containerID="82588436bd5aa456f6d1b5f1b5c061ab934045d3b8bc2eda1216af052bc4e6b7" exitCode=7
Jul 14 11:32:24.237101 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:24.236675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" event={"ID":"87b92a26-9462-433f-b4f5-289f06860221","Type":"ContainerDied","Data":"82588436bd5aa456f6d1b5f1b5c061ab934045d3b8bc2eda1216af052bc4e6b7"}
Jul 14 11:32:24.237101 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:24.236860    2581 scope.go:117] "RemoveContainer" containerID="82588436bd5aa456f6d1b5f1b5c061ab934045d3b8bc2eda1216af052bc4e6b7"
Jul 14 11:32:25.243795 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:25.243706    2581 generic.go:356] "Generic (PLEG): container finished" podID="87b92a26-9462-433f-b4f5-289f06860221" containerID="fe4194f6214a00e685163d964b339c2fc939c71ce4984408296cbcd3eed9d9ff" exitCode=7
Jul 14 11:32:25.243795 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:25.243759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" event={"ID":"87b92a26-9462-433f-b4f5-289f06860221","Type":"ContainerDied","Data":"fe4194f6214a00e685163d964b339c2fc939c71ce4984408296cbcd3eed9d9ff"}
Jul 14 11:32:25.244272 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:25.243829    2581 scope.go:117] "RemoveContainer" containerID="82588436bd5aa456f6d1b5f1b5c061ab934045d3b8bc2eda1216af052bc4e6b7"
Jul 14 11:32:25.244272 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:25.243990    2581 scope.go:117] "RemoveContainer" containerID="fe4194f6214a00e685163d964b339c2fc939c71ce4984408296cbcd3eed9d9ff"
Jul 14 11:32:25.244272 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:32:25.244243    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02a04895-pf5dg_odh-ai-gateway-infra(87b92a26-9462-433f-b4f5-289f06860221)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" podUID="87b92a26-9462-433f-b4f5-289f06860221"
Jul 14 11:32:26.254293 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:26.254261    2581 scope.go:117] "RemoveContainer" containerID="fe4194f6214a00e685163d964b339c2fc939c71ce4984408296cbcd3eed9d9ff"
Jul 14 11:32:26.254801 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:32:26.254548    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02a04895-pf5dg_odh-ai-gateway-infra(87b92a26-9462-433f-b4f5-289f06860221)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" podUID="87b92a26-9462-433f-b4f5-289f06860221"
Jul 14 11:32:33.292625 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:33.292593    2581 generic.go:356] "Generic (PLEG): container finished" podID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerID="ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a" exitCode=0
Jul 14 11:32:33.293129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:33.292666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" event={"ID":"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda","Type":"ContainerDied","Data":"ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a"}
Jul 14 11:32:33.293129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:33.293037    2581 scope.go:117] "RemoveContainer" containerID="ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a"
Jul 14 11:32:33.294120 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:33.294082    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:32:33.294202 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:33.294171    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:32:33.294244 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:33.294214    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:32:34.298991 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:34.298954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" event={"ID":"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda","Type":"ContainerStarted","Data":"e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6"}
Jul 14 11:32:34.407422 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:34.407389    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:34.408340 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:34.408313    2581 patch_prober.go:28] interesting pod/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 14 11:32:34.408450 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:34.408371    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 14 11:32:35.407507 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:35.407472    2581 patch_prober.go:28] interesting pod/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 14 11:32:35.407926 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:35.407541    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 14 11:32:36.221696 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:36.221663    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:36.406712 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:36.406673    2581 patch_prober.go:28] interesting pod/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 14 11:32:36.406892 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:36.406732    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 14 11:32:37.407369 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:37.407333    2581 patch_prober.go:28] interesting pod/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 14 11:32:37.407791 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:37.407389    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 14 11:32:38.410906 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:38.410876    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:38.411860 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:38.411839    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:32:39.046265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:39.046221    2581 scope.go:117] "RemoveContainer" containerID="fe4194f6214a00e685163d964b339c2fc939c71ce4984408296cbcd3eed9d9ff"
Jul 14 11:32:39.325099 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:39.325064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" event={"ID":"87b92a26-9462-433f-b4f5-289f06860221","Type":"ContainerStarted","Data":"b80d3d440164ca458830c89432a5dc20a8d2fff21dc174336550ca899b83652d"}
Jul 14 11:32:40.331495 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:40.331464    2581 generic.go:356] "Generic (PLEG): container finished" podID="87b92a26-9462-433f-b4f5-289f06860221" containerID="b80d3d440164ca458830c89432a5dc20a8d2fff21dc174336550ca899b83652d" exitCode=0
Jul 14 11:32:40.331979 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:40.331544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" event={"ID":"87b92a26-9462-433f-b4f5-289f06860221","Type":"ContainerDied","Data":"b80d3d440164ca458830c89432a5dc20a8d2fff21dc174336550ca899b83652d"}
Jul 14 11:32:40.331979 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:40.331618    2581 scope.go:117] "RemoveContainer" containerID="fe4194f6214a00e685163d964b339c2fc939c71ce4984408296cbcd3eed9d9ff"
Jul 14 11:32:40.387724 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:40.387695    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"]
Jul 14 11:32:41.476747 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:41.476722    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"
Jul 14 11:32:41.624732 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:41.624628    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b92a26-9462-433f-b4f5-289f06860221-maas-api-service-ca\") pod \"87b92a26-9462-433f-b4f5-289f06860221\" (UID: \"87b92a26-9462-433f-b4f5-289f06860221\") "
Jul 14 11:32:41.625051 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:41.625026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87b92a26-9462-433f-b4f5-289f06860221-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87b92a26-9462-433f-b4f5-289f06860221" (UID: "87b92a26-9462-433f-b4f5-289f06860221"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:32:41.726015 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:41.725977    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87b92a26-9462-433f-b4f5-289f06860221-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:32:42.347580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:42.347493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg" event={"ID":"87b92a26-9462-433f-b4f5-289f06860221","Type":"ContainerDied","Data":"543b6127c097c9019308d492d7679f8647f6ceae42056daeb0fc15ce44da2fe1"}
Jul 14 11:32:42.347580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:42.347545    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="543b6127c097c9019308d492d7679f8647f6ceae42056daeb0fc15ce44da2fe1"
Jul 14 11:32:42.347580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:42.347506    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"
Jul 14 11:32:42.391628 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:42.391602    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"]
Jul 14 11:32:42.399586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:42.399554    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-pf5dg"]
Jul 14 11:32:44.052188 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:32:44.052130    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87b92a26-9462-433f-b4f5-289f06860221" path="/var/lib/kubelet/pods/87b92a26-9462-433f-b4f5-289f06860221/volumes"
Jul 14 11:33:22.413458 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413417    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"]
Jul 14 11:33:22.413940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413873    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.413940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413886    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.413940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413893    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.413940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413901    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.413940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413911    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.413940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413920    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.414128 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413987    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.414128 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.413997    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:22.416219 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.416201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"
Jul 14 11:33:22.419189 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.419173    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:33:22.419499 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.419486    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:33:22.436340 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.436312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"]
Jul 14 11:33:22.514976 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.514940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b40c483-af6d-476b-9b59-aecf3e5886db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02a04895-kxf2t\" (UID: \"4b40c483-af6d-476b-9b59-aecf3e5886db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"
Jul 14 11:33:22.616075 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.616036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b40c483-af6d-476b-9b59-aecf3e5886db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02a04895-kxf2t\" (UID: \"4b40c483-af6d-476b-9b59-aecf3e5886db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"
Jul 14 11:33:22.616757 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.616732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b40c483-af6d-476b-9b59-aecf3e5886db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02a04895-kxf2t\" (UID: \"4b40c483-af6d-476b-9b59-aecf3e5886db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"
Jul 14 11:33:22.726309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.726216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"
Jul 14 11:33:22.868466 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:22.868437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"]
Jul 14 11:33:22.869099 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:33:22.869077    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b40c483_af6d_476b_9b59_aecf3e5886db.slice/crio-4ad494142009156adda319fb69e76a4aad129fceaad202278d7f87ece0dd3402 WatchSource:0}: Error finding container 4ad494142009156adda319fb69e76a4aad129fceaad202278d7f87ece0dd3402: Status 404 returned error can't find the container with id 4ad494142009156adda319fb69e76a4aad129fceaad202278d7f87ece0dd3402
Jul 14 11:33:23.552841 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:23.552812    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b40c483-af6d-476b-9b59-aecf3e5886db" containerID="cef97bd23fbea596f0d7d9e7ec1284f271fdc76d2cd5447c579976d9a109b503" exitCode=0
Jul 14 11:33:23.553135 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:23.552878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t" event={"ID":"4b40c483-af6d-476b-9b59-aecf3e5886db","Type":"ContainerDied","Data":"cef97bd23fbea596f0d7d9e7ec1284f271fdc76d2cd5447c579976d9a109b503"}
Jul 14 11:33:23.553135 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:23.552916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t" event={"ID":"4b40c483-af6d-476b-9b59-aecf3e5886db","Type":"ContainerStarted","Data":"4ad494142009156adda319fb69e76a4aad129fceaad202278d7f87ece0dd3402"}
Jul 14 11:33:24.689717 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:24.689691    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"
Jul 14 11:33:24.735700 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:24.735672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b40c483-af6d-476b-9b59-aecf3e5886db-maas-api-service-ca\") pod \"4b40c483-af6d-476b-9b59-aecf3e5886db\" (UID: \"4b40c483-af6d-476b-9b59-aecf3e5886db\") "
Jul 14 11:33:24.736024 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:24.736003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b40c483-af6d-476b-9b59-aecf3e5886db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b40c483-af6d-476b-9b59-aecf3e5886db" (UID: "4b40c483-af6d-476b-9b59-aecf3e5886db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:33:24.837500 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:24.837427    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b40c483-af6d-476b-9b59-aecf3e5886db-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:25.564552 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:25.564511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t" event={"ID":"4b40c483-af6d-476b-9b59-aecf3e5886db","Type":"ContainerDied","Data":"4ad494142009156adda319fb69e76a4aad129fceaad202278d7f87ece0dd3402"}
Jul 14 11:33:25.564552 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:25.564552    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02a04895-kxf2t"
Jul 14 11:33:25.564762 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:25.564575    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ad494142009156adda319fb69e76a4aad129fceaad202278d7f87ece0dd3402"
Jul 14 11:33:47.753537 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:47.753459    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"]
Jul 14 11:33:47.754001 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:47.753658    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy" containerID="cri-o://e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6" gracePeriod=30
Jul 14 11:33:48.345823 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.345791    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"]
Jul 14 11:33:48.346227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.346213    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b40c483-af6d-476b-9b59-aecf3e5886db" containerName="revoke-keys"
Jul 14 11:33:48.346227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.346228    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b40c483-af6d-476b-9b59-aecf3e5886db" containerName="revoke-keys"
Jul 14 11:33:48.346402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.346326    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b40c483-af6d-476b-9b59-aecf3e5886db" containerName="revoke-keys"
Jul 14 11:33:48.346402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.346340    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="87b92a26-9462-433f-b4f5-289f06860221" containerName="revoke-keys"
Jul 14 11:33:48.348477 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.348452    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.354162 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.354132    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c50a5e30-gw-openshift-default-dockercfg-z77fp\""
Jul 14 11:33:48.371175 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.371133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"]
Jul 14 11:33:48.446161 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knnpm\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-kube-api-access-knnpm\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istiod-ca-cert\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-certs\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446257    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-credential-socket\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-data\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446504 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446380    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-socket\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446504 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-envoy\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446504 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-podinfo\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.446620 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.446515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-token\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.547547 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-podinfo\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.547748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-token\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.547748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knnpm\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-kube-api-access-knnpm\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.547748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istiod-ca-cert\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.547748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-certs\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.547748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-credential-socket\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.547748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-data\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.548067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-socket\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.548067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.547846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-envoy\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.548209 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.548090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-certs\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.548209 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.548191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-credential-socket\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.548318 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.548261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-socket\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.548420 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.548396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-data\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.548603 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.548583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istiod-ca-cert\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.550049 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.550028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-envoy\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.550162 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.550134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-podinfo\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.556687 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.556660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-token\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.556802 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.556788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knnpm\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-kube-api-access-knnpm\") pod \"e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") " pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.659136 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.659038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:48.795113 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.795086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"]
Jul 14 11:33:48.796803 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:33:48.796776    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbbf4c3_a64b_4c7d_8648_275bb7dd9ddf.slice/crio-65ac16dc39addfc005102b52f410fd0a6952cef92e75863fa309e4052897c833 WatchSource:0}: Error finding container 65ac16dc39addfc005102b52f410fd0a6952cef92e75863fa309e4052897c833: Status 404 returned error can't find the container with id 65ac16dc39addfc005102b52f410fd0a6952cef92e75863fa309e4052897c833
Jul 14 11:33:48.799032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.798987    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:33:48.799101 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.799080    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:33:48.799162 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:48.799125    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:33:49.691135 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:49.691102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" event={"ID":"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf","Type":"ContainerStarted","Data":"9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0"}
Jul 14 11:33:49.691347 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:49.691187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" event={"ID":"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf","Type":"ContainerStarted","Data":"65ac16dc39addfc005102b52f410fd0a6952cef92e75863fa309e4052897c833"}
Jul 14 11:33:49.719901 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:49.719855    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" podStartSLOduration=1.7198399659999999 podStartE2EDuration="1.719839966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:33:49.718571402 +0000 UTC m=+1616.171517293" watchObservedRunningTime="2026-07-14 11:33:49.719839966 +0000 UTC m=+1616.172785844"
Jul 14 11:33:50.660106 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:50.660070    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:50.665168 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:50.665124    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:50.696307 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:50.696273    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:50.697072 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:50.697052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:33:53.009872 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.009849    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:33:53.192050 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192015    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-credential-socket\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192050 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192054    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-envoy\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192087    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-data\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192123    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-podinfo\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-certs\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-token\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192439 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192307    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istiod-ca-cert\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192439 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192322    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:33:53.192439 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192346    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-socket\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192439 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv62c\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-kube-api-access-gv62c\") pod \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\" (UID: \"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda\") "
Jul 14 11:33:53.192644 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192461    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:33:53.192699 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192636    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:33:53.192699 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192668    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:33:53.192784 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192767    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.192839 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192785    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.192839 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192798    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.192839 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.192811    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.193067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.193040    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-data" (OuterVolumeSpecName: "istio-data") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:33:53.194514 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.194487    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:33:53.194607 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.194573    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:33:53.194724 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.194702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-token" (OuterVolumeSpecName: "istio-token") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:33:53.194782 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.194710    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-kube-api-access-gv62c" (OuterVolumeSpecName: "kube-api-access-gv62c") pod "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" (UID: "8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda"). InnerVolumeSpecName "kube-api-access-gv62c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:33:53.293973 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.293946    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv62c\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-kube-api-access-gv62c\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.293973 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.293970    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.293973 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.293980    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.294196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.293988    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.294196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.293996    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:33:53.711834 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.711800    2581 generic.go:356] "Generic (PLEG): container finished" podID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerID="e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6" exitCode=0
Jul 14 11:33:53.712031 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.711852    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"
Jul 14 11:33:53.712031 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.711878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" event={"ID":"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda","Type":"ContainerDied","Data":"e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6"}
Jul 14 11:33:53.712031 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.711927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t" event={"ID":"8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda","Type":"ContainerDied","Data":"40bde00a12209274a69600edbb855d65f9a68a413da22eac861ba186ffda0bdb"}
Jul 14 11:33:53.712031 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.711954    2581 scope.go:117] "RemoveContainer" containerID="e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6"
Jul 14 11:33:53.721199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.721179    2581 scope.go:117] "RemoveContainer" containerID="ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a"
Jul 14 11:33:53.731045 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.731027    2581 scope.go:117] "RemoveContainer" containerID="e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6"
Jul 14 11:33:53.731330 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:33:53.731312    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6\": container with ID starting with e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6 not found: ID does not exist" containerID="e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6"
Jul 14 11:33:53.731395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.731337    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6"} err="failed to get container status \"e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6\": rpc error: code = NotFound desc = could not find container \"e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6\": container with ID starting with e597543962ab920390d6c1a27965f223e1be92257caaf1854eb26c17d349fdf6 not found: ID does not exist"
Jul 14 11:33:53.731395 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.731355    2581 scope.go:117] "RemoveContainer" containerID="ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a"
Jul 14 11:33:53.731542 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:33:53.731527    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a\": container with ID starting with ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a not found: ID does not exist" containerID="ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a"
Jul 14 11:33:53.731583 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.731545    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a"} err="failed to get container status \"ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a\": rpc error: code = NotFound desc = could not find container \"ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a\": container with ID starting with ee7eccb4adae9e80d94dd804f9a59f3e6d5af339a1f2286fac95bc46dfd3749a not found: ID does not exist"
Jul 14 11:33:53.737080 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.737059    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"]
Jul 14 11:33:53.741131 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:53.741114    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-02a04895-openshift-default-86cdf67bc7-4lw2t"]
Jul 14 11:33:54.052024 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.051994    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" path="/var/lib/kubelet/pods/8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda/volumes"
Jul 14 11:33:54.153350 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.153306    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"]
Jul 14 11:33:54.153735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.153718    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy"
Jul 14 11:33:54.153735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.153735    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy"
Jul 14 11:33:54.153836 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.153758    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy"
Jul 14 11:33:54.153836 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.153764    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy"
Jul 14 11:33:54.153903 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.153844    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy"
Jul 14 11:33:54.153903 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.153854    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8646c1df-9d95-4a4b-bf9a-f58b4a7a7bda" containerName="istio-proxy"
Jul 14 11:33:54.158692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.158674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"
Jul 14 11:33:54.161272 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.161247    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:33:54.161368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.161271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:33:54.165061 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.165038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"]
Jul 14 11:33:54.304481 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.304391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9e6cfd-243f-42f6-879b-cb70c0f0aab4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn\" (UID: \"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"
Jul 14 11:33:54.405444 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.405378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9e6cfd-243f-42f6-879b-cb70c0f0aab4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn\" (UID: \"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"
Jul 14 11:33:54.406331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.406299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9e6cfd-243f-42f6-879b-cb70c0f0aab4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn\" (UID: \"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"
Jul 14 11:33:54.470163 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.470115    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"
Jul 14 11:33:54.809872 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:54.809846    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"]
Jul 14 11:33:54.811890 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:33:54.811862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9e6cfd_243f_42f6_879b_cb70c0f0aab4.slice/crio-650e16c2ba570ae223931510300dcb86ccd44aad48fb68eabe4f8c6a9c691897 WatchSource:0}: Error finding container 650e16c2ba570ae223931510300dcb86ccd44aad48fb68eabe4f8c6a9c691897: Status 404 returned error can't find the container with id 650e16c2ba570ae223931510300dcb86ccd44aad48fb68eabe4f8c6a9c691897
Jul 14 11:33:55.571686 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:33:55.571659    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9e6cfd_243f_42f6_879b_cb70c0f0aab4.slice/crio-748b51b54da560eed2329b7a559e58be35c3f9e5be53b55aa51d1a8bf6b9042a.scope\": RecentStats: unable to find data in memory cache]"
Jul 14 11:33:55.723439 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:55.723408    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerID="748b51b54da560eed2329b7a559e58be35c3f9e5be53b55aa51d1a8bf6b9042a" exitCode=7
Jul 14 11:33:55.723605 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:55.723487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn" event={"ID":"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4","Type":"ContainerDied","Data":"748b51b54da560eed2329b7a559e58be35c3f9e5be53b55aa51d1a8bf6b9042a"}
Jul 14 11:33:55.723605 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:55.723535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn" event={"ID":"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4","Type":"ContainerStarted","Data":"650e16c2ba570ae223931510300dcb86ccd44aad48fb68eabe4f8c6a9c691897"}
Jul 14 11:33:55.723679 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:55.723636    2581 scope.go:117] "RemoveContainer" containerID="748b51b54da560eed2329b7a559e58be35c3f9e5be53b55aa51d1a8bf6b9042a"
Jul 14 11:33:56.729846 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:56.729755    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerID="2035aef28d0cb8d11ed045b1fcb7a4bbd44db478a858dde6acebe9695e48baa0" exitCode=7
Jul 14 11:33:56.730291 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:56.729839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn" event={"ID":"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4","Type":"ContainerDied","Data":"2035aef28d0cb8d11ed045b1fcb7a4bbd44db478a858dde6acebe9695e48baa0"}
Jul 14 11:33:56.730291 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:56.729909    2581 scope.go:117] "RemoveContainer" containerID="748b51b54da560eed2329b7a559e58be35c3f9e5be53b55aa51d1a8bf6b9042a"
Jul 14 11:33:56.730291 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:56.730002    2581 scope.go:117] "RemoveContainer" containerID="2035aef28d0cb8d11ed045b1fcb7a4bbd44db478a858dde6acebe9695e48baa0"
Jul 14 11:33:56.730291 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:33:56.730221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn_odh-ai-gateway-infra(0a9e6cfd-243f-42f6-879b-cb70c0f0aab4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4"
Jul 14 11:33:57.743697 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:33:57.743670    2581 scope.go:117] "RemoveContainer" containerID="2035aef28d0cb8d11ed045b1fcb7a4bbd44db478a858dde6acebe9695e48baa0"
Jul 14 11:33:57.744590 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:33:57.744563    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn_odh-ai-gateway-infra(0a9e6cfd-243f-42f6-879b-cb70c0f0aab4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4"
Jul 14 11:34:04.787050 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:04.787018    2581 generic.go:356] "Generic (PLEG): container finished" podID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerID="9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0" exitCode=0
Jul 14 11:34:04.787454 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:04.787099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" event={"ID":"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf","Type":"ContainerDied","Data":"9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0"}
Jul 14 11:34:04.787515 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:04.787500    2581 scope.go:117] "RemoveContainer" containerID="9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0"
Jul 14 11:34:04.788537 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:04.788510    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:34:04.788598 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:04.788578    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:34:04.788640 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:04.788608    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:34:05.696503 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:05.696451    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:34:05.793718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:05.793679    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" event={"ID":"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf","Type":"ContainerStarted","Data":"e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826"}
Jul 14 11:34:06.659424 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:06.659384    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:34:06.660396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:06.660370    2581 patch_prober.go:28] interesting pod/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 14 11:34:06.660503 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:06.660427    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 14 11:34:07.660199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:07.660140    2581 patch_prober.go:28] interesting pod/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 14 11:34:07.660598 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:07.660233    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 14 11:34:08.660087 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:08.660051    2581 patch_prober.go:28] interesting pod/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 14 11:34:08.660260 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:08.660117    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 14 11:34:09.663862 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:09.663833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:34:09.664329 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:09.664096    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:34:09.664755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:09.664738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:34:10.046525 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:10.046445    2581 scope.go:117] "RemoveContainer" containerID="2035aef28d0cb8d11ed045b1fcb7a4bbd44db478a858dde6acebe9695e48baa0"
Jul 14 11:34:10.820349 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:10.820316    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerID="2529e37f063aa322d76fa34ad45270240b6d2bc41e44e7cf7c2c219de0673323" exitCode=0
Jul 14 11:34:10.820701 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:10.820391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn" event={"ID":"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4","Type":"ContainerDied","Data":"2529e37f063aa322d76fa34ad45270240b6d2bc41e44e7cf7c2c219de0673323"}
Jul 14 11:34:10.820701 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:10.820448    2581 scope.go:117] "RemoveContainer" containerID="2035aef28d0cb8d11ed045b1fcb7a4bbd44db478a858dde6acebe9695e48baa0"
Jul 14 11:34:11.850289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:11.850258    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"]
Jul 14 11:34:11.962048 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:11.962022    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"
Jul 14 11:34:12.083652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.083584    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9e6cfd-243f-42f6-879b-cb70c0f0aab4-maas-api-service-ca\") pod \"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4\" (UID: \"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4\") "
Jul 14 11:34:12.083905 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.083884    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9e6cfd-243f-42f6-879b-cb70c0f0aab4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" (UID: "0a9e6cfd-243f-42f6-879b-cb70c0f0aab4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:34:12.185071 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.185044    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9e6cfd-243f-42f6-879b-cb70c0f0aab4-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:12.835762 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.835735    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"
Jul 14 11:34:12.835937 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.835734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn" event={"ID":"0a9e6cfd-243f-42f6-879b-cb70c0f0aab4","Type":"ContainerDied","Data":"650e16c2ba570ae223931510300dcb86ccd44aad48fb68eabe4f8c6a9c691897"}
Jul 14 11:34:12.835937 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.835863    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="650e16c2ba570ae223931510300dcb86ccd44aad48fb68eabe4f8c6a9c691897"
Jul 14 11:34:12.922363 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.922335    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"]
Jul 14 11:34:12.929500 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:12.929477    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-mmhpn"]
Jul 14 11:34:14.051972 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:14.051940    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" path="/var/lib/kubelet/pods/0a9e6cfd-243f-42f6-879b-cb70c0f0aab4/volumes"
Jul 14 11:34:44.191196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.191134    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"]
Jul 14 11:34:44.192359 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192330    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.192359 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192360    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.192513 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192394    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.192513 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192402    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.192513 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192420    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.192513 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192428    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.192645 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192522    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.192645 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.192532    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:34:44.195988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.195972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"
Jul 14 11:34:44.198528 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.198499    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:34:44.198867 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.198848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:34:44.199869 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.199841    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"]
Jul 14 11:34:44.280054 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.280014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63236df9-8832-4801-a35b-c31431ced58c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld\" (UID: \"63236df9-8832-4801-a35b-c31431ced58c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"
Jul 14 11:34:44.380673 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.380647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63236df9-8832-4801-a35b-c31431ced58c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld\" (UID: \"63236df9-8832-4801-a35b-c31431ced58c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"
Jul 14 11:34:44.381367 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.381342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63236df9-8832-4801-a35b-c31431ced58c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld\" (UID: \"63236df9-8832-4801-a35b-c31431ced58c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"
Jul 14 11:34:44.508487 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.508405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"
Jul 14 11:34:44.645983 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.645951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"]
Jul 14 11:34:44.649101 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:34:44.649072    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63236df9_8832_4801_a35b_c31431ced58c.slice/crio-4bf16e9a461a01cdc4386669aa3fea21c7917e1a6af8165908a26d53a9ddb370 WatchSource:0}: Error finding container 4bf16e9a461a01cdc4386669aa3fea21c7917e1a6af8165908a26d53a9ddb370: Status 404 returned error can't find the container with id 4bf16e9a461a01cdc4386669aa3fea21c7917e1a6af8165908a26d53a9ddb370
Jul 14 11:34:44.990536 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.990506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld" event={"ID":"63236df9-8832-4801-a35b-c31431ced58c","Type":"ContainerStarted","Data":"89b5e09e70df51a43d6b3aa92ab7ce88c9df33f6f2e82f1f7a26624c13f04c4a"}
Jul 14 11:34:44.990692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:44.990567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld" event={"ID":"63236df9-8832-4801-a35b-c31431ced58c","Type":"ContainerStarted","Data":"4bf16e9a461a01cdc4386669aa3fea21c7917e1a6af8165908a26d53a9ddb370"}
Jul 14 11:34:45.008021 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:45.007975    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld" podStartSLOduration=1.00795931 podStartE2EDuration="1.00795931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:34:45.005960839 +0000 UTC m=+1671.458906718" watchObservedRunningTime="2026-07-14 11:34:45.00795931 +0000 UTC m=+1671.460905188"
Jul 14 11:34:45.996670 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:45.996633    2581 generic.go:356] "Generic (PLEG): container finished" podID="63236df9-8832-4801-a35b-c31431ced58c" containerID="89b5e09e70df51a43d6b3aa92ab7ce88c9df33f6f2e82f1f7a26624c13f04c4a" exitCode=0
Jul 14 11:34:45.997065 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:45.996715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld" event={"ID":"63236df9-8832-4801-a35b-c31431ced58c","Type":"ContainerDied","Data":"89b5e09e70df51a43d6b3aa92ab7ce88c9df33f6f2e82f1f7a26624c13f04c4a"}
Jul 14 11:34:47.134129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:47.134107    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"
Jul 14 11:34:47.209237 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:47.209204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63236df9-8832-4801-a35b-c31431ced58c-maas-api-service-ca\") pod \"63236df9-8832-4801-a35b-c31431ced58c\" (UID: \"63236df9-8832-4801-a35b-c31431ced58c\") "
Jul 14 11:34:47.209567 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:47.209541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63236df9-8832-4801-a35b-c31431ced58c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63236df9-8832-4801-a35b-c31431ced58c" (UID: "63236df9-8832-4801-a35b-c31431ced58c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:34:47.309913 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:47.309887    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63236df9-8832-4801-a35b-c31431ced58c-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:48.007881 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:48.007847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld" event={"ID":"63236df9-8832-4801-a35b-c31431ced58c","Type":"ContainerDied","Data":"4bf16e9a461a01cdc4386669aa3fea21c7917e1a6af8165908a26d53a9ddb370"}
Jul 14 11:34:48.007881 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:48.007866    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld"
Jul 14 11:34:48.008090 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:48.007900    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bf16e9a461a01cdc4386669aa3fea21c7917e1a6af8165908a26d53a9ddb370"
Jul 14 11:34:54.283919 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:54.283883    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"]
Jul 14 11:34:54.284341 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:54.284094    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy" containerID="cri-o://e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826" gracePeriod=30
Jul 14 11:34:54.666356 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:54.666317    2581 patch_prober.go:28] interesting pod/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 14 11:34:54.666520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:54.666380    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 11:34:59.537949 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.537925    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:34:59.625978 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.625951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-podinfo\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626109 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626020    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-token\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626109 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626059    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-socket\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626127    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-data\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626240    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istiod-ca-cert\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626371 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-envoy\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626371 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-certs\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626371 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626347    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knnpm\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-kube-api-access-knnpm\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626514 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626398    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-credential-socket\") pod \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\" (UID: \"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf\") "
Jul 14 11:34:59.626514 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:34:59.626831 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626662    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:34:59.626831 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626757    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.626831 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626776    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.627058 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:34:59.627058 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.626899    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:34:59.627058 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.627012    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-data" (OuterVolumeSpecName: "istio-data") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:34:59.628333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.628305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-token" (OuterVolumeSpecName: "istio-token") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:34:59.628333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.628315    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:34:59.628637 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.628617    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:34:59.628931 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.628914    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-kube-api-access-knnpm" (OuterVolumeSpecName: "kube-api-access-knnpm") pod "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" (UID: "8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf"). InnerVolumeSpecName "kube-api-access-knnpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:34:59.727602 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.727566    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.727602 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.727597    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.727602 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.727606    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.727819 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.727614    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knnpm\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-kube-api-access-knnpm\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.727819 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.727625    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.727819 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.727633    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:34:59.727819 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:34:59.727641    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:00.068525 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.068491    2581 generic.go:356] "Generic (PLEG): container finished" podID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerID="e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826" exitCode=0
Jul 14 11:35:00.068694 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.068548    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"
Jul 14 11:35:00.068694 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.068655    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" event={"ID":"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf","Type":"ContainerDied","Data":"e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826"}
Jul 14 11:35:00.068816 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.068703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv" event={"ID":"8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf","Type":"ContainerDied","Data":"65ac16dc39addfc005102b52f410fd0a6952cef92e75863fa309e4052897c833"}
Jul 14 11:35:00.068816 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.068739    2581 scope.go:117] "RemoveContainer" containerID="e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826"
Jul 14 11:35:00.078460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.078441    2581 scope.go:117] "RemoveContainer" containerID="9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0"
Jul 14 11:35:00.086554 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.086530    2581 scope.go:117] "RemoveContainer" containerID="e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826"
Jul 14 11:35:00.086822 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:35:00.086802    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826\": container with ID starting with e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826 not found: ID does not exist" containerID="e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826"
Jul 14 11:35:00.086899 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.086833    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826"} err="failed to get container status \"e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826\": rpc error: code = NotFound desc = could not find container \"e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826\": container with ID starting with e34c12e354a208204d690bb3085b6ebb7101c84480e08d638a0cf85293771826 not found: ID does not exist"
Jul 14 11:35:00.086899 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.086852    2581 scope.go:117] "RemoveContainer" containerID="9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0"
Jul 14 11:35:00.087074 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:35:00.087057    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0\": container with ID starting with 9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0 not found: ID does not exist" containerID="9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0"
Jul 14 11:35:00.087127 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.087081    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0"} err="failed to get container status \"9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0\": rpc error: code = NotFound desc = could not find container \"9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0\": container with ID starting with 9d62530c46c70e7042f74571ae45453c40cba7a32f1ff0434c51e11cebbfb0b0 not found: ID does not exist"
Jul 14 11:35:00.091003 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.090979    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"]
Jul 14 11:35:00.100819 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.100792    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c50a5e30-gw-openshift-default-cbbfd9bff-s4njv"]
Jul 14 11:35:00.782925 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.782899    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"]
Jul 14 11:35:00.783333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783320    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy"
Jul 14 11:35:00.783378 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783334    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy"
Jul 14 11:35:00.783378 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783352    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63236df9-8832-4801-a35b-c31431ced58c" containerName="revoke-keys"
Jul 14 11:35:00.783378 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783358    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63236df9-8832-4801-a35b-c31431ced58c" containerName="revoke-keys"
Jul 14 11:35:00.783490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783421    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63236df9-8832-4801-a35b-c31431ced58c" containerName="revoke-keys"
Jul 14 11:35:00.783490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783431    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy"
Jul 14 11:35:00.783490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783437    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9e6cfd-243f-42f6-879b-cb70c0f0aab4" containerName="revoke-keys"
Jul 14 11:35:00.783490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.783444    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy"
Jul 14 11:35:00.787935 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.787911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.790527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.790499    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 11:35:00.790703 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.790549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-57573546-openshift-default-dockercfg-rr7b4\""
Jul 14 11:35:00.817626 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.817592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"]
Jul 14 11:35:00.940022 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.939978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-token\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-credential-socket\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-podinfo\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-certs\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-socket\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49ea30c4-bbab-470c-bff2-4d9e973997df-istiod-ca-cert\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-data\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940494 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ngt\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-kube-api-access-r4ngt\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:00.940494 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:00.940312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-envoy\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041408 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-credential-socket\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041408 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-podinfo\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041408 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-certs\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-socket\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49ea30c4-bbab-470c-bff2-4d9e973997df-istiod-ca-cert\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-data\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ngt\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-kube-api-access-r4ngt\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-envoy\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-token\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-credential-socket\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-certs\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.041960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.041867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-socket\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.042192 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.042137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49ea30c4-bbab-470c-bff2-4d9e973997df-istiod-ca-cert\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.042302 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.042239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-data\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.043914 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.043889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-envoy\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.044014 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.044000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-podinfo\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.050349 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.050317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-token\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.050555 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.050534    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ngt\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-kube-api-access-r4ngt\") pod \"e2e-ait-57573546-openshift-default-5488fc8b75-tlskx\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") " pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.098343 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.098305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:01.240980 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.240955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"]
Jul 14 11:35:01.243248 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:35:01.243210    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ea30c4_bbab_470c_bff2_4d9e973997df.slice/crio-5098ac6d6285d373362edb4d851d862eb9c0ae04f2654a7bc70dd06eb1a0ded8 WatchSource:0}: Error finding container 5098ac6d6285d373362edb4d851d862eb9c0ae04f2654a7bc70dd06eb1a0ded8: Status 404 returned error can't find the container with id 5098ac6d6285d373362edb4d851d862eb9c0ae04f2654a7bc70dd06eb1a0ded8
Jul 14 11:35:01.245225 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.245193    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:01.245323 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.245272    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:01.245389 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:01.245320    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:02.053268 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:02.053236    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" path="/var/lib/kubelet/pods/8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf/volumes"
Jul 14 11:35:02.081940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:02.081909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" event={"ID":"49ea30c4-bbab-470c-bff2-4d9e973997df","Type":"ContainerStarted","Data":"d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99"}
Jul 14 11:35:02.082100 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:02.081961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" event={"ID":"49ea30c4-bbab-470c-bff2-4d9e973997df","Type":"ContainerStarted","Data":"5098ac6d6285d373362edb4d851d862eb9c0ae04f2654a7bc70dd06eb1a0ded8"}
Jul 14 11:35:02.099170 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:02.099127    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:02.103992 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:02.103969    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:02.115968 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:02.115922    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" podStartSLOduration=2.115907743 podStartE2EDuration="2.115907743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:35:02.113822415 +0000 UTC m=+1688.566768327" watchObservedRunningTime="2026-07-14 11:35:02.115907743 +0000 UTC m=+1688.568853620"
Jul 14 11:35:03.087995 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:03.087967    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:03.089648 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:03.089625    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:07.060132 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.060091    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"]
Jul 14 11:35:07.060705 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.060684    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy"
Jul 14 11:35:07.060788 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.060709    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbbf4c3-a64b-4c7d-8648-275bb7dd9ddf" containerName="istio-proxy"
Jul 14 11:35:07.065211 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.065187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"
Jul 14 11:35:07.069912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.069890    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:35:07.070015 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.069998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:35:07.081355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.081332    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"]
Jul 14 11:35:07.201320 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.201286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dba424d-5403-43d8-8fd9-790684cd2742-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57573546-t4hmb\" (UID: \"2dba424d-5403-43d8-8fd9-790684cd2742\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"
Jul 14 11:35:07.302504 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.302470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dba424d-5403-43d8-8fd9-790684cd2742-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57573546-t4hmb\" (UID: \"2dba424d-5403-43d8-8fd9-790684cd2742\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"
Jul 14 11:35:07.303129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.303103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dba424d-5403-43d8-8fd9-790684cd2742-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57573546-t4hmb\" (UID: \"2dba424d-5403-43d8-8fd9-790684cd2742\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"
Jul 14 11:35:07.376436 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.376362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"
Jul 14 11:35:07.559471 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:07.559442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"]
Jul 14 11:35:07.562006 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:35:07.561975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dba424d_5403_43d8_8fd9_790684cd2742.slice/crio-0ada973ec27edd96879602d56d780381efff0f8f36f09d1cdfc4fd04843b7891 WatchSource:0}: Error finding container 0ada973ec27edd96879602d56d780381efff0f8f36f09d1cdfc4fd04843b7891: Status 404 returned error can't find the container with id 0ada973ec27edd96879602d56d780381efff0f8f36f09d1cdfc4fd04843b7891
Jul 14 11:35:08.114533 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:08.114495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb" event={"ID":"2dba424d-5403-43d8-8fd9-790684cd2742","Type":"ContainerStarted","Data":"ae7ed5185df0a05f91bfd362bd016210e94e0776ec4471dd23e3b23d802ae39c"}
Jul 14 11:35:08.115022 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:08.114559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb" event={"ID":"2dba424d-5403-43d8-8fd9-790684cd2742","Type":"ContainerStarted","Data":"0ada973ec27edd96879602d56d780381efff0f8f36f09d1cdfc4fd04843b7891"}
Jul 14 11:35:09.120614 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:09.120582    2581 generic.go:356] "Generic (PLEG): container finished" podID="2dba424d-5403-43d8-8fd9-790684cd2742" containerID="ae7ed5185df0a05f91bfd362bd016210e94e0776ec4471dd23e3b23d802ae39c" exitCode=7
Jul 14 11:35:09.121005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:09.120649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb" event={"ID":"2dba424d-5403-43d8-8fd9-790684cd2742","Type":"ContainerDied","Data":"ae7ed5185df0a05f91bfd362bd016210e94e0776ec4471dd23e3b23d802ae39c"}
Jul 14 11:35:09.121005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:09.120847    2581 scope.go:117] "RemoveContainer" containerID="ae7ed5185df0a05f91bfd362bd016210e94e0776ec4471dd23e3b23d802ae39c"
Jul 14 11:35:10.128044 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:10.128011    2581 generic.go:356] "Generic (PLEG): container finished" podID="2dba424d-5403-43d8-8fd9-790684cd2742" containerID="09b9993f0ddbbf7bfba206b7d35faf8457cbb097e9d4995fea2daefa65660c4c" exitCode=0
Jul 14 11:35:10.128509 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:10.128064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb" event={"ID":"2dba424d-5403-43d8-8fd9-790684cd2742","Type":"ContainerDied","Data":"09b9993f0ddbbf7bfba206b7d35faf8457cbb097e9d4995fea2daefa65660c4c"}
Jul 14 11:35:10.128509 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:10.128119    2581 scope.go:117] "RemoveContainer" containerID="ae7ed5185df0a05f91bfd362bd016210e94e0776ec4471dd23e3b23d802ae39c"
Jul 14 11:35:11.281613 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:11.281588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"
Jul 14 11:35:11.439964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:11.439886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dba424d-5403-43d8-8fd9-790684cd2742-maas-api-service-ca\") pod \"2dba424d-5403-43d8-8fd9-790684cd2742\" (UID: \"2dba424d-5403-43d8-8fd9-790684cd2742\") "
Jul 14 11:35:11.440350 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:11.440324    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dba424d-5403-43d8-8fd9-790684cd2742-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2dba424d-5403-43d8-8fd9-790684cd2742" (UID: "2dba424d-5403-43d8-8fd9-790684cd2742"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:35:11.541246 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:11.541209    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dba424d-5403-43d8-8fd9-790684cd2742-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:12.141561 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.141536    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerID="d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99" exitCode=0
Jul 14 11:35:12.141706 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.141604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" event={"ID":"49ea30c4-bbab-470c-bff2-4d9e973997df","Type":"ContainerDied","Data":"d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99"}
Jul 14 11:35:12.142054 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.142038    2581 scope.go:117] "RemoveContainer" containerID="d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99"
Jul 14 11:35:12.142991 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.142971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb" event={"ID":"2dba424d-5403-43d8-8fd9-790684cd2742","Type":"ContainerDied","Data":"0ada973ec27edd96879602d56d780381efff0f8f36f09d1cdfc4fd04843b7891"}
Jul 14 11:35:12.143071 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.143011    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ada973ec27edd96879602d56d780381efff0f8f36f09d1cdfc4fd04843b7891"
Jul 14 11:35:12.143071 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.143015    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57573546-t4hmb"
Jul 14 11:35:12.143190 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.143058    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:12.143190 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.143120    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:12.143190 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:12.143171    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:13.154417 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:13.154371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" event={"ID":"49ea30c4-bbab-470c-bff2-4d9e973997df","Type":"ContainerStarted","Data":"b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367"}
Jul 14 11:35:14.099137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:14.099105    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:14.100110 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:14.100082    2581 patch_prober.go:28] interesting pod/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 14 11:35:14.100257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:14.100128    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 14 11:35:15.099398 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:15.099364    2581 patch_prober.go:28] interesting pod/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 14 11:35:15.099810 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:15.099431    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 14 11:35:16.099609 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:16.099573    2581 patch_prober.go:28] interesting pod/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 14 11:35:16.099994 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:16.099625    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 14 11:35:17.102731 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:17.102698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:17.103101 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:17.103059    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:17.103656 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:17.103637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:33.237661 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.237621    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"]
Jul 14 11:35:33.238239 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.237824    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy" containerID="cri-o://b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367" gracePeriod=30
Jul 14 11:35:33.540376 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.540297    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"]
Jul 14 11:35:33.540705 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.540689    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dba424d-5403-43d8-8fd9-790684cd2742" containerName="revoke-keys"
Jul 14 11:35:33.540705 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.540702    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dba424d-5403-43d8-8fd9-790684cd2742" containerName="revoke-keys"
Jul 14 11:35:33.540796 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.540716    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dba424d-5403-43d8-8fd9-790684cd2742" containerName="revoke-keys"
Jul 14 11:35:33.540796 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.540723    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dba424d-5403-43d8-8fd9-790684cd2742" containerName="revoke-keys"
Jul 14 11:35:33.540796 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.540789    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dba424d-5403-43d8-8fd9-790684cd2742" containerName="revoke-keys"
Jul 14 11:35:33.540796 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.540797    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dba424d-5403-43d8-8fd9-790684cd2742" containerName="revoke-keys"
Jul 14 11:35:33.544488 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.544469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.547322 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.547302    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1cf7269b-openshift-default-dockercfg-2qkmk\""
Jul 14 11:35:33.563591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.563569    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"]
Jul 14 11:35:33.639917 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.639880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-certs\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.639917 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.639921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istiod-ca-cert\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.640137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.639942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-token\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.640137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.640065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-credential-socket\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.640137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.640102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-socket\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.640137 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.640127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-envoy\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.640314 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.640168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-podinfo\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.640314 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.640242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-data\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.640314 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.640265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7wg7\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-kube-api-access-v7wg7\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.740811 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.740775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-certs\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.740811 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.740814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istiod-ca-cert\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741053 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.740838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-token\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741053 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.740872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-credential-socket\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741053 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.740897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-socket\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741053 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.740923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-envoy\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741053 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.740951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-podinfo\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741053 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.741032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-data\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.741064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7wg7\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-kube-api-access-v7wg7\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.741265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-certs\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.741284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-socket\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741525 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.741418    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-credential-socket\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741628 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.741605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-data\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.741722 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.741705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istiod-ca-cert\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.743291 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.743269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-envoy\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.743413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.743385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-podinfo\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.749694 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.749668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-token\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.749884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.749869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7wg7\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-kube-api-access-v7wg7\") pod \"e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") " pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.854397 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.854343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:33.995014 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.994841    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"]
Jul 14 11:35:33.997764 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:35:33.997738    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ac3e44_b66e_4f99_aeb2_a2a120f3a9b8.slice/crio-c715470fcdf03337c9ccf0ce19363d3e3ee8fc958150a61a10e86886a4f564e8 WatchSource:0}: Error finding container c715470fcdf03337c9ccf0ce19363d3e3ee8fc958150a61a10e86886a4f564e8: Status 404 returned error can't find the container with id c715470fcdf03337c9ccf0ce19363d3e3ee8fc958150a61a10e86886a4f564e8
Jul 14 11:35:33.999968 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:33.999934    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:34.000047 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:34.000001    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:34.000047 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:34.000033    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:34.270692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:34.270587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" event={"ID":"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8","Type":"ContainerStarted","Data":"1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e"}
Jul 14 11:35:34.270692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:34.270678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" event={"ID":"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8","Type":"ContainerStarted","Data":"c715470fcdf03337c9ccf0ce19363d3e3ee8fc958150a61a10e86886a4f564e8"}
Jul 14 11:35:34.294822 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:34.294773    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" podStartSLOduration=1.294753837 podStartE2EDuration="1.294753837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:35:34.293037671 +0000 UTC m=+1720.745983550" watchObservedRunningTime="2026-07-14 11:35:34.294753837 +0000 UTC m=+1720.747699715"
Jul 14 11:35:34.854712 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:34.854683    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:35.859730 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:35.859701    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:36.280335 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:36.280250    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:36.281374 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:36.281356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:38.514934 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.514878    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:38.588521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588487    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4ngt\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-kube-api-access-r4ngt\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588671 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-data\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588671 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588620    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-certs\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588671 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588659    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-envoy\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-socket\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588757    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-credential-socket\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588791    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49ea30c4-bbab-470c-bff2-4d9e973997df-istiod-ca-cert\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588838    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-podinfo\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.588960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.588877    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-token\") pod \"49ea30c4-bbab-470c-bff2-4d9e973997df\" (UID: \"49ea30c4-bbab-470c-bff2-4d9e973997df\") "
Jul 14 11:35:38.589555 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.589506    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-data" (OuterVolumeSpecName: "istio-data") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:35:38.589681 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.589555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:35:38.589900 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.589859    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:35:38.590359 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.590321    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:35:38.590685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.590620    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49ea30c4-bbab-470c-bff2-4d9e973997df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:35:38.591435 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.591407    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-kube-api-access-r4ngt" (OuterVolumeSpecName: "kube-api-access-r4ngt") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "kube-api-access-r4ngt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:35:38.591892 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.591845    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:35:38.592469 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.592431    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-token" (OuterVolumeSpecName: "istio-token") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:35:38.592578 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.592531    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49ea30c4-bbab-470c-bff2-4d9e973997df" (UID: "49ea30c4-bbab-470c-bff2-4d9e973997df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:35:38.689743 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689708    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4ngt\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-kube-api-access-r4ngt\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689743 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689741    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689743 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689752    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689983 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689761    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689983 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689770    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689983 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689778    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49ea30c4-bbab-470c-bff2-4d9e973997df-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689983 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689786    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49ea30c4-bbab-470c-bff2-4d9e973997df-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689983 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689795    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:38.689983 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:38.689804    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49ea30c4-bbab-470c-bff2-4d9e973997df-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:39.110316 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.110283    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"]
Jul 14 11:35:39.110711 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.110698    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy"
Jul 14 11:35:39.110772 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.110713    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy"
Jul 14 11:35:39.110805 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.110788    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy"
Jul 14 11:35:39.110805 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.110798    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy"
Jul 14 11:35:39.113937 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.113916    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"
Jul 14 11:35:39.117097 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.117077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:35:39.117230 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.117104    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:35:39.131114 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.125031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"]
Jul 14 11:35:39.194500 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.194460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a6a3283-bbf1-401d-8d64-e3207580e68d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1cf7269b-flgls\" (UID: \"4a6a3283-bbf1-401d-8d64-e3207580e68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"
Jul 14 11:35:39.295289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.295253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a6a3283-bbf1-401d-8d64-e3207580e68d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1cf7269b-flgls\" (UID: \"4a6a3283-bbf1-401d-8d64-e3207580e68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"
Jul 14 11:35:39.295950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.295927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a6a3283-bbf1-401d-8d64-e3207580e68d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1cf7269b-flgls\" (UID: \"4a6a3283-bbf1-401d-8d64-e3207580e68d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"
Jul 14 11:35:39.297688 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.297656    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerID="b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367" exitCode=0
Jul 14 11:35:39.297789 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.297716    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"
Jul 14 11:35:39.297789 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.297728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" event={"ID":"49ea30c4-bbab-470c-bff2-4d9e973997df","Type":"ContainerDied","Data":"b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367"}
Jul 14 11:35:39.297874 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.297789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx" event={"ID":"49ea30c4-bbab-470c-bff2-4d9e973997df","Type":"ContainerDied","Data":"5098ac6d6285d373362edb4d851d862eb9c0ae04f2654a7bc70dd06eb1a0ded8"}
Jul 14 11:35:39.297874 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.297823    2581 scope.go:117] "RemoveContainer" containerID="b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367"
Jul 14 11:35:39.307190 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.307135    2581 scope.go:117] "RemoveContainer" containerID="d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99"
Jul 14 11:35:39.315807 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.315787    2581 scope.go:117] "RemoveContainer" containerID="b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367"
Jul 14 11:35:39.316084 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:35:39.316056    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367\": container with ID starting with b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367 not found: ID does not exist" containerID="b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367"
Jul 14 11:35:39.316184 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.316084    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367"} err="failed to get container status \"b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367\": rpc error: code = NotFound desc = could not find container \"b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367\": container with ID starting with b82f54246da97b1ea14db3d4eb6212fce18b52162c66a43e25ee62196b6fa367 not found: ID does not exist"
Jul 14 11:35:39.316184 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.316102    2581 scope.go:117] "RemoveContainer" containerID="d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99"
Jul 14 11:35:39.316441 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:35:39.316418    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99\": container with ID starting with d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99 not found: ID does not exist" containerID="d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99"
Jul 14 11:35:39.316485 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.316448    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99"} err="failed to get container status \"d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99\": rpc error: code = NotFound desc = could not find container \"d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99\": container with ID starting with d606b7335d238bf8dadcd5ac6e5d8494686413acacae66c5c923eb58f07cbb99 not found: ID does not exist"
Jul 14 11:35:39.320619 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.320597    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"]
Jul 14 11:35:39.327416 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.327392    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-57573546-openshift-default-5488fc8b75-tlskx"]
Jul 14 11:35:39.450264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.450172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"
Jul 14 11:35:39.613089 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:39.613067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"]
Jul 14 11:35:39.615264 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:35:39.615215    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6a3283_bbf1_401d_8d64_e3207580e68d.slice/crio-9db8ca5ae0989ba4d33644b002f5a1924e4993fd293f793e154facdae132a630 WatchSource:0}: Error finding container 9db8ca5ae0989ba4d33644b002f5a1924e4993fd293f793e154facdae132a630: Status 404 returned error can't find the container with id 9db8ca5ae0989ba4d33644b002f5a1924e4993fd293f793e154facdae132a630
Jul 14 11:35:40.056704 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:40.056670    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" path="/var/lib/kubelet/pods/49ea30c4-bbab-470c-bff2-4d9e973997df/volumes"
Jul 14 11:35:40.305224 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:40.305185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" event={"ID":"4a6a3283-bbf1-401d-8d64-e3207580e68d","Type":"ContainerStarted","Data":"1c988921adfc58bd60987f069f93fa8120f91ba777313749256c2aac61d181c3"}
Jul 14 11:35:40.305406 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:40.305252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" event={"ID":"4a6a3283-bbf1-401d-8d64-e3207580e68d","Type":"ContainerStarted","Data":"9db8ca5ae0989ba4d33644b002f5a1924e4993fd293f793e154facdae132a630"}
Jul 14 11:35:40.322195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:40.322086    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" podStartSLOduration=1.322066521 podStartE2EDuration="1.322066521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:35:40.320401319 +0000 UTC m=+1726.773347198" watchObservedRunningTime="2026-07-14 11:35:40.322066521 +0000 UTC m=+1726.775012399"
Jul 14 11:35:41.313426 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:41.313392    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerID="1c988921adfc58bd60987f069f93fa8120f91ba777313749256c2aac61d181c3" exitCode=7
Jul 14 11:35:41.313826 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:41.313474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" event={"ID":"4a6a3283-bbf1-401d-8d64-e3207580e68d","Type":"ContainerDied","Data":"1c988921adfc58bd60987f069f93fa8120f91ba777313749256c2aac61d181c3"}
Jul 14 11:35:41.313826 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:41.313665    2581 scope.go:117] "RemoveContainer" containerID="1c988921adfc58bd60987f069f93fa8120f91ba777313749256c2aac61d181c3"
Jul 14 11:35:42.321300 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:42.321263    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerID="097855fcb3fb05259a884583df30d7f35a29c7fa708dbddc2f159ae82f4d4740" exitCode=7
Jul 14 11:35:42.321751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:42.321322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" event={"ID":"4a6a3283-bbf1-401d-8d64-e3207580e68d","Type":"ContainerDied","Data":"097855fcb3fb05259a884583df30d7f35a29c7fa708dbddc2f159ae82f4d4740"}
Jul 14 11:35:42.321751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:42.321401    2581 scope.go:117] "RemoveContainer" containerID="1c988921adfc58bd60987f069f93fa8120f91ba777313749256c2aac61d181c3"
Jul 14 11:35:42.321751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:42.321585    2581 scope.go:117] "RemoveContainer" containerID="097855fcb3fb05259a884583df30d7f35a29c7fa708dbddc2f159ae82f4d4740"
Jul 14 11:35:42.321924 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:35:42.321827    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-1cf7269b-flgls_odh-ai-gateway-infra(4a6a3283-bbf1-401d-8d64-e3207580e68d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d"
Jul 14 11:35:43.329548 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:43.329522    2581 scope.go:117] "RemoveContainer" containerID="097855fcb3fb05259a884583df30d7f35a29c7fa708dbddc2f159ae82f4d4740"
Jul 14 11:35:43.329993 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:35:43.329705    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-1cf7269b-flgls_odh-ai-gateway-infra(4a6a3283-bbf1-401d-8d64-e3207580e68d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d"
Jul 14 11:35:45.340567 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:45.340534    2581 generic.go:356] "Generic (PLEG): container finished" podID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerID="1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e" exitCode=0
Jul 14 11:35:45.341082 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:45.340596    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" event={"ID":"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8","Type":"ContainerDied","Data":"1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e"}
Jul 14 11:35:45.341177 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:45.341088    2581 scope.go:117] "RemoveContainer" containerID="1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e"
Jul 14 11:35:45.342192 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:45.342132    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:45.342271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:45.342236    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:45.342309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:45.342283    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:35:46.354339 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:46.354300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" event={"ID":"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8","Type":"ContainerStarted","Data":"732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5"}
Jul 14 11:35:46.856517 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:46.856482    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:46.856947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:46.856917    2581 patch_prober.go:28] interesting pod/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 14 11:35:46.857221 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:46.857188    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 14 11:35:47.855739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:47.855699    2581 patch_prober.go:28] interesting pod/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 14 11:35:47.856365 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:47.856329    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 14 11:35:48.858652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:48.858599    2581 patch_prober.go:28] interesting pod/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 14 11:35:48.859070 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:48.858685    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 14 11:35:49.855166 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:49.855107    2581 patch_prober.go:28] interesting pod/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 14 11:35:49.855369 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:49.855193    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 14 11:35:50.858620 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:50.858587    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:50.859038 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:50.858951    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:50.859643 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:50.859622    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:35:54.048654 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:54.048617    2581 scope.go:117] "RemoveContainer" containerID="097855fcb3fb05259a884583df30d7f35a29c7fa708dbddc2f159ae82f4d4740"
Jul 14 11:35:54.398331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:54.398288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" event={"ID":"4a6a3283-bbf1-401d-8d64-e3207580e68d","Type":"ContainerStarted","Data":"f1dcfc179a0573c35a28454462e13e03a234974c659c372b7f65f318f853192c"}
Jul 14 11:35:55.404480 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:55.404444    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerID="f1dcfc179a0573c35a28454462e13e03a234974c659c372b7f65f318f853192c" exitCode=0
Jul 14 11:35:55.404897 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:55.404511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" event={"ID":"4a6a3283-bbf1-401d-8d64-e3207580e68d","Type":"ContainerDied","Data":"f1dcfc179a0573c35a28454462e13e03a234974c659c372b7f65f318f853192c"}
Jul 14 11:35:55.404897 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:55.404569    2581 scope.go:117] "RemoveContainer" containerID="097855fcb3fb05259a884583df30d7f35a29c7fa708dbddc2f159ae82f4d4740"
Jul 14 11:35:55.426262 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:55.426237    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"]
Jul 14 11:35:56.547758 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:56.547739    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"
Jul 14 11:35:56.658923 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:56.658891    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a6a3283-bbf1-401d-8d64-e3207580e68d-maas-api-service-ca\") pod \"4a6a3283-bbf1-401d-8d64-e3207580e68d\" (UID: \"4a6a3283-bbf1-401d-8d64-e3207580e68d\") "
Jul 14 11:35:56.659325 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:56.659305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6a3283-bbf1-401d-8d64-e3207580e68d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a6a3283-bbf1-401d-8d64-e3207580e68d" (UID: "4a6a3283-bbf1-401d-8d64-e3207580e68d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:35:56.760060 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:56.759979    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a6a3283-bbf1-401d-8d64-e3207580e68d-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:35:57.416599 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:57.416573    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"
Jul 14 11:35:57.416778 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:57.416611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls" event={"ID":"4a6a3283-bbf1-401d-8d64-e3207580e68d","Type":"ContainerDied","Data":"9db8ca5ae0989ba4d33644b002f5a1924e4993fd293f793e154facdae132a630"}
Jul 14 11:35:57.416778 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:57.416658    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9db8ca5ae0989ba4d33644b002f5a1924e4993fd293f793e154facdae132a630"
Jul 14 11:35:57.448858 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:57.448827    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"]
Jul 14 11:35:57.450812 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:57.450792    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-flgls"]
Jul 14 11:35:58.052753 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:35:58.052719    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" path="/var/lib/kubelet/pods/4a6a3283-bbf1-401d-8d64-e3207580e68d/volumes"
Jul 14 11:36:29.155071 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155039    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"]
Jul 14 11:36:29.155658 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155638    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy"
Jul 14 11:36:29.155739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155661    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ea30c4-bbab-470c-bff2-4d9e973997df" containerName="istio-proxy"
Jul 14 11:36:29.155739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155694    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155704    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155720    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155729    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155745    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155755    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155854    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155868    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.155988 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.155880    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6a3283-bbf1-401d-8d64-e3207580e68d" containerName="revoke-keys"
Jul 14 11:36:29.159083 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.159063    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"
Jul 14 11:36:29.161551 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.161529    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:36:29.161647 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.161591    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:36:29.165856 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.165832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"]
Jul 14 11:36:29.256436 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.256403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/681049d0-afad-4318-9fdc-b542a9b54b0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc\" (UID: \"681049d0-afad-4318-9fdc-b542a9b54b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"
Jul 14 11:36:29.357564 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.357527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/681049d0-afad-4318-9fdc-b542a9b54b0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc\" (UID: \"681049d0-afad-4318-9fdc-b542a9b54b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"
Jul 14 11:36:29.358132 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.358109    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/681049d0-afad-4318-9fdc-b542a9b54b0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc\" (UID: \"681049d0-afad-4318-9fdc-b542a9b54b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"
Jul 14 11:36:29.471776 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.471699    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"
Jul 14 11:36:29.607957 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:29.607931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"]
Jul 14 11:36:29.609712 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:36:29.609691    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681049d0_afad_4318_9fdc_b542a9b54b0b.slice/crio-499b9c5d27a9abcc90151bc01586d5e4e845d950339dd888122977712f754b33 WatchSource:0}: Error finding container 499b9c5d27a9abcc90151bc01586d5e4e845d950339dd888122977712f754b33: Status 404 returned error can't find the container with id 499b9c5d27a9abcc90151bc01586d5e4e845d950339dd888122977712f754b33
Jul 14 11:36:30.582511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:30.582478    2581 generic.go:356] "Generic (PLEG): container finished" podID="681049d0-afad-4318-9fdc-b542a9b54b0b" containerID="6d01a0b84b86f1c9b5caf8a88552a1ce205117835e5af9c43422b63d265f724f" exitCode=0
Jul 14 11:36:30.582882 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:30.582558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc" event={"ID":"681049d0-afad-4318-9fdc-b542a9b54b0b","Type":"ContainerDied","Data":"6d01a0b84b86f1c9b5caf8a88552a1ce205117835e5af9c43422b63d265f724f"}
Jul 14 11:36:30.582882 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:30.582601    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc" event={"ID":"681049d0-afad-4318-9fdc-b542a9b54b0b","Type":"ContainerStarted","Data":"499b9c5d27a9abcc90151bc01586d5e4e845d950339dd888122977712f754b33"}
Jul 14 11:36:31.718502 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:31.718478    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"
Jul 14 11:36:31.781490 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:31.781460    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/681049d0-afad-4318-9fdc-b542a9b54b0b-maas-api-service-ca\") pod \"681049d0-afad-4318-9fdc-b542a9b54b0b\" (UID: \"681049d0-afad-4318-9fdc-b542a9b54b0b\") "
Jul 14 11:36:31.781794 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:31.781772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/681049d0-afad-4318-9fdc-b542a9b54b0b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "681049d0-afad-4318-9fdc-b542a9b54b0b" (UID: "681049d0-afad-4318-9fdc-b542a9b54b0b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:36:31.882432 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:31.882363    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/681049d0-afad-4318-9fdc-b542a9b54b0b-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:32.594093 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:32.594066    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc"
Jul 14 11:36:32.594271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:32.594067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc" event={"ID":"681049d0-afad-4318-9fdc-b542a9b54b0b","Type":"ContainerDied","Data":"499b9c5d27a9abcc90151bc01586d5e4e845d950339dd888122977712f754b33"}
Jul 14 11:36:32.594271 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:32.594205    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="499b9c5d27a9abcc90151bc01586d5e4e845d950339dd888122977712f754b33"
Jul 14 11:36:54.404192 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:54.404139    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"]
Jul 14 11:36:54.404614 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:54.404352    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy" containerID="cri-o://732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5" gracePeriod=30
Jul 14 11:36:59.665360 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.665305    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:36:59.731202 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.731113    2581 generic.go:356] "Generic (PLEG): container finished" podID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerID="732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5" exitCode=0
Jul 14 11:36:59.731202 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.731192    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"
Jul 14 11:36:59.731402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.731186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" event={"ID":"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8","Type":"ContainerDied","Data":"732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5"}
Jul 14 11:36:59.731402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.731276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77" event={"ID":"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8","Type":"ContainerDied","Data":"c715470fcdf03337c9ccf0ce19363d3e3ee8fc958150a61a10e86886a4f564e8"}
Jul 14 11:36:59.731402 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.731312    2581 scope.go:117] "RemoveContainer" containerID="732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5"
Jul 14 11:36:59.732097 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732071    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7wg7\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-kube-api-access-v7wg7\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732259 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732176    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istiod-ca-cert\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732259 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732214    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-data\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732381 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732260    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-token\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732381 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732300    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-credential-socket\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732381 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-podinfo\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732412    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-socket\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732477    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-certs\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-envoy\") pod \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\" (UID: \"40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8\") "
Jul 14 11:36:59.732748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732582    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:36:59.732942 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732844    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.732942 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.732863    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:36:59.733130 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.733067    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:36:59.733386 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.733369    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:36:59.733464 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.733393    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:36:59.734891 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.734845    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-kube-api-access-v7wg7" (OuterVolumeSpecName: "kube-api-access-v7wg7") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "kube-api-access-v7wg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:36:59.735433 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.735402    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:36:59.735560 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.735533    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:36:59.735661 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.735637    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" (UID: "40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:36:59.759197 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.759172    2581 scope.go:117] "RemoveContainer" containerID="1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e"
Jul 14 11:36:59.767428 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.767407    2581 scope.go:117] "RemoveContainer" containerID="732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5"
Jul 14 11:36:59.767689 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:36:59.767667    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5\": container with ID starting with 732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5 not found: ID does not exist" containerID="732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5"
Jul 14 11:36:59.767769 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.767695    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5"} err="failed to get container status \"732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5\": rpc error: code = NotFound desc = could not find container \"732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5\": container with ID starting with 732870162ebaa73db6ac385a178c758a7c44ee44b01bb978d09b0901359e3bf5 not found: ID does not exist"
Jul 14 11:36:59.767769 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.767715    2581 scope.go:117] "RemoveContainer" containerID="1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e"
Jul 14 11:36:59.767941 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:36:59.767924    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e\": container with ID starting with 1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e not found: ID does not exist" containerID="1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e"
Jul 14 11:36:59.768009 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.767947    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e"} err="failed to get container status \"1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e\": rpc error: code = NotFound desc = could not find container \"1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e\": container with ID starting with 1c45b3db7c293994c35ac585ea9d752bbbeb9ab1697075a6eb4e20f16d8cd92e not found: ID does not exist"
Jul 14 11:36:59.833535 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833507    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.833535 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833531    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.833535 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833541    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.833735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833552    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.833735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833561    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.833735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833570    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.833735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833578    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7wg7\" (UniqueName: \"kubernetes.io/projected/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-kube-api-access-v7wg7\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:36:59.833735 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:36:59.833586    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:37:00.054755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:37:00.054722    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"]
Jul 14 11:37:00.058601 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:37:00.058578    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1cf7269b-openshift-default-66fb6d69f9-jww77"]
Jul 14 11:37:02.051934 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:37:02.051892    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" path="/var/lib/kubelet/pods/40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8/volumes"
Jul 14 11:38:31.644847 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.644771    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"]
Jul 14 11:38:31.645324 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.645182    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy"
Jul 14 11:38:31.645324 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.645195    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy"
Jul 14 11:38:31.645324 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.645219    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681049d0-afad-4318-9fdc-b542a9b54b0b" containerName="revoke-keys"
Jul 14 11:38:31.645324 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.645230    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="681049d0-afad-4318-9fdc-b542a9b54b0b" containerName="revoke-keys"
Jul 14 11:38:31.645324 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.645319    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="681049d0-afad-4318-9fdc-b542a9b54b0b" containerName="revoke-keys"
Jul 14 11:38:31.645324 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.645327    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy"
Jul 14 11:38:31.645521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.645334    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy"
Jul 14 11:38:31.648286 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.648269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.652873 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.652851    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1ba6ef6c-openshift-default-dockercfg-4whw7\""
Jul 14 11:38:31.653102 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.653086    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 11:38:31.682385 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.682361    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"]
Jul 14 11:38:31.756044 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89wb7\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-kube-api-access-89wb7\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-envoy\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-credential-socket\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-certs\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-socket\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-data\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-podinfo\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-token\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.756499 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.756282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9302fefe-2de7-4021-97b2-fde85f7a562a-istiod-ca-cert\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857172 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-socket\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-data\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-podinfo\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-token\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9302fefe-2de7-4021-97b2-fde85f7a562a-istiod-ca-cert\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89wb7\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-kube-api-access-89wb7\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857595 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-envoy\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857595 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-credential-socket\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857595 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-certs\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857595 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-socket\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857792 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-data\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857792 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857740    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-credential-socket\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9302fefe-2de7-4021-97b2-fde85f7a562a-istiod-ca-cert\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.857953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.857937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-certs\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.859622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.859600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-envoy\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.860008 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.859985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-podinfo\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.866699 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.866676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-token\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.866834 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.866818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89wb7\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-kube-api-access-89wb7\") pod \"e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") " pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:31.958645 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:31.958580    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:32.095457 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.095431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"]
Jul 14 11:38:32.096871 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:38:32.096844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9302fefe_2de7_4021_97b2_fde85f7a562a.slice/crio-52aac713e3df3e775281e980093b3a3940b17dd02eb43655c3a0157265d3f656 WatchSource:0}: Error finding container 52aac713e3df3e775281e980093b3a3940b17dd02eb43655c3a0157265d3f656: Status 404 returned error can't find the container with id 52aac713e3df3e775281e980093b3a3940b17dd02eb43655c3a0157265d3f656
Jul 14 11:38:32.098914 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.098878    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:38:32.098992 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.098949    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:38:32.098992 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.098979    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:38:32.192435 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.192389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" event={"ID":"9302fefe-2de7-4021-97b2-fde85f7a562a","Type":"ContainerStarted","Data":"3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1"}
Jul 14 11:38:32.192592 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.192471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" event={"ID":"9302fefe-2de7-4021-97b2-fde85f7a562a","Type":"ContainerStarted","Data":"52aac713e3df3e775281e980093b3a3940b17dd02eb43655c3a0157265d3f656"}
Jul 14 11:38:32.216171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.216037    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" podStartSLOduration=1.216017482 podStartE2EDuration="1.216017482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:38:32.215595374 +0000 UTC m=+1898.668541253" watchObservedRunningTime="2026-07-14 11:38:32.216017482 +0000 UTC m=+1898.668963363"
Jul 14 11:38:32.958885 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:32.958844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:33.963677 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:33.963647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:34.203097 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:34.203070    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:34.203896 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:34.203875    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:46.709235 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.709188    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"]
Jul 14 11:38:46.709723 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.709585    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy"
Jul 14 11:38:46.709723 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.709598    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ac3e44-b66e-4f99-aeb2-a2a120f3a9b8" containerName="istio-proxy"
Jul 14 11:38:46.714156 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.714132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"
Jul 14 11:38:46.717063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.717035    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:38:46.717224 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.717114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:38:46.721264 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.721241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"]
Jul 14 11:38:46.800198 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.800132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/041294ce-02bd-4b8a-9542-40779f22a059-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r\" (UID: \"041294ce-02bd-4b8a-9542-40779f22a059\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"
Jul 14 11:38:46.900845 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.900807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/041294ce-02bd-4b8a-9542-40779f22a059-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r\" (UID: \"041294ce-02bd-4b8a-9542-40779f22a059\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"
Jul 14 11:38:46.901433 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:46.901414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/041294ce-02bd-4b8a-9542-40779f22a059-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r\" (UID: \"041294ce-02bd-4b8a-9542-40779f22a059\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"
Jul 14 11:38:47.027243 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:47.027164    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"
Jul 14 11:38:47.171190 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:47.171164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"]
Jul 14 11:38:47.173845 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:38:47.173812    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041294ce_02bd_4b8a_9542_40779f22a059.slice/crio-ac1abeb8a71d62118b08bd81e13d9c390ca48a0c9df43554e5f3fa7df17805c4 WatchSource:0}: Error finding container ac1abeb8a71d62118b08bd81e13d9c390ca48a0c9df43554e5f3fa7df17805c4: Status 404 returned error can't find the container with id ac1abeb8a71d62118b08bd81e13d9c390ca48a0c9df43554e5f3fa7df17805c4
Jul 14 11:38:47.280756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:47.280668    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r" event={"ID":"041294ce-02bd-4b8a-9542-40779f22a059","Type":"ContainerStarted","Data":"ac1abeb8a71d62118b08bd81e13d9c390ca48a0c9df43554e5f3fa7df17805c4"}
Jul 14 11:38:48.288244 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.288121    2581 generic.go:356] "Generic (PLEG): container finished" podID="041294ce-02bd-4b8a-9542-40779f22a059" containerID="f2aeb2473510988a19872a812a0783176559740c45f0bd011459301482aceaf6" exitCode=0
Jul 14 11:38:48.288244 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.288183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r" event={"ID":"041294ce-02bd-4b8a-9542-40779f22a059","Type":"ContainerDied","Data":"f2aeb2473510988a19872a812a0783176559740c45f0bd011459301482aceaf6"}
Jul 14 11:38:48.290036 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.290013    2581 generic.go:356] "Generic (PLEG): container finished" podID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerID="3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1" exitCode=0
Jul 14 11:38:48.290176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.290055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" event={"ID":"9302fefe-2de7-4021-97b2-fde85f7a562a","Type":"ContainerDied","Data":"3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1"}
Jul 14 11:38:48.290459 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.290446    2581 scope.go:117] "RemoveContainer" containerID="3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1"
Jul 14 11:38:48.291517 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.291487    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:38:48.291614 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.291559    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:38:48.291614 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:48.291591    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:38:49.203440 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.203403    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:49.297634 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.297595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" event={"ID":"9302fefe-2de7-4021-97b2-fde85f7a562a","Type":"ContainerStarted","Data":"e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7"}
Jul 14 11:38:49.464730 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.464656    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"
Jul 14 11:38:49.527465 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.527434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/041294ce-02bd-4b8a-9542-40779f22a059-maas-api-service-ca\") pod \"041294ce-02bd-4b8a-9542-40779f22a059\" (UID: \"041294ce-02bd-4b8a-9542-40779f22a059\") "
Jul 14 11:38:49.527738 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.527718    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/041294ce-02bd-4b8a-9542-40779f22a059-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "041294ce-02bd-4b8a-9542-40779f22a059" (UID: "041294ce-02bd-4b8a-9542-40779f22a059"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:38:49.628991 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.628957    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/041294ce-02bd-4b8a-9542-40779f22a059-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:38:49.958839 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.958798    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:49.959950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.959925    2581 patch_prober.go:28] interesting pod/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 11:38:49.960063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:49.959973    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 11:38:50.304231 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:50.304205    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r"
Jul 14 11:38:50.304596 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:50.304246    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r" event={"ID":"041294ce-02bd-4b8a-9542-40779f22a059","Type":"ContainerDied","Data":"ac1abeb8a71d62118b08bd81e13d9c390ca48a0c9df43554e5f3fa7df17805c4"}
Jul 14 11:38:50.304596 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:50.304292    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac1abeb8a71d62118b08bd81e13d9c390ca48a0c9df43554e5f3fa7df17805c4"
Jul 14 11:38:50.959301 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:50.959265    2581 patch_prober.go:28] interesting pod/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 11:38:50.959482 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:50.959323    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 11:38:51.959881 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:51.959840    2581 patch_prober.go:28] interesting pod/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 11:38:51.960388 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:51.959905    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 11:38:52.959247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:52.959202    2581 patch_prober.go:28] interesting pod/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 14 11:38:52.959460 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:52.959266    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 14 11:38:53.963120 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:53.963092    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:53.963508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:53.963403    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:53.964066 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:53.964045    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:38:54.141909 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:38:54.141878    2581 scope.go:117] "RemoveContainer" containerID="b80d3d440164ca458830c89432a5dc20a8d2fff21dc174336550ca899b83652d"
Jul 14 11:39:12.491562 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:12.491527    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"]
Jul 14 11:39:12.492139 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:12.491797    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy" containerID="cri-o://e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7" gracePeriod=30
Jul 14 11:39:17.752501 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.752479    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:39:17.784318 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784261    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9302fefe-2de7-4021-97b2-fde85f7a562a-istiod-ca-cert\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784318 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784298    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-credential-socket\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-certs\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784363    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-data\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784391    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-socket\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784426    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-token\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784453    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-envoy\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784486    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-podinfo\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784818 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784523    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89wb7\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-kube-api-access-89wb7\") pod \"9302fefe-2de7-4021-97b2-fde85f7a562a\" (UID: \"9302fefe-2de7-4021-97b2-fde85f7a562a\") "
Jul 14 11:39:17.784818 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784605    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:39:17.784818 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784701    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9302fefe-2de7-4021-97b2-fde85f7a562a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:39:17.784975 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784823    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:39:17.785604 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.784746    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:39:17.785604 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.785539    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:39:17.785604 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.785558    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9302fefe-2de7-4021-97b2-fde85f7a562a-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.785604 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.785585    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.785604 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.785601    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.787248 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.787190    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:39:17.794266 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.794227    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-kube-api-access-89wb7" (OuterVolumeSpecName: "kube-api-access-89wb7") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "kube-api-access-89wb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:39:17.794975 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.794927    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:39:17.795328 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.794978    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9302fefe-2de7-4021-97b2-fde85f7a562a" (UID: "9302fefe-2de7-4021-97b2-fde85f7a562a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:39:17.886482 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.886451    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.886482 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.886479    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.886672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.886491    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.886672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.886502    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.886672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.886514    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9302fefe-2de7-4021-97b2-fde85f7a562a-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:17.886672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:17.886525    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89wb7\" (UniqueName: \"kubernetes.io/projected/9302fefe-2de7-4021-97b2-fde85f7a562a-kube-api-access-89wb7\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:39:18.443637 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.443556    2581 generic.go:356] "Generic (PLEG): container finished" podID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerID="e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7" exitCode=0
Jul 14 11:39:18.443637 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.443620    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"
Jul 14 11:39:18.443813 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.443647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" event={"ID":"9302fefe-2de7-4021-97b2-fde85f7a562a","Type":"ContainerDied","Data":"e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7"}
Jul 14 11:39:18.443813 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.443706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz" event={"ID":"9302fefe-2de7-4021-97b2-fde85f7a562a","Type":"ContainerDied","Data":"52aac713e3df3e775281e980093b3a3940b17dd02eb43655c3a0157265d3f656"}
Jul 14 11:39:18.443813 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.443731    2581 scope.go:117] "RemoveContainer" containerID="e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7"
Jul 14 11:39:18.452407 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.452392    2581 scope.go:117] "RemoveContainer" containerID="3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1"
Jul 14 11:39:18.460322 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.460306    2581 scope.go:117] "RemoveContainer" containerID="e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7"
Jul 14 11:39:18.460578 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:39:18.460554    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7\": container with ID starting with e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7 not found: ID does not exist" containerID="e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7"
Jul 14 11:39:18.460648 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.460586    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7"} err="failed to get container status \"e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7\": rpc error: code = NotFound desc = could not find container \"e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7\": container with ID starting with e28920eb8f89ca5fc29150f4f25940d31bab717656b411756a3c242de68b76b7 not found: ID does not exist"
Jul 14 11:39:18.460648 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.460604    2581 scope.go:117] "RemoveContainer" containerID="3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1"
Jul 14 11:39:18.460899 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:39:18.460879    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1\": container with ID starting with 3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1 not found: ID does not exist" containerID="3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1"
Jul 14 11:39:18.460944 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.460905    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1"} err="failed to get container status \"3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1\": rpc error: code = NotFound desc = could not find container \"3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1\": container with ID starting with 3d6c2fce192ba7c377b07f71df370bb056452883f426274f9cce56ccf79ad2e1 not found: ID does not exist"
Jul 14 11:39:18.462367 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.462347    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"]
Jul 14 11:39:18.466119 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:18.466100    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1ba6ef6c-openshift-default-5b4fd689b7-bdjxz"]
Jul 14 11:39:20.052006 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:20.051963    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" path="/var/lib/kubelet/pods/9302fefe-2de7-4021-97b2-fde85f7a562a/volumes"
Jul 14 11:39:32.657453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.657418    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"]
Jul 14 11:39:32.657884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.657781    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy"
Jul 14 11:39:32.657884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.657791    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy"
Jul 14 11:39:32.657884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.657818    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="041294ce-02bd-4b8a-9542-40779f22a059" containerName="revoke-keys"
Jul 14 11:39:32.657884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.657826    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="041294ce-02bd-4b8a-9542-40779f22a059" containerName="revoke-keys"
Jul 14 11:39:32.658034 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.657934    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="041294ce-02bd-4b8a-9542-40779f22a059" containerName="revoke-keys"
Jul 14 11:39:32.658034 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.657946    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy"
Jul 14 11:39:32.660117 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.660100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.662800 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.662782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 11:39:32.662905 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.662886    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c5ce9ebd-openshift-default-dockercfg-rlb4z\""
Jul 14 11:39:32.677209 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.677187    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"]
Jul 14 11:39:32.831902 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.831866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-podinfo\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.831929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-envoy\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.831958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lgxt\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-kube-api-access-5lgxt\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832067 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.832037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istiod-ca-cert\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832197 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.832069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-token\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832197 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.832096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-data\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832197 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.832110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-credential-socket\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832197 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.832143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-certs\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.832321 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.832198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-socket\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933532 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istiod-ca-cert\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933532 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-token\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933532 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-data\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-credential-socket\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-certs\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-socket\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-podinfo\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-envoy\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.933756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lgxt\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-kube-api-access-5lgxt\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.934066 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.933995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-data\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.934066 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.934029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-socket\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.934201 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.934103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-certs\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.934201 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.934119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-credential-socket\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.934451 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.934428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istiod-ca-cert\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.936071 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.936041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-envoy\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.936244 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.936227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-podinfo\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.946215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.946197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-token\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.951467 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.951439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lgxt\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-kube-api-access-5lgxt\") pod \"e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") " pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:32.969725 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:32.969707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:33.099431 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.099406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"]
Jul 14 11:39:33.101016 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:39:33.100989    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc8dfef_77e7_4cbf_aa59_760809a304ca.slice/crio-d431cfc23adc13a650ed013ee286c6dc9e7bd4125fa4074e95fc8dc09595be28 WatchSource:0}: Error finding container d431cfc23adc13a650ed013ee286c6dc9e7bd4125fa4074e95fc8dc09595be28: Status 404 returned error can't find the container with id d431cfc23adc13a650ed013ee286c6dc9e7bd4125fa4074e95fc8dc09595be28
Jul 14 11:39:33.103248 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.103214    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:39:33.103315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.103284    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:39:33.103350 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.103312    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:39:33.516238 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.516200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" event={"ID":"9fc8dfef-77e7-4cbf-aa59-760809a304ca","Type":"ContainerStarted","Data":"993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567"}
Jul 14 11:39:33.516406 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.516266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" event={"ID":"9fc8dfef-77e7-4cbf-aa59-760809a304ca","Type":"ContainerStarted","Data":"d431cfc23adc13a650ed013ee286c6dc9e7bd4125fa4074e95fc8dc09595be28"}
Jul 14 11:39:33.542520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.542474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" podStartSLOduration=1.542458637 podStartE2EDuration="1.542458637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:39:33.540381085 +0000 UTC m=+1959.993326964" watchObservedRunningTime="2026-07-14 11:39:33.542458637 +0000 UTC m=+1959.995404516"
Jul 14 11:39:33.970169 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:33.970121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:34.974795 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:34.974766    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:35.525915 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:35.525887    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:35.526798 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:35.526780    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:49.600538 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:49.600503    2581 generic.go:356] "Generic (PLEG): container finished" podID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerID="993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567" exitCode=0
Jul 14 11:39:49.600980 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:49.600579    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" event={"ID":"9fc8dfef-77e7-4cbf-aa59-760809a304ca","Type":"ContainerDied","Data":"993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567"}
Jul 14 11:39:49.600980 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:49.600962    2581 scope.go:117] "RemoveContainer" containerID="993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567"
Jul 14 11:39:49.601947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:49.601917    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:39:49.602012 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:49.601985    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:39:49.602056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:49.602014    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:39:50.526376 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:50.526346    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:50.607237 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:50.607203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" event={"ID":"9fc8dfef-77e7-4cbf-aa59-760809a304ca","Type":"ContainerStarted","Data":"36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81"}
Jul 14 11:39:50.970917 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:50.970869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:50.971985 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:50.971956    2581 patch_prober.go:28] interesting pod/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 14 11:39:50.972133 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:50.972029    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 14 11:39:51.970556 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:51.970519    2581 patch_prober.go:28] interesting pod/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 14 11:39:51.970951 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:51.970586    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 14 11:39:52.970348 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:52.970309    2581 patch_prober.go:28] interesting pod/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 14 11:39:52.970552 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:52.970371    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 14 11:39:53.970997 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:53.970962    2581 patch_prober.go:28] interesting pod/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 14 11:39:53.971398 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:53.971013    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 14 11:39:54.974142 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:54.974110    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:54.974555 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:54.974377    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:39:54.975160 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:39:54.975127    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:40:28.708930 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.708897    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"]
Jul 14 11:40:28.709429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.709309    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy"
Jul 14 11:40:28.709429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.709322    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy"
Jul 14 11:40:28.709429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.709406    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9302fefe-2de7-4021-97b2-fde85f7a562a" containerName="istio-proxy"
Jul 14 11:40:28.712472 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.712455    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"
Jul 14 11:40:28.714990 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.714969    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:40:28.715121 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.714977    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:40:28.727864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.727836    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"]
Jul 14 11:40:28.758521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.758483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14a2c7da-d8a7-4882-aa2a-ca65a25120c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96\" (UID: \"14a2c7da-d8a7-4882-aa2a-ca65a25120c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"
Jul 14 11:40:28.858993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.858954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14a2c7da-d8a7-4882-aa2a-ca65a25120c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96\" (UID: \"14a2c7da-d8a7-4882-aa2a-ca65a25120c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"
Jul 14 11:40:28.859618 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:28.859598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14a2c7da-d8a7-4882-aa2a-ca65a25120c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96\" (UID: \"14a2c7da-d8a7-4882-aa2a-ca65a25120c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"
Jul 14 11:40:29.030476 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:29.030389    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"
Jul 14 11:40:29.162110 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:29.162080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"]
Jul 14 11:40:29.164238 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:40:29.164211    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a2c7da_d8a7_4882_aa2a_ca65a25120c9.slice/crio-86e1a42888e9fa8ff5ee54a3b14ed0e0ffc17b653231abebd111c579424e00c5 WatchSource:0}: Error finding container 86e1a42888e9fa8ff5ee54a3b14ed0e0ffc17b653231abebd111c579424e00c5: Status 404 returned error can't find the container with id 86e1a42888e9fa8ff5ee54a3b14ed0e0ffc17b653231abebd111c579424e00c5
Jul 14 11:40:29.812283 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:29.812247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96" event={"ID":"14a2c7da-d8a7-4882-aa2a-ca65a25120c9","Type":"ContainerStarted","Data":"b17ae0350bbe13331399e02bed184f6e1a1d034140a2bf39d62e4a4fb376e2b8"}
Jul 14 11:40:29.812681 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:29.812308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96" event={"ID":"14a2c7da-d8a7-4882-aa2a-ca65a25120c9","Type":"ContainerStarted","Data":"86e1a42888e9fa8ff5ee54a3b14ed0e0ffc17b653231abebd111c579424e00c5"}
Jul 14 11:40:29.828013 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:29.827965    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96" podStartSLOduration=1.827950282 podStartE2EDuration="1.827950282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:40:29.827206844 +0000 UTC m=+2016.280152727" watchObservedRunningTime="2026-07-14 11:40:29.827950282 +0000 UTC m=+2016.280896159"
Jul 14 11:40:30.821672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:30.821635    2581 generic.go:356] "Generic (PLEG): container finished" podID="14a2c7da-d8a7-4882-aa2a-ca65a25120c9" containerID="b17ae0350bbe13331399e02bed184f6e1a1d034140a2bf39d62e4a4fb376e2b8" exitCode=0
Jul 14 11:40:30.822092 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:30.821695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96" event={"ID":"14a2c7da-d8a7-4882-aa2a-ca65a25120c9","Type":"ContainerDied","Data":"b17ae0350bbe13331399e02bed184f6e1a1d034140a2bf39d62e4a4fb376e2b8"}
Jul 14 11:40:31.960939 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:31.960907    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"
Jul 14 11:40:31.985751 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:31.985727    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14a2c7da-d8a7-4882-aa2a-ca65a25120c9-maas-api-service-ca\") pod \"14a2c7da-d8a7-4882-aa2a-ca65a25120c9\" (UID: \"14a2c7da-d8a7-4882-aa2a-ca65a25120c9\") "
Jul 14 11:40:31.986063 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:31.986041    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14a2c7da-d8a7-4882-aa2a-ca65a25120c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14a2c7da-d8a7-4882-aa2a-ca65a25120c9" (UID: "14a2c7da-d8a7-4882-aa2a-ca65a25120c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:40:32.086818 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:32.086737    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14a2c7da-d8a7-4882-aa2a-ca65a25120c9-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:40:32.833187 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:32.833139    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96"
Jul 14 11:40:32.833353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:32.833143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96" event={"ID":"14a2c7da-d8a7-4882-aa2a-ca65a25120c9","Type":"ContainerDied","Data":"86e1a42888e9fa8ff5ee54a3b14ed0e0ffc17b653231abebd111c579424e00c5"}
Jul 14 11:40:32.833353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:32.833283    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86e1a42888e9fa8ff5ee54a3b14ed0e0ffc17b653231abebd111c579424e00c5"
Jul 14 11:40:54.174100 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:40:54.174068    2581 scope.go:117] "RemoveContainer" containerID="2529e37f063aa322d76fa34ad45270240b6d2bc41e44e7cf7c2c219de0673323"
Jul 14 11:41:54.194060 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:41:54.194026    2581 scope.go:117] "RemoveContainer" containerID="f1dcfc179a0573c35a28454462e13e03a234974c659c372b7f65f318f853192c"
Jul 14 11:41:56.207094 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:41:56.207052    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"]
Jul 14 11:41:56.207586 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:41:56.207278    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy" containerID="cri-o://36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81" gracePeriod=30
Jul 14 11:42:01.461856 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.461822    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:42:01.493826 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.493752    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-credential-socket\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.493826 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.493791    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-certs\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.493852    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istiod-ca-cert\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.493875    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-podinfo\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.493909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lgxt\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-kube-api-access-5lgxt\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.493956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-envoy\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.493987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-socket\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494018    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-token\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494043    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-data\") pod \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\" (UID: \"9fc8dfef-77e7-4cbf-aa59-760809a304ca\") "
Jul 14 11:42:01.494355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:42:01.494355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494179    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:42:01.494355 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494309    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:42:01.494557 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494350    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:42:01.494557 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494454    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.494557 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494473    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.494557 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494488    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.494557 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.494503    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.495263 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.495239    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:42:01.496431 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.496408    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:42:01.496726 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.496697    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:42:01.496828 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.496743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:42:01.496828 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.496776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-kube-api-access-5lgxt" (OuterVolumeSpecName: "kube-api-access-5lgxt") pod "9fc8dfef-77e7-4cbf-aa59-760809a304ca" (UID: "9fc8dfef-77e7-4cbf-aa59-760809a304ca"). InnerVolumeSpecName "kube-api-access-5lgxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:42:01.594930 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.594900    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.594930 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.594924    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lgxt\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-kube-api-access-5lgxt\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.595092 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.594935    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.595092 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.594945    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:01.595092 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:01.594952    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fc8dfef-77e7-4cbf-aa59-760809a304ca-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:42:02.286597 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.286560    2581 generic.go:356] "Generic (PLEG): container finished" podID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerID="36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81" exitCode=0
Jul 14 11:42:02.286744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.286601    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"
Jul 14 11:42:02.286744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.286606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" event={"ID":"9fc8dfef-77e7-4cbf-aa59-760809a304ca","Type":"ContainerDied","Data":"36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81"}
Jul 14 11:42:02.286744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.286675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz" event={"ID":"9fc8dfef-77e7-4cbf-aa59-760809a304ca","Type":"ContainerDied","Data":"d431cfc23adc13a650ed013ee286c6dc9e7bd4125fa4074e95fc8dc09595be28"}
Jul 14 11:42:02.286744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.286699    2581 scope.go:117] "RemoveContainer" containerID="36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81"
Jul 14 11:42:02.295516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.295501    2581 scope.go:117] "RemoveContainer" containerID="993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567"
Jul 14 11:42:02.303049 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.303032    2581 scope.go:117] "RemoveContainer" containerID="36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81"
Jul 14 11:42:02.303583 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:42:02.303560    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81\": container with ID starting with 36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81 not found: ID does not exist" containerID="36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81"
Jul 14 11:42:02.303681 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.303590    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81"} err="failed to get container status \"36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81\": rpc error: code = NotFound desc = could not find container \"36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81\": container with ID starting with 36bceaeaadf9790ade0f093f6d5fbc5654ae22847cfaae11f962e4e7ef439d81 not found: ID does not exist"
Jul 14 11:42:02.303681 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.303612    2581 scope.go:117] "RemoveContainer" containerID="993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567"
Jul 14 11:42:02.303879 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:42:02.303861    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567\": container with ID starting with 993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567 not found: ID does not exist" containerID="993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567"
Jul 14 11:42:02.303921 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.303885    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567"} err="failed to get container status \"993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567\": rpc error: code = NotFound desc = could not find container \"993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567\": container with ID starting with 993663a2f1406f4b84e3846096b81750377ed232fff24b7304d28bd6c0872567 not found: ID does not exist"
Jul 14 11:42:02.308622 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.308602    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"]
Jul 14 11:42:02.312747 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:02.312703    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c5ce9ebd-openshift-default-78669445cf-96vdz"]
Jul 14 11:42:04.051913 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:04.051871    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" path="/var/lib/kubelet/pods/9fc8dfef-77e7-4cbf-aa59-760809a304ca/volumes"
Jul 14 11:42:51.523194 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523094    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"]
Jul 14 11:42:51.523724 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523710    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy"
Jul 14 11:42:51.523797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523732    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy"
Jul 14 11:42:51.523797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523750    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a2c7da-d8a7-4882-aa2a-ca65a25120c9" containerName="revoke-keys"
Jul 14 11:42:51.523797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523759    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a2c7da-d8a7-4882-aa2a-ca65a25120c9" containerName="revoke-keys"
Jul 14 11:42:51.523797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523777    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy"
Jul 14 11:42:51.523797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523786    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy"
Jul 14 11:42:51.524042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523868    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a2c7da-d8a7-4882-aa2a-ca65a25120c9" containerName="revoke-keys"
Jul 14 11:42:51.524042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523882    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy"
Jul 14 11:42:51.524042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.523894    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc8dfef-77e7-4cbf-aa59-760809a304ca" containerName="istio-proxy"
Jul 14 11:42:51.527101 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.527078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.529742 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.529721    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 11:42:51.529904 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.529886    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1b0afa-openshift-default-dockercfg-v89wc\""
Jul 14 11:42:51.540036 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.540011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"]
Jul 14 11:42:51.543532 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-data\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-socket\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543668 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-certs\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543707 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwbs4\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-kube-api-access-vwbs4\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543766 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-credential-socket\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543875 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-token\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543875 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-podinfo\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istiod-ca-cert\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.543961 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.543924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-envoy\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644575 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-data\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644575 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-socket\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-certs\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwbs4\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-kube-api-access-vwbs4\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-credential-socket\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-token\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644712    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-podinfo\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istiod-ca-cert\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.644852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.644783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-envoy\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.645215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.645021    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-data\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.645215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.645081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-certs\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.645215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.645114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-credential-socket\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.645215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.645183    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-socket\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.645585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.645549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istiod-ca-cert\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.647085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.647064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-envoy\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.647195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.647115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-podinfo\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.652856 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.652832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-token\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.653065 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.653048    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwbs4\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-kube-api-access-vwbs4\") pod \"e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") " pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.837279 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.837245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:51.977018 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.976985    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"]
Jul 14 11:42:51.978352 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:42:51.978324    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34b9b1d_18dd_48c2_b5d6_b6045d49adba.slice/crio-b8ef985931c98fc399d1a4a1958aff622e30564fccde5f62fb35d5d961e7ce88 WatchSource:0}: Error finding container b8ef985931c98fc399d1a4a1958aff622e30564fccde5f62fb35d5d961e7ce88: Status 404 returned error can't find the container with id b8ef985931c98fc399d1a4a1958aff622e30564fccde5f62fb35d5d961e7ce88
Jul 14 11:42:51.980924 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.980892    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:42:51.981021 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.980964    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:42:51.981021 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:51.981003    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:42:52.543340 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:52.543304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" event={"ID":"f34b9b1d-18dd-48c2-b5d6-b6045d49adba","Type":"ContainerStarted","Data":"2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32"}
Jul 14 11:42:52.543739 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:52.543365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" event={"ID":"f34b9b1d-18dd-48c2-b5d6-b6045d49adba","Type":"ContainerStarted","Data":"b8ef985931c98fc399d1a4a1958aff622e30564fccde5f62fb35d5d961e7ce88"}
Jul 14 11:42:52.566206 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:52.566131    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podStartSLOduration=1.566115812 podStartE2EDuration="1.566115812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:42:52.564026419 +0000 UTC m=+2159.016972308" watchObservedRunningTime="2026-07-14 11:42:52.566115812 +0000 UTC m=+2159.019061690"
Jul 14 11:42:52.837390 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:52.837357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:53.843404 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:53.843369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:54.554553 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:54.554525    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:54.555619 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:54.555597    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:42:59.684544 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.684509    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"]
Jul 14 11:42:59.688333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.688310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.692044 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.692020    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f85160-openshift-default-dockercfg-9zvtg\""
Jul 14 11:42:59.701776 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.701756    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"]
Jul 14 11:42:59.720812 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.720788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfv7\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-kube-api-access-jgfv7\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.720903 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.720826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-credential-socket\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.720903 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.720847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-token\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.720903 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.720869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d555ac-580e-4112-9ba8-bbfefcd845b5-istiod-ca-cert\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.720903 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.720899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-certs\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.721075 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.720921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-socket\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.721075 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.721001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-data\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.721075 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.721033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-envoy\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.721075 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.721056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-podinfo\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.821852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.821818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-certs\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.821852 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.821858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-socket\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.821906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-data\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.821928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-envoy\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.821955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-podinfo\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.821998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfv7\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-kube-api-access-jgfv7\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822338 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-credential-socket\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822338 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-token\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822338 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-certs\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822338 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d555ac-580e-4112-9ba8-bbfefcd845b5-istiod-ca-cert\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822338 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-data\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822600 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-socket\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822600 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-credential-socket\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.822946 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.822928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d555ac-580e-4112-9ba8-bbfefcd845b5-istiod-ca-cert\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.824235 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.824215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-envoy\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.824642 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.824617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-podinfo\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.833074 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.833054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-token\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.833730 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.833709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfv7\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-kube-api-access-jgfv7\") pod \"e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") " pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:42:59.999210 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:42:59.999105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:00.139078 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.139050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"]
Jul 14 11:43:00.139894 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:43:00.139790    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d555ac_580e_4112_9ba8_bbfefcd845b5.slice/crio-454acb338dda9e1e4d55ff72b71770d21143e1fa099ca284518551ff38677910 WatchSource:0}: Error finding container 454acb338dda9e1e4d55ff72b71770d21143e1fa099ca284518551ff38677910: Status 404 returned error can't find the container with id 454acb338dda9e1e4d55ff72b71770d21143e1fa099ca284518551ff38677910
Jul 14 11:43:00.141895 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.141862    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:00.141991 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.141937    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:00.142058 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.141987    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:00.586128 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.586094    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" event={"ID":"12d555ac-580e-4112-9ba8-bbfefcd845b5","Type":"ContainerStarted","Data":"64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391"}
Jul 14 11:43:00.586320 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.586165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" event={"ID":"12d555ac-580e-4112-9ba8-bbfefcd845b5","Type":"ContainerStarted","Data":"454acb338dda9e1e4d55ff72b71770d21143e1fa099ca284518551ff38677910"}
Jul 14 11:43:00.619390 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.619344    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" podStartSLOduration=1.619326074 podStartE2EDuration="1.619326074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:43:00.617430014 +0000 UTC m=+2167.070375915" watchObservedRunningTime="2026-07-14 11:43:00.619326074 +0000 UTC m=+2167.072271953"
Jul 14 11:43:00.999744 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:00.999664    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:02.004158 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:02.004108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:02.597698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:02.597672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:02.598686 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:02.598667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:10.596346 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:10.596304    2581 patch_prober.go:28] interesting pod/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 11:43:10.598215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:10.596362    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 11:43:11.658930 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:11.658890    2581 generic.go:356] "Generic (PLEG): container finished" podID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerID="2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32" exitCode=0
Jul 14 11:43:11.659404 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:11.659025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" event={"ID":"f34b9b1d-18dd-48c2-b5d6-b6045d49adba","Type":"ContainerDied","Data":"2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32"}
Jul 14 11:43:11.659575 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:11.659555    2581 scope.go:117] "RemoveContainer" containerID="2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32"
Jul 14 11:43:11.660748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:11.660713    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:11.660844 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:11.660784    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:11.660844 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:11.660825    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:12.669816 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:12.669768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" event={"ID":"f34b9b1d-18dd-48c2-b5d6-b6045d49adba","Type":"ContainerStarted","Data":"ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88"}
Jul 14 11:43:12.838367 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:12.838327    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:43:12.838760 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:12.838666    2581 patch_prober.go:28] interesting pod/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 11:43:12.838942 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:12.838921    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 11:43:13.837750 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:13.837714    2581 patch_prober.go:28] interesting pod/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 11:43:13.838773 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:13.838326    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 11:43:14.837929 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:14.837883    2581 patch_prober.go:28] interesting pod/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 11:43:14.838451 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:14.837965    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 11:43:15.837802 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:15.837758    2581 patch_prober.go:28] interesting pod/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 11:43:15.838000 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:15.837835    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 11:43:16.842380 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:16.842341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:43:16.842876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:16.842730    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:43:16.843612 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:16.843588    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:43:17.599494 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.599413    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 14 11:43:17.599494 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.599472    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 14 11:43:17.702556 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.702528    2581 generic.go:356] "Generic (PLEG): container finished" podID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerID="64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391" exitCode=0
Jul 14 11:43:17.702730 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.702617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" event={"ID":"12d555ac-580e-4112-9ba8-bbfefcd845b5","Type":"ContainerDied","Data":"64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391"}
Jul 14 11:43:17.703089 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.703076    2581 scope.go:117] "RemoveContainer" containerID="64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391"
Jul 14 11:43:17.704065 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.704036    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:17.704176 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.704137    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:17.704246 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:17.704209    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:43:18.710005 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:18.709973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" event={"ID":"12d555ac-580e-4112-9ba8-bbfefcd845b5","Type":"ContainerStarted","Data":"45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e"}
Jul 14 11:43:18.999897 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:18.999810    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:19.000055 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:19.000002    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 14 11:43:19.000099 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:19.000051    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 14 11:43:20.000467 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:20.000434    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 14 11:43:20.000864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:20.000505    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 14 11:43:21.000419 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:21.000384    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 14 11:43:21.000602 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:21.000440    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 14 11:43:21.999734 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:21.999695    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 14 11:43:21.999908 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:21.999749    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 14 11:43:23.004142 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:23.004107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:23.004631 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:23.004428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:43:23.005050 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:43:23.005031    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:44:01.794461 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:01.794423    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"]
Jul 14 11:44:01.796869 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:01.796852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"
Jul 14 11:44:01.799388 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:01.799364    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:44:01.799512 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:01.799366    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:44:01.805651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:01.805627    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"]
Jul 14 11:44:01.932278 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:01.932249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca665413-a6b3-4590-abe0-22036e975127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t\" (UID: \"ca665413-a6b3-4590-abe0-22036e975127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"
Jul 14 11:44:02.033376 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:02.033336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca665413-a6b3-4590-abe0-22036e975127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t\" (UID: \"ca665413-a6b3-4590-abe0-22036e975127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"
Jul 14 11:44:02.033943 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:02.033925    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca665413-a6b3-4590-abe0-22036e975127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t\" (UID: \"ca665413-a6b3-4590-abe0-22036e975127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"
Jul 14 11:44:02.110652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:02.110602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"
Jul 14 11:44:02.243236 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:02.243211    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"]
Jul 14 11:44:02.245575 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:44:02.245547    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca665413_a6b3_4590_abe0_22036e975127.slice/crio-afa021824ae03638fd9317cae9190af5195d7c2fd0f5295c175559498b8876a2 WatchSource:0}: Error finding container afa021824ae03638fd9317cae9190af5195d7c2fd0f5295c175559498b8876a2: Status 404 returned error can't find the container with id afa021824ae03638fd9317cae9190af5195d7c2fd0f5295c175559498b8876a2
Jul 14 11:44:02.937962 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:02.937914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t" event={"ID":"ca665413-a6b3-4590-abe0-22036e975127","Type":"ContainerStarted","Data":"c7f1b2c2ab931908031f18c803df4417cdfd2bc0a23b814f20965908e727baab"}
Jul 14 11:44:02.938366 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:02.937981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t" event={"ID":"ca665413-a6b3-4590-abe0-22036e975127","Type":"ContainerStarted","Data":"afa021824ae03638fd9317cae9190af5195d7c2fd0f5295c175559498b8876a2"}
Jul 14 11:44:02.955971 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:02.955920    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t" podStartSLOduration=1.955903879 podStartE2EDuration="1.955903879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:44:02.955370935 +0000 UTC m=+2229.408316836" watchObservedRunningTime="2026-07-14 11:44:02.955903879 +0000 UTC m=+2229.408849748"
Jul 14 11:44:03.946916 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:03.946877    2581 generic.go:356] "Generic (PLEG): container finished" podID="ca665413-a6b3-4590-abe0-22036e975127" containerID="c7f1b2c2ab931908031f18c803df4417cdfd2bc0a23b814f20965908e727baab" exitCode=0
Jul 14 11:44:03.947335 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:03.946966    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t" event={"ID":"ca665413-a6b3-4590-abe0-22036e975127","Type":"ContainerDied","Data":"c7f1b2c2ab931908031f18c803df4417cdfd2bc0a23b814f20965908e727baab"}
Jul 14 11:44:05.087960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:05.087933    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"
Jul 14 11:44:05.262971 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:05.262894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca665413-a6b3-4590-abe0-22036e975127-maas-api-service-ca\") pod \"ca665413-a6b3-4590-abe0-22036e975127\" (UID: \"ca665413-a6b3-4590-abe0-22036e975127\") "
Jul 14 11:44:05.263348 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:05.263305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca665413-a6b3-4590-abe0-22036e975127-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca665413-a6b3-4590-abe0-22036e975127" (UID: "ca665413-a6b3-4590-abe0-22036e975127"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:44:05.364494 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:05.364470    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca665413-a6b3-4590-abe0-22036e975127-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:05.959210 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:05.959183    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t"
Jul 14 11:44:05.959357 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:05.959181    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t" event={"ID":"ca665413-a6b3-4590-abe0-22036e975127","Type":"ContainerDied","Data":"afa021824ae03638fd9317cae9190af5195d7c2fd0f5295c175559498b8876a2"}
Jul 14 11:44:05.959357 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:05.959315    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afa021824ae03638fd9317cae9190af5195d7c2fd0f5295c175559498b8876a2"
Jul 14 11:44:27.589527 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:27.589441    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"]
Jul 14 11:44:27.589996 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:27.589696    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy" containerID="cri-o://ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88" gracePeriod=30
Jul 14 11:44:31.845097 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:31.845060    2581 patch_prober.go:28] interesting pod/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 11:44:31.845547 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:31.845139    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 11:44:32.857085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:32.857024    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:44:33.017858 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.017827    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-podinfo\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018037 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.017897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-data\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018037 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.017937    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-token\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018037 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.017959    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-envoy\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018037 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018000    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-credential-socket\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018277 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018144    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istiod-ca-cert\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018277 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018230    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-socket\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018384 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:33.018384 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018323    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-certs\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018384 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018353    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwbs4\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-kube-api-access-vwbs4\") pod \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\" (UID: \"f34b9b1d-18dd-48c2-b5d6-b6045d49adba\") "
Jul 14 11:44:33.018537 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018513    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:33.018748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018698    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.018748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018562    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:44:33.018870 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.018768    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:33.019080 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.019053    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-data" (OuterVolumeSpecName: "istio-data") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:33.020217 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.020191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:33.020217 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.020202    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:44:33.020337 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.020234    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-token" (OuterVolumeSpecName: "istio-token") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:44:33.020669 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.020655    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-kube-api-access-vwbs4" (OuterVolumeSpecName: "kube-api-access-vwbs4") pod "f34b9b1d-18dd-48c2-b5d6-b6045d49adba" (UID: "f34b9b1d-18dd-48c2-b5d6-b6045d49adba"). InnerVolumeSpecName "kube-api-access-vwbs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:44:33.104056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.104022    2581 generic.go:356] "Generic (PLEG): container finished" podID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerID="ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88" exitCode=0
Jul 14 11:44:33.104251 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.104070    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"
Jul 14 11:44:33.104251 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.104103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" event={"ID":"f34b9b1d-18dd-48c2-b5d6-b6045d49adba","Type":"ContainerDied","Data":"ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88"}
Jul 14 11:44:33.104251 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.104170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s" event={"ID":"f34b9b1d-18dd-48c2-b5d6-b6045d49adba","Type":"ContainerDied","Data":"b8ef985931c98fc399d1a4a1958aff622e30564fccde5f62fb35d5d961e7ce88"}
Jul 14 11:44:33.104251 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.104192    2581 scope.go:117] "RemoveContainer" containerID="ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88"
Jul 14 11:44:33.113824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.113810    2581 scope.go:117] "RemoveContainer" containerID="2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32"
Jul 14 11:44:33.120074 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120053    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.120074 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120076    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.120220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120085    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.120220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120093    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.120220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120102    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.120220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120109    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.120220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120117    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.120220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.120126    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwbs4\" (UniqueName: \"kubernetes.io/projected/f34b9b1d-18dd-48c2-b5d6-b6045d49adba-kube-api-access-vwbs4\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:33.121977 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.121965    2581 scope.go:117] "RemoveContainer" containerID="ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88"
Jul 14 11:44:33.122224 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:44:33.122199    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88\": container with ID starting with ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88 not found: ID does not exist" containerID="ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88"
Jul 14 11:44:33.122287 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.122232    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88"} err="failed to get container status \"ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88\": rpc error: code = NotFound desc = could not find container \"ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88\": container with ID starting with ca5bf96ebdf434fad4983b2ee5ee3a794d5a09ef053c5bf48528ac5006ccdd88 not found: ID does not exist"
Jul 14 11:44:33.122287 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.122249    2581 scope.go:117] "RemoveContainer" containerID="2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32"
Jul 14 11:44:33.122480 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:44:33.122464    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32\": container with ID starting with 2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32 not found: ID does not exist" containerID="2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32"
Jul 14 11:44:33.122521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.122485    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32"} err="failed to get container status \"2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32\": rpc error: code = NotFound desc = could not find container \"2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32\": container with ID starting with 2cfb33700d77f14ee9590bcebafe32459ad699524840b114ea56ab9700959a32 not found: ID does not exist"
Jul 14 11:44:33.126808 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.126789    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"]
Jul 14 11:44:33.130701 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:33.130678    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1b0afa-openshift-default-79595586c-6lw2s"]
Jul 14 11:44:34.051833 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:34.051797    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" path="/var/lib/kubelet/pods/f34b9b1d-18dd-48c2-b5d6-b6045d49adba/volumes"
Jul 14 11:44:53.782508 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:53.782470    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"]
Jul 14 11:44:53.782925 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:53.782712    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy" containerID="cri-o://45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e" gracePeriod=30
Jul 14 11:44:54.700796 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.700767    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"]
Jul 14 11:44:54.701215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701200    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy"
Jul 14 11:44:54.701265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701217    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy"
Jul 14 11:44:54.701265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701225    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca665413-a6b3-4590-abe0-22036e975127" containerName="revoke-keys"
Jul 14 11:44:54.701265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701233    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca665413-a6b3-4590-abe0-22036e975127" containerName="revoke-keys"
Jul 14 11:44:54.701265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701244    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy"
Jul 14 11:44:54.701265 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701251    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy"
Jul 14 11:44:54.701424 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701336    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy"
Jul 14 11:44:54.701424 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701345    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34b9b1d-18dd-48c2-b5d6-b6045d49adba" containerName="istio-proxy"
Jul 14 11:44:54.701424 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.701350    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca665413-a6b3-4590-abe0-22036e975127" containerName="revoke-keys"
Jul 14 11:44:54.705931 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.705913    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.708540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.708521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-bb21d4-openshift-default-dockercfg-x79jd\""
Jul 14 11:44:54.717316 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.717294    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"]
Jul 14 11:44:54.802275 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-socket\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvxf\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-kube-api-access-qdvxf\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-envoy\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-credential-socket\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-data\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47737e64-c7ff-4e95-88ca-c5d722050899-istio-podinfo\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47737e64-c7ff-4e95-88ca-c5d722050899-istiod-ca-cert\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-certs\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.802652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.802580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-istio-token\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.903845 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.903809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-istio-token\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904038 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.903855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-socket\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904038 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.903887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvxf\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-kube-api-access-qdvxf\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904038 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.903913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-envoy\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904038 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.903975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-credential-socket\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904284 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-data\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904284 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47737e64-c7ff-4e95-88ca-c5d722050899-istio-podinfo\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904284 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47737e64-c7ff-4e95-88ca-c5d722050899-istiod-ca-cert\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904445 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-certs\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904445 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-socket\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904445 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-credential-socket\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904591 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-data\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904647 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-certs\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.904871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.904852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47737e64-c7ff-4e95-88ca-c5d722050899-istiod-ca-cert\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.906329 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.906310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-envoy\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.906667 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.906645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47737e64-c7ff-4e95-88ca-c5d722050899-istio-podinfo\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.914085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.914065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvxf\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-kube-api-access-qdvxf\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:54.914195 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:54.914064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-istio-token\") pod \"e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") " pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:55.019007 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:55.018929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:55.159073 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:55.159044    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"]
Jul 14 11:44:55.160518 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:44:55.160487    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47737e64_c7ff_4e95_88ca_c5d722050899.slice/crio-29b47e5d4b1a79dc835de246ba69446e870a48dd45ba7c33b88c7a137d99c8d0 WatchSource:0}: Error finding container 29b47e5d4b1a79dc835de246ba69446e870a48dd45ba7c33b88c7a137d99c8d0: Status 404 returned error can't find the container with id 29b47e5d4b1a79dc835de246ba69446e870a48dd45ba7c33b88c7a137d99c8d0
Jul 14 11:44:55.162725 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:55.162690    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:44:55.162827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:55.162754    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:44:55.162827 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:55.162783    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:44:55.223318 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:55.223288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" event={"ID":"47737e64-c7ff-4e95-88ca-c5d722050899","Type":"ContainerStarted","Data":"29b47e5d4b1a79dc835de246ba69446e870a48dd45ba7c33b88c7a137d99c8d0"}
Jul 14 11:44:56.235797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:56.235760    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" event={"ID":"47737e64-c7ff-4e95-88ca-c5d722050899","Type":"ContainerStarted","Data":"93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0"}
Jul 14 11:44:56.260379 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:56.260332    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" podStartSLOduration=2.260318377 podStartE2EDuration="2.260318377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:44:56.258104599 +0000 UTC m=+2282.711050478" watchObservedRunningTime="2026-07-14 11:44:56.260318377 +0000 UTC m=+2282.713264323"
Jul 14 11:44:57.019506 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:57.019466    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:57.024379 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:57.024355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:57.241072 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:57.241048    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:57.241887 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:57.241869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:44:59.042448 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.042419    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:44:59.144118 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144042    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-credential-socket\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144118 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144078    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgfv7\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-kube-api-access-jgfv7\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144184    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-envoy\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d555ac-580e-4112-9ba8-bbfefcd845b5-istiod-ca-cert\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144253    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-token\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144292    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-certs\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144330 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-data\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144594 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144356    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-socket\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144594 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144377    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:59.144594 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-podinfo\") pod \"12d555ac-580e-4112-9ba8-bbfefcd845b5\" (UID: \"12d555ac-580e-4112-9ba8-bbfefcd845b5\") "
Jul 14 11:44:59.144754 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144734    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:59.144816 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.144757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d555ac-580e-4112-9ba8-bbfefcd845b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:44:59.145234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.145034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:59.145234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.145098    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.145234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.145142    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:59.145234 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.145182    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.146540 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.146506    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-kube-api-access-jgfv7" (OuterVolumeSpecName: "kube-api-access-jgfv7") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "kube-api-access-jgfv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:44:59.146941 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.146910    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:44:59.147019 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.146967    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:44:59.147019 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.146994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12d555ac-580e-4112-9ba8-bbfefcd845b5" (UID: "12d555ac-580e-4112-9ba8-bbfefcd845b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:44:59.245958 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.245928    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12d555ac-580e-4112-9ba8-bbfefcd845b5-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.245958 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.245954    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.245958 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.245963    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.246205 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.245971    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.246205 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.245979    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.246205 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.245990    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgfv7\" (UniqueName: \"kubernetes.io/projected/12d555ac-580e-4112-9ba8-bbfefcd845b5-kube-api-access-jgfv7\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.246205 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.245999    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12d555ac-580e-4112-9ba8-bbfefcd845b5-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:44:59.252323 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.252288    2581 generic.go:356] "Generic (PLEG): container finished" podID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerID="45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e" exitCode=0
Jul 14 11:44:59.252456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.252330    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"
Jul 14 11:44:59.252456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.252363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" event={"ID":"12d555ac-580e-4112-9ba8-bbfefcd845b5","Type":"ContainerDied","Data":"45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e"}
Jul 14 11:44:59.252456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.252424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv" event={"ID":"12d555ac-580e-4112-9ba8-bbfefcd845b5","Type":"ContainerDied","Data":"454acb338dda9e1e4d55ff72b71770d21143e1fa099ca284518551ff38677910"}
Jul 14 11:44:59.252456 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.252455    2581 scope.go:117] "RemoveContainer" containerID="45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e"
Jul 14 11:44:59.262050 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.262034    2581 scope.go:117] "RemoveContainer" containerID="64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391"
Jul 14 11:44:59.270731 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.270715    2581 scope.go:117] "RemoveContainer" containerID="45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e"
Jul 14 11:44:59.270971 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:44:59.270951    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e\": container with ID starting with 45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e not found: ID does not exist" containerID="45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e"
Jul 14 11:44:59.271044 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.270983    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e"} err="failed to get container status \"45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e\": rpc error: code = NotFound desc = could not find container \"45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e\": container with ID starting with 45d98a88992922271b63ce5ea60f1a96954b8481b5465a9330dd8e26ec858b2e not found: ID does not exist"
Jul 14 11:44:59.271044 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.271006    2581 scope.go:117] "RemoveContainer" containerID="64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391"
Jul 14 11:44:59.271292 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:44:59.271275    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391\": container with ID starting with 64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391 not found: ID does not exist" containerID="64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391"
Jul 14 11:44:59.271331 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.271298    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391"} err="failed to get container status \"64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391\": rpc error: code = NotFound desc = could not find container \"64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391\": container with ID starting with 64ba7630a09a50215dbc2f24ac28d45dc9173b3e213f89180b18a72cf46b5391 not found: ID does not exist"
Jul 14 11:44:59.282621 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.282574    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"]
Jul 14 11:44:59.286124 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:44:59.286101    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f85160-openshift-default-7f4b99cfd7-8f8dv"]
Jul 14 11:45:00.051958 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.051923    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" path="/var/lib/kubelet/pods/12d555ac-580e-4112-9ba8-bbfefcd845b5/volumes"
Jul 14 11:45:00.128563 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.128532    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k"]
Jul 14 11:45:00.128934 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.128922    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy"
Jul 14 11:45:00.128973 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.128936    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy"
Jul 14 11:45:00.128973 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.128947    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy"
Jul 14 11:45:00.128973 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.128952    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy"
Jul 14 11:45:00.129086 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.129014    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy"
Jul 14 11:45:00.129086 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.129023    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d555ac-580e-4112-9ba8-bbfefcd845b5" containerName="istio-proxy"
Jul 14 11:45:00.133811 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.133791    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"]
Jul 14 11:45:00.133951 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.133899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k"
Jul 14 11:45:00.136333 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.136315    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jtnsf\""
Jul 14 11:45:00.137246 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.137229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"
Jul 14 11:45:00.142192 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.142017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k"]
Jul 14 11:45:00.144873 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.144838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"]
Jul 14 11:45:00.147350 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.147329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k"
Jul 14 11:45:00.155240 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.155218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"
Jul 14 11:45:00.295322 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.295280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k"]
Jul 14 11:45:00.298507 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:45:00.298475    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098bca83_34b1_4b1c_8f47_75fd0ab3358d.slice/crio-3368a0006653acfa01366c8462fc33dc654f4d8b28a8130aa490faad44665df5 WatchSource:0}: Error finding container 3368a0006653acfa01366c8462fc33dc654f4d8b28a8130aa490faad44665df5: Status 404 returned error can't find the container with id 3368a0006653acfa01366c8462fc33dc654f4d8b28a8130aa490faad44665df5
Jul 14 11:45:00.528855 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:00.528824    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"]
Jul 14 11:45:00.530636 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:45:00.530602    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bf4ee8_ed8b_4fcd_9e04_cc2339ec2462.slice/crio-2a0530f83a8131cd5ef4454fb9fe779826b0b34bebe3f2926eb282f41e4074eb WatchSource:0}: Error finding container 2a0530f83a8131cd5ef4454fb9fe779826b0b34bebe3f2926eb282f41e4074eb: Status 404 returned error can't find the container with id 2a0530f83a8131cd5ef4454fb9fe779826b0b34bebe3f2926eb282f41e4074eb
Jul 14 11:45:01.266273 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:01.266241    2581 generic.go:356] "Generic (PLEG): container finished" podID="098bca83-34b1-4b1c-8f47-75fd0ab3358d" containerID="2f752258f6a5b8977e7dbb40c4640ef5e9e886d48c813c069c4fd12c0342db1a" exitCode=0
Jul 14 11:45:01.266606 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:01.266312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k" event={"ID":"098bca83-34b1-4b1c-8f47-75fd0ab3358d","Type":"ContainerDied","Data":"2f752258f6a5b8977e7dbb40c4640ef5e9e886d48c813c069c4fd12c0342db1a"}
Jul 14 11:45:01.266606 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:01.266389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k" event={"ID":"098bca83-34b1-4b1c-8f47-75fd0ab3358d","Type":"ContainerStarted","Data":"3368a0006653acfa01366c8462fc33dc654f4d8b28a8130aa490faad44665df5"}
Jul 14 11:45:01.267860 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:01.267838    2581 generic.go:356] "Generic (PLEG): container finished" podID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerID="946fb24f3c4db34b8512b3e4f388a37a905fd3a28b154349e9cf93625461ae9a" exitCode=7
Jul 14 11:45:01.267951 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:01.267868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" event={"ID":"36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462","Type":"ContainerDied","Data":"946fb24f3c4db34b8512b3e4f388a37a905fd3a28b154349e9cf93625461ae9a"}
Jul 14 11:45:01.267951 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:01.267899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" event={"ID":"36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462","Type":"ContainerStarted","Data":"2a0530f83a8131cd5ef4454fb9fe779826b0b34bebe3f2926eb282f41e4074eb"}
Jul 14 11:45:01.268088 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:01.268069    2581 scope.go:117] "RemoveContainer" containerID="946fb24f3c4db34b8512b3e4f388a37a905fd3a28b154349e9cf93625461ae9a"
Jul 14 11:45:02.274368 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:02.274287    2581 generic.go:356] "Generic (PLEG): container finished" podID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerID="f77f94494c3989251bd4fdb9ab31fed0ed03bc4cc06ee5dba9dba8827a0d9db8" exitCode=7
Jul 14 11:45:02.274757 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:02.274369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" event={"ID":"36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462","Type":"ContainerDied","Data":"f77f94494c3989251bd4fdb9ab31fed0ed03bc4cc06ee5dba9dba8827a0d9db8"}
Jul 14 11:45:02.274757 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:02.274426    2581 scope.go:117] "RemoveContainer" containerID="946fb24f3c4db34b8512b3e4f388a37a905fd3a28b154349e9cf93625461ae9a"
Jul 14 11:45:02.274757 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:02.274627    2581 scope.go:117] "RemoveContainer" containerID="f77f94494c3989251bd4fdb9ab31fed0ed03bc4cc06ee5dba9dba8827a0d9db8"
Jul 14 11:45:02.275285 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:45:02.274897    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g_odh-ai-gateway-infra(36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462"
Jul 14 11:45:02.404970 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:02.404940    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k"
Jul 14 11:45:03.280463 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.280433    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k"
Jul 14 11:45:03.280884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.280471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733825-tj69k" event={"ID":"098bca83-34b1-4b1c-8f47-75fd0ab3358d","Type":"ContainerDied","Data":"3368a0006653acfa01366c8462fc33dc654f4d8b28a8130aa490faad44665df5"}
Jul 14 11:45:03.280884 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.280521    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3368a0006653acfa01366c8462fc33dc654f4d8b28a8130aa490faad44665df5"
Jul 14 11:45:03.282388 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.282371    2581 scope.go:117] "RemoveContainer" containerID="f77f94494c3989251bd4fdb9ab31fed0ed03bc4cc06ee5dba9dba8827a0d9db8"
Jul 14 11:45:03.282635 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:45:03.282604    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g_odh-ai-gateway-infra(36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462"
Jul 14 11:45:03.513618 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.513585    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"]
Jul 14 11:45:03.513981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.513968    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="098bca83-34b1-4b1c-8f47-75fd0ab3358d" containerName="cleanup"
Jul 14 11:45:03.513981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.513981    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="098bca83-34b1-4b1c-8f47-75fd0ab3358d" containerName="cleanup"
Jul 14 11:45:03.514100 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.514054    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="098bca83-34b1-4b1c-8f47-75fd0ab3358d" containerName="cleanup"
Jul 14 11:45:03.517421 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.517401    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.520342 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.520323    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-af8cc2-openshift-default-dockercfg-swz7c\""
Jul 14 11:45:03.529876 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.529854    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"]
Jul 14 11:45:03.586701 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-envoy\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.586947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-certs\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.586947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhvg6\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-kube-api-access-qhvg6\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.586947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-socket\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.586947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-credential-socket\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.586947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-podinfo\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.586947 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-token\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.587183 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.586997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e93007f-d27b-4678-ae9c-d0022f803e65-istiod-ca-cert\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.587183 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.587038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-data\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e93007f-d27b-4678-ae9c-d0022f803e65-istiod-ca-cert\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688289 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-data\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-envoy\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-certs\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhvg6\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-kube-api-access-qhvg6\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-socket\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-credential-socket\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-data\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-podinfo\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-token\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688847    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-certs\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.688912 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-socket\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.689023 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.688926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-credential-socket\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.689170 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.689126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e93007f-d27b-4678-ae9c-d0022f803e65-istiod-ca-cert\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.690726 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.690695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-envoy\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.691069 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.691052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-podinfo\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.697577 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.697552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhvg6\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-kube-api-access-qhvg6\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.697659 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.697600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-token\") pod \"e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") " pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:03.828978 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:03.828942    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:04.002034 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.001998    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"]
Jul 14 11:45:04.003162 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:45:04.003124    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e93007f_d27b_4678_ae9c_d0022f803e65.slice/crio-9dcf84687abe4e6b5e6a3666f3e77e40c883bcec79096d5932c8f2ffc1739f5a WatchSource:0}: Error finding container 9dcf84687abe4e6b5e6a3666f3e77e40c883bcec79096d5932c8f2ffc1739f5a: Status 404 returned error can't find the container with id 9dcf84687abe4e6b5e6a3666f3e77e40c883bcec79096d5932c8f2ffc1739f5a
Jul 14 11:45:04.005311 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.005275    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:04.005396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.005340    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:04.005396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.005371    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:04.288960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.288874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" event={"ID":"2e93007f-d27b-4678-ae9c-d0022f803e65","Type":"ContainerStarted","Data":"c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2"}
Jul 14 11:45:04.288960 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.288924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" event={"ID":"2e93007f-d27b-4678-ae9c-d0022f803e65","Type":"ContainerStarted","Data":"9dcf84687abe4e6b5e6a3666f3e77e40c883bcec79096d5932c8f2ffc1739f5a"}
Jul 14 11:45:04.342173 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.339808    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podStartSLOduration=1.3397858519999999 podStartE2EDuration="1.339785852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:45:04.337673184 +0000 UTC m=+2290.790619063" watchObservedRunningTime="2026-07-14 11:45:04.339785852 +0000 UTC m=+2290.792731731"
Jul 14 11:45:04.829614 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:04.829578    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:05.837256 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:05.837225    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:06.299259 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:06.299224    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:06.300365 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:06.300339    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:11.326676 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:11.326642    2581 generic.go:356] "Generic (PLEG): container finished" podID="47737e64-c7ff-4e95-88ca-c5d722050899" containerID="93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0" exitCode=0
Jul 14 11:45:11.327103 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:11.326700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" event={"ID":"47737e64-c7ff-4e95-88ca-c5d722050899","Type":"ContainerDied","Data":"93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0"}
Jul 14 11:45:11.327103 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:11.327062    2581 scope.go:117] "RemoveContainer" containerID="93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0"
Jul 14 11:45:11.328054 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:11.328018    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:11.328181 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:11.328089    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:11.328181 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:11.328125    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:12.241339 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:12.241303    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:45:12.334693 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:12.334660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" event={"ID":"47737e64-c7ff-4e95-88ca-c5d722050899","Type":"ContainerStarted","Data":"2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143"}
Jul 14 11:45:13.019609 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:13.019574    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:45:13.020763 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:13.020736    2581 patch_prober.go:28] interesting pod/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 14 11:45:13.021085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:13.020790    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 14 11:45:14.019740 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:14.019700    2581 patch_prober.go:28] interesting pod/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 14 11:45:14.020226 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:14.019762    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 14 11:45:15.019847 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:15.019813    2581 patch_prober.go:28] interesting pod/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 14 11:45:15.020247 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:15.019873    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 14 11:45:15.046899 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:15.046870    2581 scope.go:117] "RemoveContainer" containerID="f77f94494c3989251bd4fdb9ab31fed0ed03bc4cc06ee5dba9dba8827a0d9db8"
Jul 14 11:45:16.019680 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:16.019642    2581 patch_prober.go:28] interesting pod/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 14 11:45:16.019935 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:16.019699    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 14 11:45:16.369952 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:16.369914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" event={"ID":"36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462","Type":"ContainerStarted","Data":"ab298d3fc5eb773cf200663547515fd2250f4675e602f5c019c01d0bef76ef84"}
Jul 14 11:45:16.392896 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:16.392846    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" podStartSLOduration=16.39283245 podStartE2EDuration="16.39283245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:45:16.391301833 +0000 UTC m=+2302.844247722" watchObservedRunningTime="2026-07-14 11:45:16.39283245 +0000 UTC m=+2302.845778328"
Jul 14 11:45:17.023315 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:17.023281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:45:17.023720 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:17.023656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:45:17.024339 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:17.024319    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:45:17.376756 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:17.376725    2581 generic.go:356] "Generic (PLEG): container finished" podID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerID="ab298d3fc5eb773cf200663547515fd2250f4675e602f5c019c01d0bef76ef84" exitCode=0
Jul 14 11:45:17.376926 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:17.376792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" event={"ID":"36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462","Type":"ContainerDied","Data":"ab298d3fc5eb773cf200663547515fd2250f4675e602f5c019c01d0bef76ef84"}
Jul 14 11:45:17.376926 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:17.376849    2581 scope.go:117] "RemoveContainer" containerID="f77f94494c3989251bd4fdb9ab31fed0ed03bc4cc06ee5dba9dba8827a0d9db8"
Jul 14 11:45:17.411635 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:17.411607    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"]
Jul 14 11:45:18.555171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:18.554292    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"
Jul 14 11:45:19.018520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.018482    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"]
Jul 14 11:45:19.019113 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.019092    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:45:19.019192 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.019118    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:45:19.019235 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.019215    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:45:19.019235 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.019225    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:45:19.019328 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.019316    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:45:19.019371 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.019335    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:45:19.022054 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.022037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"
Jul 14 11:45:19.024703 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.024681    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 11:45:19.028538 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.028489    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"]
Jul 14 11:45:19.162721 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.162681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5a4d3-aea2-47bb-bb02-784d393134ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm\" (UID: \"9bf5a4d3-aea2-47bb-bb02-784d393134ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"
Jul 14 11:45:19.264534 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.264494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5a4d3-aea2-47bb-bb02-784d393134ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm\" (UID: \"9bf5a4d3-aea2-47bb-bb02-784d393134ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"
Jul 14 11:45:19.265134 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.265111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5a4d3-aea2-47bb-bb02-784d393134ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm\" (UID: \"9bf5a4d3-aea2-47bb-bb02-784d393134ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"
Jul 14 11:45:19.333701 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.333665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"
Jul 14 11:45:19.390901 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.390854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g" event={"ID":"36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462","Type":"ContainerDied","Data":"2a0530f83a8131cd5ef4454fb9fe779826b0b34bebe3f2926eb282f41e4074eb"}
Jul 14 11:45:19.391064 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.390913    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a0530f83a8131cd5ef4454fb9fe779826b0b34bebe3f2926eb282f41e4074eb"
Jul 14 11:45:19.391064 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.390872    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"
Jul 14 11:45:19.428706 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.428678    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"]
Jul 14 11:45:19.442172 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.433763    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-bb21d4-29733825-p4s4g"]
Jul 14 11:45:19.510266 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:19.510234    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"]
Jul 14 11:45:19.511693 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:45:19.511663    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf5a4d3_aea2_47bb_bb02_784d393134ff.slice/crio-29c3fd3c9ddcb40651c22b4fc56f432d460250a7329481a12699ae037677383b WatchSource:0}: Error finding container 29c3fd3c9ddcb40651c22b4fc56f432d460250a7329481a12699ae037677383b: Status 404 returned error can't find the container with id 29c3fd3c9ddcb40651c22b4fc56f432d460250a7329481a12699ae037677383b
Jul 14 11:45:20.053096 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:20.053066    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" path="/var/lib/kubelet/pods/36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462/volumes"
Jul 14 11:45:20.398560 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:20.398524    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bf5a4d3-aea2-47bb-bb02-784d393134ff" containerID="6c6456a4ab7e22e215d9c77238cc2458a4b7ccfe92f8ccd6849be2bcec5400d9" exitCode=0
Jul 14 11:45:20.398722 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:20.398619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm" event={"ID":"9bf5a4d3-aea2-47bb-bb02-784d393134ff","Type":"ContainerDied","Data":"6c6456a4ab7e22e215d9c77238cc2458a4b7ccfe92f8ccd6849be2bcec5400d9"}
Jul 14 11:45:20.398722 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:20.398676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm" event={"ID":"9bf5a4d3-aea2-47bb-bb02-784d393134ff","Type":"ContainerStarted","Data":"29c3fd3c9ddcb40651c22b4fc56f432d460250a7329481a12699ae037677383b"}
Jul 14 11:45:21.574891 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:21.574853    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"
Jul 14 11:45:21.690248 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:21.690126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5a4d3-aea2-47bb-bb02-784d393134ff-maas-api-service-ca\") pod \"9bf5a4d3-aea2-47bb-bb02-784d393134ff\" (UID: \"9bf5a4d3-aea2-47bb-bb02-784d393134ff\") "
Jul 14 11:45:21.690590 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:21.690563    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf5a4d3-aea2-47bb-bb02-784d393134ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9bf5a4d3-aea2-47bb-bb02-784d393134ff" (UID: "9bf5a4d3-aea2-47bb-bb02-784d393134ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:45:21.791387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:21.791351    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5a4d3-aea2-47bb-bb02-784d393134ff-maas-api-service-ca\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:22.340400 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:22.340298    2581 patch_prober.go:28] interesting pod/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 11:45:22.340400 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:22.340364    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 11:45:22.412776 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:22.412747    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm"
Jul 14 11:45:22.412970 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:22.412796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm" event={"ID":"9bf5a4d3-aea2-47bb-bb02-784d393134ff","Type":"ContainerDied","Data":"29c3fd3c9ddcb40651c22b4fc56f432d460250a7329481a12699ae037677383b"}
Jul 14 11:45:22.412970 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:22.412841    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29c3fd3c9ddcb40651c22b4fc56f432d460250a7329481a12699ae037677383b"
Jul 14 11:45:23.419869 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:23.419837    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerID="c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2" exitCode=0
Jul 14 11:45:23.420399 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:23.419910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" event={"ID":"2e93007f-d27b-4678-ae9c-d0022f803e65","Type":"ContainerDied","Data":"c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2"}
Jul 14 11:45:23.420467 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:23.420434    2581 scope.go:117] "RemoveContainer" containerID="c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2"
Jul 14 11:45:23.421470 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:23.421439    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:23.421542 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:23.421524    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:23.421589 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:23.421575    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:45:24.427132 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:24.427098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" event={"ID":"2e93007f-d27b-4678-ae9c-d0022f803e65","Type":"ContainerStarted","Data":"237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449"}
Jul 14 11:45:24.829219 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:24.829185    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:24.829482 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:24.829457    2581 patch_prober.go:28] interesting pod/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 14 11:45:24.829529 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:24.829511    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 14 11:45:25.830269 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:25.830234    2581 patch_prober.go:28] interesting pod/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 14 11:45:25.830670 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:25.830296    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 14 11:45:26.830309 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:26.830266    2581 patch_prober.go:28] interesting pod/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 14 11:45:26.830733 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:26.830332    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 14 11:45:27.829898 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:27.829862    2581 patch_prober.go:28] interesting pod/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 14 11:45:27.830081 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:27.829919    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 14 11:45:28.833488 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:28.833455    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:28.833904 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:28.833806    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:28.834413 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:28.834398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:45:44.798453 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:44.798407    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"]
Jul 14 11:45:44.798950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:44.798674    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy" containerID="cri-o://2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143" gracePeriod=30
Jul 14 11:45:47.025291 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:47.025247    2581 patch_prober.go:28] interesting pod/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 11:45:47.025667 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:47.025325    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 11:45:50.065414 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.065338    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:45:50.176514 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176486    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-istio-token\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176522    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-envoy\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176566    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-socket\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176591    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-certs\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176616    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47737e64-c7ff-4e95-88ca-c5d722050899-istio-podinfo\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176685 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47737e64-c7ff-4e95-88ca-c5d722050899-istiod-ca-cert\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176948 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdvxf\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-kube-api-access-qdvxf\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176948 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176750    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-credential-socket\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.176948 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176788    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-data\") pod \"47737e64-c7ff-4e95-88ca-c5d722050899\" (UID: \"47737e64-c7ff-4e95-88ca-c5d722050899\") "
Jul 14 11:45:50.177110 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176936    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:45:50.177201 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.177138    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:45:50.177201 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.176943    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:45:50.177310 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.177237    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.177310 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.177260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47737e64-c7ff-4e95-88ca-c5d722050899-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:45:50.177842 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.177813    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-data" (OuterVolumeSpecName: "istio-data") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:45:50.178859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.178827    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-istio-token" (OuterVolumeSpecName: "istio-token") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:45:50.178969 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.178900    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47737e64-c7ff-4e95-88ca-c5d722050899-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:45:50.178969 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.178927    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-kube-api-access-qdvxf" (OuterVolumeSpecName: "kube-api-access-qdvxf") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "kube-api-access-qdvxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:45:50.179084 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.179064    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "47737e64-c7ff-4e95-88ca-c5d722050899" (UID: "47737e64-c7ff-4e95-88ca-c5d722050899"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:45:50.278740 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278681    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.278740 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278730    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.278740 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278744    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.278740 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278755    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47737e64-c7ff-4e95-88ca-c5d722050899-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.279028 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278767    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47737e64-c7ff-4e95-88ca-c5d722050899-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.279028 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278779    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdvxf\" (UniqueName: \"kubernetes.io/projected/47737e64-c7ff-4e95-88ca-c5d722050899-kube-api-access-qdvxf\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.279028 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278792    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.279028 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.278803    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47737e64-c7ff-4e95-88ca-c5d722050899-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:45:50.566824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.566790    2581 generic.go:356] "Generic (PLEG): container finished" podID="47737e64-c7ff-4e95-88ca-c5d722050899" containerID="2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143" exitCode=0
Jul 14 11:45:50.566993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.566844    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"
Jul 14 11:45:50.566993 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.566835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" event={"ID":"47737e64-c7ff-4e95-88ca-c5d722050899","Type":"ContainerDied","Data":"2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143"}
Jul 14 11:45:50.567076 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.567000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4" event={"ID":"47737e64-c7ff-4e95-88ca-c5d722050899","Type":"ContainerDied","Data":"29b47e5d4b1a79dc835de246ba69446e870a48dd45ba7c33b88c7a137d99c8d0"}
Jul 14 11:45:50.567076 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.567024    2581 scope.go:117] "RemoveContainer" containerID="2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143"
Jul 14 11:45:50.576719 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.576702    2581 scope.go:117] "RemoveContainer" containerID="93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0"
Jul 14 11:45:50.585922 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.585897    2581 scope.go:117] "RemoveContainer" containerID="2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143"
Jul 14 11:45:50.586300 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:45:50.586276    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143\": container with ID starting with 2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143 not found: ID does not exist" containerID="2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143"
Jul 14 11:45:50.586410 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.586314    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143"} err="failed to get container status \"2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143\": rpc error: code = NotFound desc = could not find container \"2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143\": container with ID starting with 2b1ba83b875e5bcac2951c661311b22fba5231ae7effbfea9362a674cae50143 not found: ID does not exist"
Jul 14 11:45:50.586410 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.586340    2581 scope.go:117] "RemoveContainer" containerID="93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0"
Jul 14 11:45:50.586756 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:45:50.586733    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0\": container with ID starting with 93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0 not found: ID does not exist" containerID="93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0"
Jul 14 11:45:50.586871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.586762    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0"} err="failed to get container status \"93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0\": rpc error: code = NotFound desc = could not find container \"93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0\": container with ID starting with 93516d77ff5127bf1af8a1cffb7baf307535664d9dffb7e571f21a62b32867c0 not found: ID does not exist"
Jul 14 11:45:50.589090 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.589070    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"]
Jul 14 11:45:50.595138 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:50.595115    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-bb21d4-openshift-default-58886757c-8tgc4"]
Jul 14 11:45:52.053022 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:45:52.052986    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" path="/var/lib/kubelet/pods/47737e64-c7ff-4e95-88ca-c5d722050899/volumes"
Jul 14 11:46:11.066419 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:11.066388    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"]
Jul 14 11:46:11.066830 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:11.066574    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy" containerID="cri-o://237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449" gracePeriod=30
Jul 14 11:46:12.176065 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176031    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"]
Jul 14 11:46:12.176504 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176490    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf5a4d3-aea2-47bb-bb02-784d393134ff" containerName="revoke-keys"
Jul 14 11:46:12.176550 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176505    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf5a4d3-aea2-47bb-bb02-784d393134ff" containerName="revoke-keys"
Jul 14 11:46:12.176550 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176516    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy"
Jul 14 11:46:12.176550 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176521    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy"
Jul 14 11:46:12.176550 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176529    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:46:12.176550 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176538    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:46:12.176550 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176549    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy"
Jul 14 11:46:12.176741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176554    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy"
Jul 14 11:46:12.176741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176621    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bf4ee8-ed8b-4fcd-9e04-cc2339ec2462" containerName="cleanup"
Jul 14 11:46:12.176741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176631    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf5a4d3-aea2-47bb-bb02-784d393134ff" containerName="revoke-keys"
Jul 14 11:46:12.176741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176637    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy"
Jul 14 11:46:12.176741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.176644    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="47737e64-c7ff-4e95-88ca-c5d722050899" containerName="istio-proxy"
Jul 14 11:46:12.178788 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.178767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.190641 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:46:12.190606    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" is forbidden: User \"system:node:ip-10-0-128-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-125.ec2.internal' and this object" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.190977 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:46:12.190953    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-shared-a-6b8edc-openshift-default-dockercfg-jzhsr\" is forbidden: User \"system:node:ip-10-0-128-125.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-128-125.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6b8edc-openshift-default-dockercfg-jzhsr\"" type="*v1.Secret"
Jul 14 11:46:12.229500 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.229469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"]
Jul 14 11:46:12.279438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3380aac-f706-4d3f-b1cc-edeca34105a3-istiod-ca-cert\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgw2z\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-kube-api-access-pgw2z\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-podinfo\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-data\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-token\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-certs\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-credential-socket\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279923 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-socket\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.279923 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.279803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-envoy\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381108 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3380aac-f706-4d3f-b1cc-edeca34105a3-istiod-ca-cert\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgw2z\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-kube-api-access-pgw2z\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-podinfo\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-data\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-token\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-certs\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-credential-socket\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-socket\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.381580 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.381385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-envoy\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.382401 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.382103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-data\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.382533 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.382419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-certs\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.382646 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.382608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-socket\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.382718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.382689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3380aac-f706-4d3f-b1cc-edeca34105a3-istiod-ca-cert\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.382825 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.382806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-credential-socket\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.390487 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.390460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-envoy\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.390979 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.390956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-podinfo\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.398925 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.398904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgw2z\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-kube-api-access-pgw2z\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:12.401164 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:12.401126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-token\") pod \"e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") " pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:13.357142 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.357106    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6b8edc-openshift-default-dockercfg-jzhsr\""
Jul 14 11:46:13.359186 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.359162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:13.496003 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.495978    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"]
Jul 14 11:46:13.498082 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:46:13.498055    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3380aac_f706_4d3f_b1cc_edeca34105a3.slice/crio-79c0b2a8e117f223b042d415a753265a56d61e967db86109904168cace1ee857 WatchSource:0}: Error finding container 79c0b2a8e117f223b042d415a753265a56d61e967db86109904168cace1ee857: Status 404 returned error can't find the container with id 79c0b2a8e117f223b042d415a753265a56d61e967db86109904168cace1ee857
Jul 14 11:46:13.500475 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.500442    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:13.500551 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.500508    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:13.500551 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.500537    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:13.690038 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.689950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" event={"ID":"c3380aac-f706-4d3f-b1cc-edeca34105a3","Type":"ContainerStarted","Data":"f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2"}
Jul 14 11:46:13.690038 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.690002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" event={"ID":"c3380aac-f706-4d3f-b1cc-edeca34105a3","Type":"ContainerStarted","Data":"79c0b2a8e117f223b042d415a753265a56d61e967db86109904168cace1ee857"}
Jul 14 11:46:13.716245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.716179    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" podStartSLOduration=1.716140632 podStartE2EDuration="1.716140632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:46:13.716020991 +0000 UTC m=+2360.168966886" watchObservedRunningTime="2026-07-14 11:46:13.716140632 +0000 UTC m=+2360.169086508"
Jul 14 11:46:13.836391 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.836353    2581 patch_prober.go:28] interesting pod/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 14 11:46:13.836554 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:13.836421    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 11:46:14.359672 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:14.359638    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:14.364390 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:14.364364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:14.695227 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:14.695120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:14.695984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:14.695967    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:16.321835 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.321812    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:46:16.423474 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423381    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-podinfo\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423474 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhvg6\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-kube-api-access-qhvg6\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423474 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423439    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-token\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423474 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423466    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-envoy\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423508    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e93007f-d27b-4678-ae9c-d0022f803e65-istiod-ca-cert\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423595    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-certs\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-credential-socket\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423650    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-data\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.423859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423676    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-socket\") pod \"2e93007f-d27b-4678-ae9c-d0022f803e65\" (UID: \"2e93007f-d27b-4678-ae9c-d0022f803e65\") "
Jul 14 11:46:16.424084 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.423932    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:46:16.424084 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424039    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:46:16.424220 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424074    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e93007f-d27b-4678-ae9c-d0022f803e65-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:46:16.424364 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424329    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:46:16.424778 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424754    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e93007f-d27b-4678-ae9c-d0022f803e65-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.424868 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424784    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.424868 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424800    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.424868 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424814    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.425043 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.424982    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:46:16.425886 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.425865    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:46:16.425886 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.425871    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:46:16.426010 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.425912    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:46:16.426741 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.426722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-kube-api-access-qhvg6" (OuterVolumeSpecName: "kube-api-access-qhvg6") pod "2e93007f-d27b-4678-ae9c-d0022f803e65" (UID: "2e93007f-d27b-4678-ae9c-d0022f803e65"). InnerVolumeSpecName "kube-api-access-qhvg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:46:16.525437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.525401    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.525437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.525433    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.525437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.525443    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhvg6\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-kube-api-access-qhvg6\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.525665 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.525454    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.525665 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.525462    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e93007f-d27b-4678-ae9c-d0022f803e65-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:46:16.707733 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.707643    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerID="237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449" exitCode=0
Jul 14 11:46:16.707733 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.707690    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"
Jul 14 11:46:16.707913 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.707736    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" event={"ID":"2e93007f-d27b-4678-ae9c-d0022f803e65","Type":"ContainerDied","Data":"237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449"}
Jul 14 11:46:16.707913 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.707791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz" event={"ID":"2e93007f-d27b-4678-ae9c-d0022f803e65","Type":"ContainerDied","Data":"9dcf84687abe4e6b5e6a3666f3e77e40c883bcec79096d5932c8f2ffc1739f5a"}
Jul 14 11:46:16.707913 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.707815    2581 scope.go:117] "RemoveContainer" containerID="237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449"
Jul 14 11:46:16.717340 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.717329    2581 scope.go:117] "RemoveContainer" containerID="c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2"
Jul 14 11:46:16.725726 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.725681    2581 scope.go:117] "RemoveContainer" containerID="237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449"
Jul 14 11:46:16.725945 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:46:16.725927    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449\": container with ID starting with 237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449 not found: ID does not exist" containerID="237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449"
Jul 14 11:46:16.725984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.725953    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449"} err="failed to get container status \"237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449\": rpc error: code = NotFound desc = could not find container \"237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449\": container with ID starting with 237fd1efcb7b46a6703fbe81a8263992feef70744b4da43519c270ae7cc8b449 not found: ID does not exist"
Jul 14 11:46:16.725984 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.725970    2581 scope.go:117] "RemoveContainer" containerID="c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2"
Jul 14 11:46:16.726214 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:46:16.726196    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2\": container with ID starting with c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2 not found: ID does not exist" containerID="c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2"
Jul 14 11:46:16.726260 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.726221    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2"} err="failed to get container status \"c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2\": rpc error: code = NotFound desc = could not find container \"c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2\": container with ID starting with c03248822747260188efc98c96b22067bf7f56e064da0f7336dca4d9b5e8dcb2 not found: ID does not exist"
Jul 14 11:46:16.739307 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.739282    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"]
Jul 14 11:46:16.741280 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:16.741262    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-af8cc2-openshift-default-85bc7fff5f-rv4pz"]
Jul 14 11:46:18.052277 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:18.052246    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" path="/var/lib/kubelet/pods/2e93007f-d27b-4678-ae9c-d0022f803e65/volumes"
Jul 14 11:46:20.983982 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.983949    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"]
Jul 14 11:46:20.984388 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.984372    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy"
Jul 14 11:46:20.984433 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.984390    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy"
Jul 14 11:46:20.984433 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.984403    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy"
Jul 14 11:46:20.984433 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.984409    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy"
Jul 14 11:46:20.984531 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.984485    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy"
Jul 14 11:46:20.988980 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.988962    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:20.991718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:20.991698    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5c5a7d-openshift-default-dockercfg-sjrtv\""
Jul 14 11:46:21.001141 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.001117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"]
Jul 14 11:46:21.068482 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-istio-token\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068482 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0192a6f6-033d-4301-98ed-b59902341010-istiod-ca-cert\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068696 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-credential-socket\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068696 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4zl\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-kube-api-access-8g4zl\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068696 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-certs\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068800 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-socket\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068800 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-envoy\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068863 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-data\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.068863 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.068840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0192a6f6-033d-4301-98ed-b59902341010-istio-podinfo\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169369 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-credential-socket\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169559 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4zl\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-kube-api-access-8g4zl\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169559 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-certs\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169559 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-socket\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169559 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-envoy\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169559 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-data\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169559 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0192a6f6-033d-4301-98ed-b59902341010-istio-podinfo\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169889 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-istio-token\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169889 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0192a6f6-033d-4301-98ed-b59902341010-istiod-ca-cert\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.169889 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-credential-socket\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.170001 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.169896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-certs\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.170056 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.170035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-data\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.170169 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.170133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-socket\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.170577 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.170554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0192a6f6-033d-4301-98ed-b59902341010-istiod-ca-cert\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.171950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.171926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-envoy\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.172107 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.172088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0192a6f6-033d-4301-98ed-b59902341010-istio-podinfo\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.180196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.180177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-istio-token\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.180617 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.180589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4zl\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-kube-api-access-8g4zl\") pod \"e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") " pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.300088 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.300035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:21.506872 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.506840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"]
Jul 14 11:46:21.509359 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:46:21.509326    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0192a6f6_033d_4301_98ed_b59902341010.slice/crio-bb79765aee4f79fe5741f492df2c0d2e874a1d946fcc354a33f2fff300fa30bc WatchSource:0}: Error finding container bb79765aee4f79fe5741f492df2c0d2e874a1d946fcc354a33f2fff300fa30bc: Status 404 returned error can't find the container with id bb79765aee4f79fe5741f492df2c0d2e874a1d946fcc354a33f2fff300fa30bc
Jul 14 11:46:21.511720 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.511675    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:21.511837 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.511742    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:21.511837 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.511769    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:21.749173 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.746698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" event={"ID":"0192a6f6-033d-4301-98ed-b59902341010","Type":"ContainerStarted","Data":"d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f"}
Jul 14 11:46:21.749173 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.746760    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" event={"ID":"0192a6f6-033d-4301-98ed-b59902341010","Type":"ContainerStarted","Data":"bb79765aee4f79fe5741f492df2c0d2e874a1d946fcc354a33f2fff300fa30bc"}
Jul 14 11:46:21.771409 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:21.771331    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podStartSLOduration=1.771310716 podStartE2EDuration="1.771310716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:46:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:46:21.76952422 +0000 UTC m=+2368.222470102" watchObservedRunningTime="2026-07-14 11:46:21.771310716 +0000 UTC m=+2368.224256597"
Jul 14 11:46:22.300267 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:22.300225    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:22.305171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:22.305129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:22.754748 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:22.754655    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:22.758807 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:22.758780    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:27.787534 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:27.787430    2581 generic.go:356] "Generic (PLEG): container finished" podID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerID="f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2" exitCode=0
Jul 14 11:46:27.787534 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:27.787505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" event={"ID":"c3380aac-f706-4d3f-b1cc-edeca34105a3","Type":"ContainerDied","Data":"f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2"}
Jul 14 11:46:27.787976 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:27.787941    2581 scope.go:117] "RemoveContainer" containerID="f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2"
Jul 14 11:46:27.788927 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:27.788894    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:27.789032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:27.788961    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:27.789032 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:27.788992    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:28.794832 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:28.794788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" event={"ID":"c3380aac-f706-4d3f-b1cc-edeca34105a3","Type":"ContainerStarted","Data":"eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa"}
Jul 14 11:46:29.359718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:29.359681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:29.360940 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:29.360906    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 11:46:29.361085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:29.360966    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 11:46:29.695102 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:29.695009    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:30.360524 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:30.360479    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 11:46:30.360914 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:30.360545    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 11:46:31.360511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:31.360471    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 11:46:31.360698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:31.360527    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 11:46:32.360183 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:32.360124    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 14 11:46:32.360506 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:32.360470    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 14 11:46:33.364316 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:33.364283    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:33.365111 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:33.365093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:46:38.797316 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:38.797279    2581 patch_prober.go:28] interesting pod/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 11:46:38.797762 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:38.797353    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 11:46:39.862498 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:39.862465    2581 generic.go:356] "Generic (PLEG): container finished" podID="0192a6f6-033d-4301-98ed-b59902341010" containerID="d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f" exitCode=0
Jul 14 11:46:39.862922 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:39.862541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" event={"ID":"0192a6f6-033d-4301-98ed-b59902341010","Type":"ContainerDied","Data":"d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f"}
Jul 14 11:46:39.862922 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:39.862912    2581 scope.go:117] "RemoveContainer" containerID="d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f"
Jul 14 11:46:39.863977 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:39.863947    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:39.864037 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:39.864016    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:39.864072 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:39.864050    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 11:46:40.870175 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:40.870115    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" event={"ID":"0192a6f6-033d-4301-98ed-b59902341010","Type":"ContainerStarted","Data":"54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56"}
Jul 14 11:46:41.300771 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:41.300739    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:41.301042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:41.301006    2581 patch_prober.go:28] interesting pod/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 11:46:41.301203 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:41.301065    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 11:46:42.301133 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:42.301093    2581 patch_prober.go:28] interesting pod/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 11:46:42.301133 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:42.301181    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 11:46:43.300692 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:43.300661    2581 patch_prober.go:28] interesting pod/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 11:46:43.300874 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:43.300728    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 11:46:44.300387 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:44.300355    2581 patch_prober.go:28] interesting pod/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 14 11:46:44.300767 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:44.300418    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 14 11:46:45.304440 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:45.304403    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:45.304829 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:45.304783    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:46:45.305317 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:46:45.305297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:51:54.312819 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:51:54.312790    2581 scope.go:117] "RemoveContainer" containerID="ab298d3fc5eb773cf200663547515fd2250f4675e602f5c019c01d0bef76ef84"
Jul 14 11:52:02.480491 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.480453    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140190212572336"]
Jul 14 11:52:02.480911 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.480897    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e93007f-d27b-4678-ae9c-d0022f803e65" containerName="istio-proxy"
Jul 14 11:52:02.482875 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.482858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212572336"
Jul 14 11:52:02.485698 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.485673    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8dvv5\""
Jul 14 11:52:02.488730 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.488708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212572336"]
Jul 14 11:52:02.551018 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.550987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ppjs\" (UniqueName: \"kubernetes.io/projected/e67b0e00-7efb-4389-ba97-1043dd062790-kube-api-access-2ppjs\") pod \"test-curl-7757-140190212572336\" (UID: \"e67b0e00-7efb-4389-ba97-1043dd062790\") " pod="opendatahub/test-curl-7757-140190212572336"
Jul 14 11:52:02.652388 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.652345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ppjs\" (UniqueName: \"kubernetes.io/projected/e67b0e00-7efb-4389-ba97-1043dd062790-kube-api-access-2ppjs\") pod \"test-curl-7757-140190212572336\" (UID: \"e67b0e00-7efb-4389-ba97-1043dd062790\") " pod="opendatahub/test-curl-7757-140190212572336"
Jul 14 11:52:02.663037 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.663009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ppjs\" (UniqueName: \"kubernetes.io/projected/e67b0e00-7efb-4389-ba97-1043dd062790-kube-api-access-2ppjs\") pod \"test-curl-7757-140190212572336\" (UID: \"e67b0e00-7efb-4389-ba97-1043dd062790\") " pod="opendatahub/test-curl-7757-140190212572336"
Jul 14 11:52:02.793292 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.793204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212572336"
Jul 14 11:52:02.927199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.927171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212572336"]
Jul 14 11:52:02.927927 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:52:02.927898    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode67b0e00_7efb_4389_ba97_1043dd062790.slice/crio-774a5cde5df3103054932065a9c7e59447c809187c89f1e2b5af2f251297a4fe WatchSource:0}: Error finding container 774a5cde5df3103054932065a9c7e59447c809187c89f1e2b5af2f251297a4fe: Status 404 returned error can't find the container with id 774a5cde5df3103054932065a9c7e59447c809187c89f1e2b5af2f251297a4fe
Jul 14 11:52:02.929397 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:02.929377    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 11:52:03.604375 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:03.604348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212572336" event={"ID":"e67b0e00-7efb-4389-ba97-1043dd062790","Type":"ContainerStarted","Data":"774a5cde5df3103054932065a9c7e59447c809187c89f1e2b5af2f251297a4fe"}
Jul 14 11:52:04.610721 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:04.610689    2581 generic.go:356] "Generic (PLEG): container finished" podID="e67b0e00-7efb-4389-ba97-1043dd062790" containerID="c6af2fa8abc2588f59be431db096fd298095266fcec31b719833ef3104de83c4" exitCode=0
Jul 14 11:52:04.611116 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:04.610757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212572336" event={"ID":"e67b0e00-7efb-4389-ba97-1043dd062790","Type":"ContainerDied","Data":"c6af2fa8abc2588f59be431db096fd298095266fcec31b719833ef3104de83c4"}
Jul 14 11:52:05.755083 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.755057    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212572336"
Jul 14 11:52:05.797987 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.797957    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140190212572336_e67b0e00-7efb-4389-ba97-1043dd062790/test-curl-7757-140190212572336/0.log"
Jul 14 11:52:05.826493 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.826451    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140190212572336"]
Jul 14 11:52:05.831448 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.831424    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140190212572336"]
Jul 14 11:52:05.887235 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.887162    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ppjs\" (UniqueName: \"kubernetes.io/projected/e67b0e00-7efb-4389-ba97-1043dd062790-kube-api-access-2ppjs\") pod \"e67b0e00-7efb-4389-ba97-1043dd062790\" (UID: \"e67b0e00-7efb-4389-ba97-1043dd062790\") "
Jul 14 11:52:05.889092 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.889068    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67b0e00-7efb-4389-ba97-1043dd062790-kube-api-access-2ppjs" (OuterVolumeSpecName: "kube-api-access-2ppjs") pod "e67b0e00-7efb-4389-ba97-1043dd062790" (UID: "e67b0e00-7efb-4389-ba97-1043dd062790"). InnerVolumeSpecName "kube-api-access-2ppjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:52:05.970921 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.970876    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140190212182320"]
Jul 14 11:52:05.971911 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.971882    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67b0e00-7efb-4389-ba97-1043dd062790" containerName="test-curl-7757-140190212572336"
Jul 14 11:52:05.971911 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.971911    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67b0e00-7efb-4389-ba97-1043dd062790" containerName="test-curl-7757-140190212572336"
Jul 14 11:52:05.972121 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.972108    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67b0e00-7efb-4389-ba97-1043dd062790" containerName="test-curl-7757-140190212572336"
Jul 14 11:52:05.975763 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.975741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:05.980364 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.980338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212182320"]
Jul 14 11:52:05.988112 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:05.988087    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ppjs\" (UniqueName: \"kubernetes.io/projected/e67b0e00-7efb-4389-ba97-1043dd062790-kube-api-access-2ppjs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:06.052212 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.052186    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67b0e00-7efb-4389-ba97-1043dd062790" path="/var/lib/kubelet/pods/e67b0e00-7efb-4389-ba97-1043dd062790/volumes"
Jul 14 11:52:06.089193 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.089144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r6mp\" (UniqueName: \"kubernetes.io/projected/3d882e77-3f4c-41a2-8bb4-1d8a355b55fe-kube-api-access-8r6mp\") pod \"test-curl-7757-140190212182320\" (UID: \"3d882e77-3f4c-41a2-8bb4-1d8a355b55fe\") " pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:06.189745 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.189657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r6mp\" (UniqueName: \"kubernetes.io/projected/3d882e77-3f4c-41a2-8bb4-1d8a355b55fe-kube-api-access-8r6mp\") pod \"test-curl-7757-140190212182320\" (UID: \"3d882e77-3f4c-41a2-8bb4-1d8a355b55fe\") " pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:06.199416 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.199391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r6mp\" (UniqueName: \"kubernetes.io/projected/3d882e77-3f4c-41a2-8bb4-1d8a355b55fe-kube-api-access-8r6mp\") pod \"test-curl-7757-140190212182320\" (UID: \"3d882e77-3f4c-41a2-8bb4-1d8a355b55fe\") " pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:06.289251 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.289218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:06.420030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.420003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212182320"]
Jul 14 11:52:06.421659 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:52:06.421619    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d882e77_3f4c_41a2_8bb4_1d8a355b55fe.slice/crio-d2035c32a7abc30a86e291d088e6bd89954d5c516ef889ae30ad8dbcbc416326 WatchSource:0}: Error finding container d2035c32a7abc30a86e291d088e6bd89954d5c516ef889ae30ad8dbcbc416326: Status 404 returned error can't find the container with id d2035c32a7abc30a86e291d088e6bd89954d5c516ef889ae30ad8dbcbc416326
Jul 14 11:52:06.623599 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.623560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212182320" event={"ID":"3d882e77-3f4c-41a2-8bb4-1d8a355b55fe","Type":"ContainerStarted","Data":"d2035c32a7abc30a86e291d088e6bd89954d5c516ef889ae30ad8dbcbc416326"}
Jul 14 11:52:06.624813 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.624792    2581 scope.go:117] "RemoveContainer" containerID="c6af2fa8abc2588f59be431db096fd298095266fcec31b719833ef3104de83c4"
Jul 14 11:52:06.624813 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:06.624813    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212572336"
Jul 14 11:52:07.632343 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:07.632309    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d882e77-3f4c-41a2-8bb4-1d8a355b55fe" containerID="93facfe8868c9b07919bb25f99953a97a8c79ef1e92c775cbc07bf0a4b20b406" exitCode=0
Jul 14 11:52:07.632717 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:07.632389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212182320" event={"ID":"3d882e77-3f4c-41a2-8bb4-1d8a355b55fe","Type":"ContainerDied","Data":"93facfe8868c9b07919bb25f99953a97a8c79ef1e92c775cbc07bf0a4b20b406"}
Jul 14 11:52:08.766732 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.766707    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:08.789075 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.789050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140190212182320_3d882e77-3f4c-41a2-8bb4-1d8a355b55fe/test-curl-7757-140190212182320/0.log"
Jul 14 11:52:08.817418 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.817390    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140190212182320"]
Jul 14 11:52:08.821466 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.821446    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140190212182320"]
Jul 14 11:52:08.917339 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.917263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r6mp\" (UniqueName: \"kubernetes.io/projected/3d882e77-3f4c-41a2-8bb4-1d8a355b55fe-kube-api-access-8r6mp\") pod \"3d882e77-3f4c-41a2-8bb4-1d8a355b55fe\" (UID: \"3d882e77-3f4c-41a2-8bb4-1d8a355b55fe\") "
Jul 14 11:52:08.919285 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.919257    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d882e77-3f4c-41a2-8bb4-1d8a355b55fe-kube-api-access-8r6mp" (OuterVolumeSpecName: "kube-api-access-8r6mp") pod "3d882e77-3f4c-41a2-8bb4-1d8a355b55fe" (UID: "3d882e77-3f4c-41a2-8bb4-1d8a355b55fe"). InnerVolumeSpecName "kube-api-access-8r6mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:52:08.987230 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.987197    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:08.987618 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.987606    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d882e77-3f4c-41a2-8bb4-1d8a355b55fe" containerName="test-curl-7757-140190212182320"
Jul 14 11:52:08.987671 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.987621    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d882e77-3f4c-41a2-8bb4-1d8a355b55fe" containerName="test-curl-7757-140190212182320"
Jul 14 11:52:08.987704 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.987681    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d882e77-3f4c-41a2-8bb4-1d8a355b55fe" containerName="test-curl-7757-140190212182320"
Jul 14 11:52:08.989766 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:08.989747    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:09.002187 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.002161    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:09.018677 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.018654    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r6mp\" (UniqueName: \"kubernetes.io/projected/3d882e77-3f4c-41a2-8bb4-1d8a355b55fe-kube-api-access-8r6mp\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:09.119610 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.119571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5cxv\" (UniqueName: \"kubernetes.io/projected/f7357757-26a8-46c6-b174-866f945104e9-kube-api-access-l5cxv\") pod \"test-curl-7757-140190212300848\" (UID: \"f7357757-26a8-46c6-b174-866f945104e9\") " pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:09.220976 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.220892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5cxv\" (UniqueName: \"kubernetes.io/projected/f7357757-26a8-46c6-b174-866f945104e9-kube-api-access-l5cxv\") pod \"test-curl-7757-140190212300848\" (UID: \"f7357757-26a8-46c6-b174-866f945104e9\") " pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:09.230011 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.229981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5cxv\" (UniqueName: \"kubernetes.io/projected/f7357757-26a8-46c6-b174-866f945104e9-kube-api-access-l5cxv\") pod \"test-curl-7757-140190212300848\" (UID: \"f7357757-26a8-46c6-b174-866f945104e9\") " pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:09.298529 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.298496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:09.434267 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.434238    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:09.435190 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:52:09.435142    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7357757_26a8_46c6_b174_866f945104e9.slice/crio-27ab933111a7d4ab509efc01639b344540f640874cacf1d6b62d83b1f99c6707 WatchSource:0}: Error finding container 27ab933111a7d4ab509efc01639b344540f640874cacf1d6b62d83b1f99c6707: Status 404 returned error can't find the container with id 27ab933111a7d4ab509efc01639b344540f640874cacf1d6b62d83b1f99c6707
Jul 14 11:52:09.648008 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.647973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212300848" event={"ID":"f7357757-26a8-46c6-b174-866f945104e9","Type":"ContainerStarted","Data":"27ab933111a7d4ab509efc01639b344540f640874cacf1d6b62d83b1f99c6707"}
Jul 14 11:52:09.649070 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.649045    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:09.649224 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:09.649100    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2035c32a7abc30a86e291d088e6bd89954d5c516ef889ae30ad8dbcbc416326"
Jul 14 11:52:09.659271 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:52:09.659246    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7757-140190212182320\" is forbidden: User \"system:node:ip-10-0-128-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-125.ec2.internal' and this object" podUID="3d882e77-3f4c-41a2-8bb4-1d8a355b55fe" pod="opendatahub/test-curl-7757-140190212182320"
Jul 14 11:52:10.053042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:10.053010    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d882e77-3f4c-41a2-8bb4-1d8a355b55fe" path="/var/lib/kubelet/pods/3d882e77-3f4c-41a2-8bb4-1d8a355b55fe/volumes"
Jul 14 11:52:10.664955 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:10.664919    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7357757-26a8-46c6-b174-866f945104e9" containerID="970ccc3b1c04fd24a22a76a155a7c9afc2ce4d9ee63092261d8c5740068c3629" exitCode=0
Jul 14 11:52:10.665169 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:10.665005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212300848" event={"ID":"f7357757-26a8-46c6-b174-866f945104e9","Type":"ContainerDied","Data":"970ccc3b1c04fd24a22a76a155a7c9afc2ce4d9ee63092261d8c5740068c3629"}
Jul 14 11:52:11.802489 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.802463    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:11.824203 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.824177    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140190212300848_f7357757-26a8-46c6-b174-866f945104e9/test-curl-7757-140190212300848/0.log"
Jul 14 11:52:11.848824 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.848787    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:11.853171 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.853132    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:11.946554 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.946462    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5cxv\" (UniqueName: \"kubernetes.io/projected/f7357757-26a8-46c6-b174-866f945104e9-kube-api-access-l5cxv\") pod \"f7357757-26a8-46c6-b174-866f945104e9\" (UID: \"f7357757-26a8-46c6-b174-866f945104e9\") "
Jul 14 11:52:11.948571 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.948542    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7357757-26a8-46c6-b174-866f945104e9-kube-api-access-l5cxv" (OuterVolumeSpecName: "kube-api-access-l5cxv") pod "f7357757-26a8-46c6-b174-866f945104e9" (UID: "f7357757-26a8-46c6-b174-866f945104e9"). InnerVolumeSpecName "kube-api-access-l5cxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:52:11.977743 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.977702    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:11.978245 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.978224    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7357757-26a8-46c6-b174-866f945104e9" containerName="test-curl-7757-140190212300848"
Jul 14 11:52:11.978353 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.978247    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7357757-26a8-46c6-b174-866f945104e9" containerName="test-curl-7757-140190212300848"
Jul 14 11:52:11.978411 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.978353    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7357757-26a8-46c6-b174-866f945104e9" containerName="test-curl-7757-140190212300848"
Jul 14 11:52:11.980429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.980408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:11.986910 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:11.986882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:12.047313 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.047276    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5cxv\" (UniqueName: \"kubernetes.io/projected/f7357757-26a8-46c6-b174-866f945104e9-kube-api-access-l5cxv\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:12.052918 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.052885    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7357757-26a8-46c6-b174-866f945104e9" path="/var/lib/kubelet/pods/f7357757-26a8-46c6-b174-866f945104e9/volumes"
Jul 14 11:52:12.148097 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.148058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n8sz\" (UniqueName: \"kubernetes.io/projected/8e220d75-0eef-4d8b-95e2-639dc7528e00-kube-api-access-6n8sz\") pod \"test-curl-7757-140190212300848\" (UID: \"8e220d75-0eef-4d8b-95e2-639dc7528e00\") " pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:12.248857 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.248742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n8sz\" (UniqueName: \"kubernetes.io/projected/8e220d75-0eef-4d8b-95e2-639dc7528e00-kube-api-access-6n8sz\") pod \"test-curl-7757-140190212300848\" (UID: \"8e220d75-0eef-4d8b-95e2-639dc7528e00\") " pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:12.257218 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.257191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n8sz\" (UniqueName: \"kubernetes.io/projected/8e220d75-0eef-4d8b-95e2-639dc7528e00-kube-api-access-6n8sz\") pod \"test-curl-7757-140190212300848\" (UID: \"8e220d75-0eef-4d8b-95e2-639dc7528e00\") " pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:12.290378 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.290345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:12.425003 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.424974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:12.425560 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:52:12.425522    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e220d75_0eef_4d8b_95e2_639dc7528e00.slice/crio-6a677f95ac5b1a1049037a443b72292a10a3a836ea84efed32a10f7d2e49af98 WatchSource:0}: Error finding container 6a677f95ac5b1a1049037a443b72292a10a3a836ea84efed32a10f7d2e49af98: Status 404 returned error can't find the container with id 6a677f95ac5b1a1049037a443b72292a10a3a836ea84efed32a10f7d2e49af98
Jul 14 11:52:12.676773 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.676729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212300848" event={"ID":"8e220d75-0eef-4d8b-95e2-639dc7528e00","Type":"ContainerStarted","Data":"6a677f95ac5b1a1049037a443b72292a10a3a836ea84efed32a10f7d2e49af98"}
Jul 14 11:52:12.678089 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.678063    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:12.678211 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:12.678066    2581 scope.go:117] "RemoveContainer" containerID="970ccc3b1c04fd24a22a76a155a7c9afc2ce4d9ee63092261d8c5740068c3629"
Jul 14 11:52:13.685582 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:13.685549    2581 generic.go:356] "Generic (PLEG): container finished" podID="8e220d75-0eef-4d8b-95e2-639dc7528e00" containerID="0f7d27035fbcb9afa0bde2f5e3ff668eada7ae4ad9d1ead8534e08f6b7cdf8ec" exitCode=0
Jul 14 11:52:13.685950 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:13.685603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212300848" event={"ID":"8e220d75-0eef-4d8b-95e2-639dc7528e00","Type":"ContainerDied","Data":"0f7d27035fbcb9afa0bde2f5e3ff668eada7ae4ad9d1ead8534e08f6b7cdf8ec"}
Jul 14 11:52:14.828783 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:14.828759    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:14.849919 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:14.849892    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140190212300848_8e220d75-0eef-4d8b-95e2-639dc7528e00/test-curl-7757-140190212300848/0.log"
Jul 14 11:52:14.876049 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:14.876015    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:14.878768 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:14.878741    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140190212300848"]
Jul 14 11:52:14.973047 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:14.972936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n8sz\" (UniqueName: \"kubernetes.io/projected/8e220d75-0eef-4d8b-95e2-639dc7528e00-kube-api-access-6n8sz\") pod \"8e220d75-0eef-4d8b-95e2-639dc7528e00\" (UID: \"8e220d75-0eef-4d8b-95e2-639dc7528e00\") "
Jul 14 11:52:14.975021 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:14.974996    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e220d75-0eef-4d8b-95e2-639dc7528e00-kube-api-access-6n8sz" (OuterVolumeSpecName: "kube-api-access-6n8sz") pod "8e220d75-0eef-4d8b-95e2-639dc7528e00" (UID: "8e220d75-0eef-4d8b-95e2-639dc7528e00"). InnerVolumeSpecName "kube-api-access-6n8sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:52:15.031943 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.031908    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140190212301856"]
Jul 14 11:52:15.032354 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.032340    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e220d75-0eef-4d8b-95e2-639dc7528e00" containerName="test-curl-7757-140190212300848"
Jul 14 11:52:15.032403 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.032355    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e220d75-0eef-4d8b-95e2-639dc7528e00" containerName="test-curl-7757-140190212300848"
Jul 14 11:52:15.032436 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.032427    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e220d75-0eef-4d8b-95e2-639dc7528e00" containerName="test-curl-7757-140190212300848"
Jul 14 11:52:15.034429 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.034411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212301856"
Jul 14 11:52:15.042755 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.042729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212301856"]
Jul 14 11:52:15.073857 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.073807    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n8sz\" (UniqueName: \"kubernetes.io/projected/8e220d75-0eef-4d8b-95e2-639dc7528e00-kube-api-access-6n8sz\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:15.174981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.174944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffzqx\" (UniqueName: \"kubernetes.io/projected/a26ccfb3-819c-4ff4-97ff-d6e114c42e3c-kube-api-access-ffzqx\") pod \"test-curl-7757-140190212301856\" (UID: \"a26ccfb3-819c-4ff4-97ff-d6e114c42e3c\") " pod="opendatahub/test-curl-7757-140190212301856"
Jul 14 11:52:15.275535 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.275446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffzqx\" (UniqueName: \"kubernetes.io/projected/a26ccfb3-819c-4ff4-97ff-d6e114c42e3c-kube-api-access-ffzqx\") pod \"test-curl-7757-140190212301856\" (UID: \"a26ccfb3-819c-4ff4-97ff-d6e114c42e3c\") " pod="opendatahub/test-curl-7757-140190212301856"
Jul 14 11:52:15.283807 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.283774    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffzqx\" (UniqueName: \"kubernetes.io/projected/a26ccfb3-819c-4ff4-97ff-d6e114c42e3c-kube-api-access-ffzqx\") pod \"test-curl-7757-140190212301856\" (UID: \"a26ccfb3-819c-4ff4-97ff-d6e114c42e3c\") " pod="opendatahub/test-curl-7757-140190212301856"
Jul 14 11:52:15.344883 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.344845    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212301856"
Jul 14 11:52:15.474354 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.474322    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140190212301856"]
Jul 14 11:52:15.476618 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:52:15.476582    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda26ccfb3_819c_4ff4_97ff_d6e114c42e3c.slice/crio-89934c293ea7371c50dce4d3fabf380d50f001f9f015124e00b014e78121d126 WatchSource:0}: Error finding container 89934c293ea7371c50dce4d3fabf380d50f001f9f015124e00b014e78121d126: Status 404 returned error can't find the container with id 89934c293ea7371c50dce4d3fabf380d50f001f9f015124e00b014e78121d126
Jul 14 11:52:15.697026 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.697001    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a677f95ac5b1a1049037a443b72292a10a3a836ea84efed32a10f7d2e49af98"
Jul 14 11:52:15.697026 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.697010    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:15.698221 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:15.698190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212301856" event={"ID":"a26ccfb3-819c-4ff4-97ff-d6e114c42e3c","Type":"ContainerStarted","Data":"89934c293ea7371c50dce4d3fabf380d50f001f9f015124e00b014e78121d126"}
Jul 14 11:52:15.708263 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:52:15.708235    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7757-140190212300848\" is forbidden: User \"system:node:ip-10-0-128-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-125.ec2.internal' and this object" podUID="8e220d75-0eef-4d8b-95e2-639dc7528e00" pod="opendatahub/test-curl-7757-140190212300848"
Jul 14 11:52:16.052215 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:16.052182    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e220d75-0eef-4d8b-95e2-639dc7528e00" path="/var/lib/kubelet/pods/8e220d75-0eef-4d8b-95e2-639dc7528e00/volumes"
Jul 14 11:52:16.705669 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:16.705633    2581 generic.go:356] "Generic (PLEG): container finished" podID="a26ccfb3-819c-4ff4-97ff-d6e114c42e3c" containerID="d5a864e67eefc330eb26c533ab7931c63cba063c04530c8c4ac3dc22d4915423" exitCode=0
Jul 14 11:52:16.705845 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:16.705714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140190212301856" event={"ID":"a26ccfb3-819c-4ff4-97ff-d6e114c42e3c","Type":"ContainerDied","Data":"d5a864e67eefc330eb26c533ab7931c63cba063c04530c8c4ac3dc22d4915423"}
Jul 14 11:52:17.849191 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:17.849165    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212301856"
Jul 14 11:52:17.872902 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:17.872874    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140190212301856_a26ccfb3-819c-4ff4-97ff-d6e114c42e3c/test-curl-7757-140190212301856/0.log"
Jul 14 11:52:17.895916 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:17.895885    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140190212301856"]
Jul 14 11:52:17.900587 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:17.900566    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140190212301856"]
Jul 14 11:52:17.999434 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:17.999328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffzqx\" (UniqueName: \"kubernetes.io/projected/a26ccfb3-819c-4ff4-97ff-d6e114c42e3c-kube-api-access-ffzqx\") pod \"a26ccfb3-819c-4ff4-97ff-d6e114c42e3c\" (UID: \"a26ccfb3-819c-4ff4-97ff-d6e114c42e3c\") "
Jul 14 11:52:18.001377 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:18.001347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26ccfb3-819c-4ff4-97ff-d6e114c42e3c-kube-api-access-ffzqx" (OuterVolumeSpecName: "kube-api-access-ffzqx") pod "a26ccfb3-819c-4ff4-97ff-d6e114c42e3c" (UID: "a26ccfb3-819c-4ff4-97ff-d6e114c42e3c"). InnerVolumeSpecName "kube-api-access-ffzqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:52:18.053437 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:18.053404    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26ccfb3-819c-4ff4-97ff-d6e114c42e3c" path="/var/lib/kubelet/pods/a26ccfb3-819c-4ff4-97ff-d6e114c42e3c/volumes"
Jul 14 11:52:18.100273 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:18.100243    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffzqx\" (UniqueName: \"kubernetes.io/projected/a26ccfb3-819c-4ff4-97ff-d6e114c42e3c-kube-api-access-ffzqx\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:18.717561 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:18.717529    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140190212301856"
Jul 14 11:52:18.717719 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:18.717586    2581 scope.go:117] "RemoveContainer" containerID="d5a864e67eefc330eb26c533ab7931c63cba063c04530c8c4ac3dc22d4915423"
Jul 14 11:52:47.069216 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:47.069172    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"]
Jul 14 11:52:47.069765 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:47.069426    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy" containerID="cri-o://eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa" gracePeriod=30
Jul 14 11:52:48.367667 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:48.367633    2581 patch_prober.go:28] interesting pod/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 11:52:48.368108 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:48.367691    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 11:52:52.325469 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.325443    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:52:52.428354 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-socket\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428354 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428316    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgw2z\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-kube-api-access-pgw2z\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428354 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428339    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-certs\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428608 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428367    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3380aac-f706-4d3f-b1cc-edeca34105a3-istiod-ca-cert\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428608 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-credential-socket\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428608 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-podinfo\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428608 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428465    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-data\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428608 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-envoy\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428608 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428588    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-token\") pod \"c3380aac-f706-4d3f-b1cc-edeca34105a3\" (UID: \"c3380aac-f706-4d3f-b1cc-edeca34105a3\") "
Jul 14 11:52:52.428608 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428597    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:52:52.428981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428640    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:52:52.428981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428830    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3380aac-f706-4d3f-b1cc-edeca34105a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:52:52.428981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428924    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.428981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428945    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.428981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428960    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3380aac-f706-4d3f-b1cc-edeca34105a3-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.428981 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.428950    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:52:52.429465 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.429435    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:52:52.430587 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.430566    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-kube-api-access-pgw2z" (OuterVolumeSpecName: "kube-api-access-pgw2z") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "kube-api-access-pgw2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:52:52.430704 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.430647    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:52:52.431089 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.431065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:52:52.431089 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.431074    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3380aac-f706-4d3f-b1cc-edeca34105a3" (UID: "c3380aac-f706-4d3f-b1cc-edeca34105a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:52:52.529379 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.529353    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.529379 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.529378    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgw2z\" (UniqueName: \"kubernetes.io/projected/c3380aac-f706-4d3f-b1cc-edeca34105a3-kube-api-access-pgw2z\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.529379 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.529387    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.529718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.529395    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.529718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.529404    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.529718 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.529412    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3380aac-f706-4d3f-b1cc-edeca34105a3-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:52:52.902110 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.902073    2581 generic.go:356] "Generic (PLEG): container finished" podID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerID="eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa" exitCode=0
Jul 14 11:52:52.902294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.902123    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"
Jul 14 11:52:52.902294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.902172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" event={"ID":"c3380aac-f706-4d3f-b1cc-edeca34105a3","Type":"ContainerDied","Data":"eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa"}
Jul 14 11:52:52.902294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.902229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx" event={"ID":"c3380aac-f706-4d3f-b1cc-edeca34105a3","Type":"ContainerDied","Data":"79c0b2a8e117f223b042d415a753265a56d61e967db86109904168cace1ee857"}
Jul 14 11:52:52.902294 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.902259    2581 scope.go:117] "RemoveContainer" containerID="eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa"
Jul 14 11:52:52.912543 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.912523    2581 scope.go:117] "RemoveContainer" containerID="f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2"
Jul 14 11:52:52.920511 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.920491    2581 scope.go:117] "RemoveContainer" containerID="eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa"
Jul 14 11:52:52.920756 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:52:52.920736    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa\": container with ID starting with eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa not found: ID does not exist" containerID="eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa"
Jul 14 11:52:52.920828 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.920769    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa"} err="failed to get container status \"eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa\": rpc error: code = NotFound desc = could not find container \"eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa\": container with ID starting with eba3d61d9a710dc695a6209e4d47c299be97ba3b86900e4cfaad2d4a6c150cfa not found: ID does not exist"
Jul 14 11:52:52.920828 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.920794    2581 scope.go:117] "RemoveContainer" containerID="f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2"
Jul 14 11:52:52.921018 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:52:52.921000    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2\": container with ID starting with f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2 not found: ID does not exist" containerID="f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2"
Jul 14 11:52:52.921065 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.921025    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2"} err="failed to get container status \"f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2\": rpc error: code = NotFound desc = could not find container \"f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2\": container with ID starting with f21f5323ea888e1e533aedfb6aaffda49dda936dd5a40db6c5695b87b308f1e2 not found: ID does not exist"
Jul 14 11:52:52.933321 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.933297    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"]
Jul 14 11:52:52.935537 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:52.935518    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6b8edc-openshift-default-68856f5bdc-msgqx"]
Jul 14 11:52:54.052516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:52:54.052486    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" path="/var/lib/kubelet/pods/c3380aac-f706-4d3f-b1cc-edeca34105a3/volumes"
Jul 14 11:53:13.307097 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:13.307063    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"]
Jul 14 11:53:13.307594 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:13.307306    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy" containerID="cri-o://54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56" gracePeriod=30
Jul 14 11:53:15.307167 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:15.307116    2581 patch_prober.go:28] interesting pod/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 11:53:15.307457 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:15.307197    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 11:53:18.557458 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.557430    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:53:18.663533 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663464    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-istio-token\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.663533 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663508    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g4zl\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-kube-api-access-8g4zl\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.663703 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-certs\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.663703 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-data\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.663703 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663663    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-credential-socket\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.663810 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663716    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:53:18.663810 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663725    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-envoy\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.663810 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663760    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0192a6f6-033d-4301-98ed-b59902341010-istio-podinfo\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.663810 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0192a6f6-033d-4301-98ed-b59902341010-istiod-ca-cert\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.664024 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.663862    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-socket\") pod \"0192a6f6-033d-4301-98ed-b59902341010\" (UID: \"0192a6f6-033d-4301-98ed-b59902341010\") "
Jul 14 11:53:18.664211 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.664191    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-certs\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.664304 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.664281    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0192a6f6-033d-4301-98ed-b59902341010-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 11:53:18.664396 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.664364    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:53:18.664462 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.664422    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-data" (OuterVolumeSpecName: "istio-data") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:53:18.664462 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.664433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:53:18.665715 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.665688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-istio-token" (OuterVolumeSpecName: "istio-token") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:53:18.665859 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.665825    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0192a6f6-033d-4301-98ed-b59902341010-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 11:53:18.666134 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.666113    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 11:53:18.666134 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.666120    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-kube-api-access-8g4zl" (OuterVolumeSpecName: "kube-api-access-8g4zl") pod "0192a6f6-033d-4301-98ed-b59902341010" (UID: "0192a6f6-033d-4301-98ed-b59902341010"). InnerVolumeSpecName "kube-api-access-8g4zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 11:53:18.764683 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764661    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0192a6f6-033d-4301-98ed-b59902341010-istiod-ca-cert\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.764683 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764682    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-workload-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.764864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764691    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-istio-token\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.764864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764700    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g4zl\" (UniqueName: \"kubernetes.io/projected/0192a6f6-033d-4301-98ed-b59902341010-kube-api-access-8g4zl\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.764864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764709    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-data\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.764864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764717    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-credential-socket\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.764864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764726    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0192a6f6-033d-4301-98ed-b59902341010-istio-envoy\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:18.764864 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:18.764733    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0192a6f6-033d-4301-98ed-b59902341010-istio-podinfo\") on node \"ip-10-0-128-125.ec2.internal\" DevicePath \"\""
Jul 14 11:53:19.036129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.036045    2581 generic.go:356] "Generic (PLEG): container finished" podID="0192a6f6-033d-4301-98ed-b59902341010" containerID="54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56" exitCode=0
Jul 14 11:53:19.036129 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.036091    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"
Jul 14 11:53:19.036337 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.036125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" event={"ID":"0192a6f6-033d-4301-98ed-b59902341010","Type":"ContainerDied","Data":"54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56"}
Jul 14 11:53:19.036337 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.036197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn" event={"ID":"0192a6f6-033d-4301-98ed-b59902341010","Type":"ContainerDied","Data":"bb79765aee4f79fe5741f492df2c0d2e874a1d946fcc354a33f2fff300fa30bc"}
Jul 14 11:53:19.036337 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.036220    2581 scope.go:117] "RemoveContainer" containerID="54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56"
Jul 14 11:53:19.046238 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.046222    2581 scope.go:117] "RemoveContainer" containerID="d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f"
Jul 14 11:53:19.053905 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.053889    2581 scope.go:117] "RemoveContainer" containerID="54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56"
Jul 14 11:53:19.054128 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:53:19.054110    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56\": container with ID starting with 54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56 not found: ID does not exist" containerID="54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56"
Jul 14 11:53:19.054199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.054134    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56"} err="failed to get container status \"54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56\": rpc error: code = NotFound desc = could not find container \"54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56\": container with ID starting with 54593d71bd62194c96754023d806d4d3f2fd9aac8a5e7232bc22e49d0767fe56 not found: ID does not exist"
Jul 14 11:53:19.054199 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.054164    2581 scope.go:117] "RemoveContainer" containerID="d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f"
Jul 14 11:53:19.054374 ip-10-0-128-125 kubenswrapper[2581]: E0714 11:53:19.054357    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f\": container with ID starting with d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f not found: ID does not exist" containerID="d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f"
Jul 14 11:53:19.054419 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.054379    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f"} err="failed to get container status \"d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f\": rpc error: code = NotFound desc = could not find container \"d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f\": container with ID starting with d7f1c5414ad402d727268830d4520caf34cbdbdeef279e49834135e4ba62553f not found: ID does not exist"
Jul 14 11:53:19.063831 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.063808    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"]
Jul 14 11:53:19.066964 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.066940    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5c5a7d-openshift-default-86c4df545f-799gn"]
Jul 14 11:53:19.483209 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.483182    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5794fb4596-lvfpk_56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64/manager/0.log"
Jul 14 11:53:19.856965 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.856938    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff488f585-hc7fc_4ddd1523-609a-437c-909b-5ce510b549d1/copy-manifests/0.log"
Jul 14 11:53:19.864196 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:19.864179    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff488f585-hc7fc_4ddd1523-609a-437c-909b-5ce510b549d1/manager/0.log"
Jul 14 11:53:20.051990 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:20.051958    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0192a6f6-033d-4301-98ed-b59902341010" path="/var/lib/kubelet/pods/0192a6f6-033d-4301-98ed-b59902341010/volumes"
Jul 14 11:53:20.665905 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:20.665878    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733810-g6z9d_11455530-3cb0-4e38-a1c2-9cc4f2761466/cleanup/0.log"
Jul 14 11:53:20.797469 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:20.797439    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733825-tj69k_098bca83-34b1-4b1c-8f47-75fd0ab3358d/cleanup/0.log"
Jul 14 11:53:20.917257 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:20.917182    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-02a04895-kxf2t_4b40c483-af6d-476b-9b59-aecf3e5886db/revoke-keys/0.log"
Jul 14 11:53:21.036233 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:21.036208    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-57573546-t4hmb_2dba424d-5403-43d8-8fd9-790684cd2742/revoke-keys/1.log"
Jul 14 11:53:21.155222 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:21.155198    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-bb21d4-ccnbm_9bf5a4d3-aea2-47bb-bb02-784d393134ff/revoke-keys/0.log"
Jul 14 11:53:21.408518 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:21.408488    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-1cf7269b-6nvxc_681049d0-afad-4318-9fdc-b542a9b54b0b/revoke-keys/0.log"
Jul 14 11:53:21.527485 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:21.527454    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-1b0afa-xrh6t_ca665413-a6b3-4590-abe0-22036e975127/revoke-keys/0.log"
Jul 14 11:53:21.758465 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:21.758393    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-c50a5e30-68nld_63236df9-8832-4801-a35b-c31431ced58c/revoke-keys/0.log"
Jul 14 11:53:21.881365 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:21.881332    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-1ba6ef6c-6g59r_041294ce-02bd-4b8a-9542-40779f22a059/revoke-keys/0.log"
Jul 14 11:53:22.001871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:22.001846    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-c5ce9ebd-jhf96_14a2c7da-d8a7-4882-aa2a-ca65a25120c9/revoke-keys/0.log"
Jul 14 11:53:24.135359 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:24.135332    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-m8mzx_eff9ce3a-0f66-4e43-b999-b396963921a7/kuadrant-console-plugin/0.log"
Jul 14 11:53:25.301013 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:25.300985    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f79597649-9vmd4_571648b5-5085-4e89-9f52-70668da030d1/kube-auth-proxy/0.log"
Jul 14 11:53:25.670953 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:25.670867    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tng2s_64185333-d171-469c-beb3-861211f468bc/payload-pre-processing/0.log"
Jul 14 11:53:25.789895 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:25.789861    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-z5kr8_d605f0a6-194d-46b9-87cc-50ee23f39df7/payload-processing/0.log"
Jul 14 11:53:25.911412 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:25.911383    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbbc7db94-vdx9z_77e7b20a-f34d-4c02-96f3-561ed0832cbc/router/0.log"
Jul 14 11:53:26.275749 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:26.275725    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-jjswm_5d429d75-eb35-40c6-8e76-59804903c58a/main/0.log"
Jul 14 11:53:26.511520 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:26.511488    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ltn78_bc703cdc-09b3-4ee3-9f79-f85432e01d4d/main/0.log"
Jul 14 11:53:33.806819 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:33.806786    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lvmq6_e0c360fc-9142-49aa-91ad-b2f93750c852/global-pull-secret-syncer/0.log"
Jul 14 11:53:33.998804 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:33.998776    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qg6c7_ae81f669-74d5-4af6-99ea-590029ff201b/konnectivity-agent/0.log"
Jul 14 11:53:34.058889 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:34.058818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-125.ec2.internal_7c473f26d8bf8389afb77ad42acd15a9/haproxy/0.log"
Jul 14 11:53:39.725284 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:39.725254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-m8mzx_eff9ce3a-0f66-4e43-b999-b396963921a7/kuadrant-console-plugin/0.log"
Jul 14 11:53:41.762107 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:41.762078    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc169ec4-029a-464e-a7ff-f547c722fc5b/alertmanager/0.log"
Jul 14 11:53:41.787944 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:41.787919    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc169ec4-029a-464e-a7ff-f547c722fc5b/config-reloader/0.log"
Jul 14 11:53:41.824399 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:41.824369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc169ec4-029a-464e-a7ff-f547c722fc5b/kube-rbac-proxy-web/0.log"
Jul 14 11:53:41.853871 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:41.853846    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc169ec4-029a-464e-a7ff-f547c722fc5b/kube-rbac-proxy/0.log"
Jul 14 11:53:41.883348 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:41.883289    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc169ec4-029a-464e-a7ff-f547c722fc5b/kube-rbac-proxy-metric/0.log"
Jul 14 11:53:41.909719 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:41.909696    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc169ec4-029a-464e-a7ff-f547c722fc5b/prom-label-proxy/0.log"
Jul 14 11:53:41.941042 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:41.941023    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc169ec4-029a-464e-a7ff-f547c722fc5b/init-config-reloader/0.log"
Jul 14 11:53:42.143513 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.143436    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-gwppw_30c47a78-7933-4521-8e39-5a623083cb6b/monitoring-plugin/0.log"
Jul 14 11:53:42.388726 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.388702    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xsn9q_1b77bcc4-9ca1-44fa-a95b-9101e944b3e6/node-exporter/0.log"
Jul 14 11:53:42.417291 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.417211    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xsn9q_1b77bcc4-9ca1-44fa-a95b-9101e944b3e6/kube-rbac-proxy/0.log"
Jul 14 11:53:42.442920 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.442900    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xsn9q_1b77bcc4-9ca1-44fa-a95b-9101e944b3e6/init-textfile/0.log"
Jul 14 11:53:42.473652 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.473627    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8w7bw_11374f1c-49aa-4b35-970c-b7784cda3dd0/kube-rbac-proxy-main/0.log"
Jul 14 11:53:42.512441 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.512415    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8w7bw_11374f1c-49aa-4b35-970c-b7784cda3dd0/kube-rbac-proxy-self/0.log"
Jul 14 11:53:42.538612 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.538592    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8w7bw_11374f1c-49aa-4b35-970c-b7784cda3dd0/openshift-state-metrics/0.log"
Jul 14 11:53:42.578077 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.578057    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34021b3b-8c28-4364-9fc9-2b8ad7c93df9/prometheus/0.log"
Jul 14 11:53:42.604426 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.604402    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34021b3b-8c28-4364-9fc9-2b8ad7c93df9/config-reloader/0.log"
Jul 14 11:53:42.629030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.629009    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34021b3b-8c28-4364-9fc9-2b8ad7c93df9/thanos-sidecar/0.log"
Jul 14 11:53:42.659119 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.659097    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34021b3b-8c28-4364-9fc9-2b8ad7c93df9/kube-rbac-proxy-web/0.log"
Jul 14 11:53:42.683326 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.683268    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34021b3b-8c28-4364-9fc9-2b8ad7c93df9/kube-rbac-proxy/0.log"
Jul 14 11:53:42.708530 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.708501    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34021b3b-8c28-4364-9fc9-2b8ad7c93df9/kube-rbac-proxy-thanos/0.log"
Jul 14 11:53:42.740125 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.740108    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_34021b3b-8c28-4364-9fc9-2b8ad7c93df9/init-config-reloader/0.log"
Jul 14 11:53:42.776054 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.776025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hb2dd_08c53e81-c8b5-4f91-9a48-63bde39e7f68/prometheus-operator/0.log"
Jul 14 11:53:42.800924 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.800888    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hb2dd_08c53e81-c8b5-4f91-9a48-63bde39e7f68/kube-rbac-proxy/0.log"
Jul 14 11:53:42.834797 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.834774    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-h9dv5_2e07ea80-3034-4a27-86ea-263da767ca1d/prometheus-operator-admission-webhook/0.log"
Jul 14 11:53:42.868312 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.868291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8464f65bd-5z2lv_c773a67d-224f-4a39-b1db-9d766f0a600f/telemeter-client/0.log"
Jul 14 11:53:42.892668 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.892652    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8464f65bd-5z2lv_c773a67d-224f-4a39-b1db-9d766f0a600f/reload/0.log"
Jul 14 11:53:42.921080 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:42.921063    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8464f65bd-5z2lv_c773a67d-224f-4a39-b1db-9d766f0a600f/kube-rbac-proxy/0.log"
Jul 14 11:53:43.516033 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516000    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"]
Jul 14 11:53:43.516418 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516405    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy"
Jul 14 11:53:43.516468 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516419    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy"
Jul 14 11:53:43.516516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516482    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy"
Jul 14 11:53:43.516516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516493    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy"
Jul 14 11:53:43.516516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516502    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26ccfb3-819c-4ff4-97ff-d6e114c42e3c" containerName="test-curl-7757-140190212301856"
Jul 14 11:53:43.516516 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516511    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26ccfb3-819c-4ff4-97ff-d6e114c42e3c" containerName="test-curl-7757-140190212301856"
Jul 14 11:53:43.516642 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516528    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy"
Jul 14 11:53:43.516642 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516537    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy"
Jul 14 11:53:43.516709 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516654    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3380aac-f706-4d3f-b1cc-edeca34105a3" containerName="istio-proxy"
Jul 14 11:53:43.516709 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516665    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy"
Jul 14 11:53:43.516709 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516674    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0192a6f6-033d-4301-98ed-b59902341010" containerName="istio-proxy"
Jul 14 11:53:43.516709 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.516683    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26ccfb3-819c-4ff4-97ff-d6e114c42e3c" containerName="test-curl-7757-140190212301856"
Jul 14 11:53:43.519822 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.519807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.534479 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.534462    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j46tr\"/\"default-dockercfg-ntl7c\""
Jul 14 11:53:43.534585 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.534466    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j46tr\"/\"kube-root-ca.crt\""
Jul 14 11:53:43.535202 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.535187    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j46tr\"/\"openshift-service-ca.crt\""
Jul 14 11:53:43.550742 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.550716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"]
Jul 14 11:53:43.585273 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.585246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-lib-modules\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.585386 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.585283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf2jp\" (UniqueName: \"kubernetes.io/projected/58aa84dc-f753-4bbf-8f10-b594d6929f9b-kube-api-access-vf2jp\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.585386 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.585303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-proc\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.585461 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.585379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-podres\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.585461 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.585411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-sys\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686290 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-lib-modules\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2jp\" (UniqueName: \"kubernetes.io/projected/58aa84dc-f753-4bbf-8f10-b594d6929f9b-kube-api-access-vf2jp\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-proc\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-podres\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686438 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-sys\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-proc\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-lib-modules\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-sys\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.686651 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.686503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58aa84dc-f753-4bbf-8f10-b594d6929f9b-podres\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.695219 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.695195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf2jp\" (UniqueName: \"kubernetes.io/projected/58aa84dc-f753-4bbf-8f10-b594d6929f9b-kube-api-access-vf2jp\") pod \"perf-node-gather-daemonset-nb4q7\" (UID: \"58aa84dc-f753-4bbf-8f10-b594d6929f9b\") " pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.828710 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.828685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:43.959951 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:43.959922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"]
Jul 14 11:53:43.961003 ip-10-0-128-125 kubenswrapper[2581]: W0714 11:53:43.960971    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58aa84dc_f753_4bbf_8f10_b594d6929f9b.slice/crio-e60eaece0224bcfba86726f549d5cb5c6d003f94dcd3183c119e36956562e2da WatchSource:0}: Error finding container e60eaece0224bcfba86726f549d5cb5c6d003f94dcd3183c119e36956562e2da: Status 404 returned error can't find the container with id e60eaece0224bcfba86726f549d5cb5c6d003f94dcd3183c119e36956562e2da
Jul 14 11:53:44.162521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:44.162442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7" event={"ID":"58aa84dc-f753-4bbf-8f10-b594d6929f9b","Type":"ContainerStarted","Data":"ffc2f2fb2cc18742ee10f026dc947ac754f901d270afff547ed789cea4641549"}
Jul 14 11:53:44.162521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:44.162494    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:44.162521 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:44.162511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7" event={"ID":"58aa84dc-f753-4bbf-8f10-b594d6929f9b","Type":"ContainerStarted","Data":"e60eaece0224bcfba86726f549d5cb5c6d003f94dcd3183c119e36956562e2da"}
Jul 14 11:53:44.182612 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:44.182566    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7" podStartSLOduration=1.182552381 podStartE2EDuration="1.182552381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:53:44.180830185 +0000 UTC m=+2810.633776055" watchObservedRunningTime="2026-07-14 11:53:44.182552381 +0000 UTC m=+2810.635498260"
Jul 14 11:53:45.315352 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:45.315322    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97699c468-hxwhd_7d708581-1884-43f9-80c6-aa26352e91c7/console/0.log"
Jul 14 11:53:45.369323 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:45.369294    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-lxkmm_1f299971-fa8c-4de0-a8a3-ad55d920d3f3/download-server/0.log"
Jul 14 11:53:46.011259 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:46.011230    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-cxbl6_f37f13c8-f48c-4753-b912-eaddfad26793/volume-data-source-validator/0.log"
Jul 14 11:53:47.140782 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:47.140754    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8l87r_7af456ff-1a86-41dc-90f9-6c6566c40355/dns/0.log"
Jul 14 11:53:47.167020 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:47.166978    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8l87r_7af456ff-1a86-41dc-90f9-6c6566c40355/kube-rbac-proxy/0.log"
Jul 14 11:53:47.513712 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:47.513642    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wxx9k_484fe3a1-4a30-4b1d-9d4f-5343989fd5e4/dns-node-resolver/0.log"
Jul 14 11:53:48.131285 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:48.131256    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xdmdm_ccf3a373-3d7c-4bbb-86fe-76aed78860f7/node-ca/0.log"
Jul 14 11:53:49.313030 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:49.313004    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f79597649-9vmd4_571648b5-5085-4e89-9f52-70668da030d1/kube-auth-proxy/0.log"
Jul 14 11:53:49.457140 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:49.457107    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tng2s_64185333-d171-469c-beb3-861211f468bc/payload-pre-processing/0.log"
Jul 14 11:53:49.491035 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:49.491007    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-z5kr8_d605f0a6-194d-46b9-87cc-50ee23f39df7/payload-processing/0.log"
Jul 14 11:53:49.519374 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:49.519347    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbbc7db94-vdx9z_77e7b20a-f34d-4c02-96f3-561ed0832cbc/router/0.log"
Jul 14 11:53:50.176310 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:50.176285    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j46tr/perf-node-gather-daemonset-nb4q7"
Jul 14 11:53:50.292198 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:50.292171    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlqhn_c88130e7-b11f-4ac9-bbbb-6bc55657e978/serve-healthcheck-canary/0.log"
Jul 14 11:53:50.984158 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:50.984132    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r9wpm_0779c170-99ba-4ca7-847e-6defef4ba484/kube-rbac-proxy/0.log"
Jul 14 11:53:51.031623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:51.031596    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r9wpm_0779c170-99ba-4ca7-847e-6defef4ba484/exporter/0.log"
Jul 14 11:53:51.060958 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:51.060903    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r9wpm_0779c170-99ba-4ca7-847e-6defef4ba484/extractor/0.log"
Jul 14 11:53:53.879254 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:53.879225    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5794fb4596-lvfpk_56ab2a02-57f7-4d1e-b8b0-d1d84f42ec64/manager/0.log"
Jul 14 11:53:54.018085 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:54.017998    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff488f585-hc7fc_4ddd1523-609a-437c-909b-5ce510b549d1/manager/0.log"
Jul 14 11:53:54.041875 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:54.041845    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ff488f585-hc7fc_4ddd1523-609a-437c-909b-5ce510b549d1/copy-manifests/0.log"
Jul 14 11:53:54.413708 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:54.413687    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f79597649-9vmd4_571648b5-5085-4e89-9f52-70668da030d1/kube-auth-proxy/0.log"
Jul 14 11:53:54.523022 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:54.522992    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tng2s_64185333-d171-469c-beb3-861211f468bc/payload-pre-processing/0.log"
Jul 14 11:53:54.574727 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:54.574697    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-z5kr8_d605f0a6-194d-46b9-87cc-50ee23f39df7/payload-processing/0.log"
Jul 14 11:53:54.599637 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:54.599608    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbbc7db94-vdx9z_77e7b20a-f34d-4c02-96f3-561ed0832cbc/router/0.log"
Jul 14 11:53:55.558645 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:55.558565    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d84b86c7f-xccbw_84f7a80f-131a-4411-88b8-cbb9f60a83d5/manager/0.log"
Jul 14 11:53:55.925687 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:55.925604    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f79597649-9vmd4_571648b5-5085-4e89-9f52-70668da030d1/kube-auth-proxy/0.log"
Jul 14 11:53:56.050349 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:56.050315    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tng2s_64185333-d171-469c-beb3-861211f468bc/payload-pre-processing/0.log"
Jul 14 11:53:56.072623 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:56.072595    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-z5kr8_d605f0a6-194d-46b9-87cc-50ee23f39df7/payload-processing/0.log"
Jul 14 11:53:56.086372 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:53:56.086354    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6fbbc7db94-vdx9z_77e7b20a-f34d-4c02-96f3-561ed0832cbc/router/0.log"
Jul 14 11:54:00.433345 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:54:00.433303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-mg4mx_f51b19a5-ff43-4f70-8354-13b915543ea3/migrator/0.log"
Jul 14 11:54:00.457412 ip-10-0-128-125 kubenswrapper[2581]: I0714 11:54:00.457387    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-mg4mx_f51b19a5-ff43-4f70-8354-13b915543ea3/graceful-termination/0.log"