Sep 10 14:19:48.914142 ip-10-0-135-201 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 14:19:49.289096 ip-10-0-135-201 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:19:49.289096 ip-10-0-135-201 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 14:19:49.289096 ip-10-0-135-201 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:19:49.289096 ip-10-0-135-201 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 14:19:49.289096 ip-10-0-135-201 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:19:49.291004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.290916    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 14:19:49.295038 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295023    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:49.295038 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295037    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295042    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295046    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295049    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295052    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295058    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295061    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295063    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295066    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295068    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295071    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295074    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295076    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295078    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295081    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295083    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295086    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295088    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295091    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295093    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:49.295100 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295095    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295098    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295100    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295103    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295106    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295108    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295111    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295114    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295118    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295122    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295124    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295127    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295129    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295132    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295134    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295137    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295139    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295143    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295145    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295148    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:49.295557 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295150    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295152    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295156    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295158    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295160    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295163    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295165    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295167    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295170    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295172    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295175    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295177    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295179    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295182    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295185    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295188    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295191    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295193    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295196    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295199    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:49.296082 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295202    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295204    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295206    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295209    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295211    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295214    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295218    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295221    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295224    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295227    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295230    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295233    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295236    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295238    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295241    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295244    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295246    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295249    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295251    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295254    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:49.296552 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295257    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295260    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295263    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295266    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295270    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295273    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295276    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295278    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295281    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295284    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295287    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295289    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295291    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295294    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295297    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295299    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295301    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295304    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295991    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:49.297055 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.295997    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296001    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296004    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296007    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296010    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296013    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296016    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296019    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296021    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296024    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296027    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296029    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296032    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296036    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296038    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296041    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296044    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296046    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296049    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296052    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:49.297511 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296054    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296057    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296060    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296063    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296065    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296068    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296071    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296073    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296076    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296079    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296081    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296084    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296088    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296092    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296095    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296098    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296100    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296103    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296107    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:49.298022 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296109    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296112    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296114    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296117    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296119    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296121    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296124    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296126    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296129    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296131    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296133    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296136    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296144    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296148    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296152    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296155    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296158    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296161    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296164    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296167    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:49.298514 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296169    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296172    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296174    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296177    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296180    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296182    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296185    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296188    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296191    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296193    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296196    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296199    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296202    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296204    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296207    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296209    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296212    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296214    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296216    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296219    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:49.298997 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296221    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296224    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296226    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296229    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296233    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296237    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296241    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296244    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296246    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296248    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296251    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296253    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296256    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296258    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296261    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296264    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296267    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296269    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296271    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:49.299464 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296616    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296620    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296623    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296626    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296629    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296632    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296634    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296637    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296640    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296642    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296645    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296647    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296650    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296652    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296655    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296657    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296659    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296663    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296665    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:49.299943 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296668    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296671    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296673    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296676    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296678    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296682    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296685    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296688    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296691    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296694    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296698    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296701    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296704    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296707    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296710    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296712    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296715    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296717    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296720    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:49.300388 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296723    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296726    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296728    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296732    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296735    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296738    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296741    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296743    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296746    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296748    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296750    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296753    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296756    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296758    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296761    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296764    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296767    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296770    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296772    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296775    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:49.300840 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296777    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296780    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296782    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296784    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296787    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296789    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296792    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296795    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296797    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296800    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296802    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296804    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296807    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296809    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296812    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296815    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296817    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296819    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296822    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296824    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:49.301428 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296827    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296829    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296832    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296834    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296837    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296852    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296855    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296858    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296861    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296864    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296867    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296869    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296872    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296874    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296877    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296879    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296882    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296885    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296887    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296890    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.296892    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:49.301937 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.296966    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297012    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297019    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297023    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297027    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297050    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297054    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297059    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297063    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297066    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297069    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297073    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297076    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297079    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297082    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297085    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297088    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297091    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297094    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297097    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297100    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297103    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297107    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297110    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 14:19:49.302447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297113    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297116    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297119    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297123    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297126    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297129    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297132    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297135    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297139    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297142    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297145    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297148    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297150    2577 flags.go:64] FLAG: --enable-server="true"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297153    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297158    2577 flags.go:64] FLAG: --event-burst="100"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297161    2577 flags.go:64] FLAG: --event-qps="50"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297164    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297167    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297170    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297173    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297176    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297181    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297184    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297187    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297190    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 14:19:49.303024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297193    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297197    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297200    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297203    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297206    2577 flags.go:64] FLAG: --feature-gates=""
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297209    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297212    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297215    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297218    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297221    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297224    2577 flags.go:64] FLAG: --help="false"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297227    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297230    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297233    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297236    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297239    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297243    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297246    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297248    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297251    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297254    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297257    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297260    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297263    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 10 14:19:49.303966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297266    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297268    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297271    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297274    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297278    2577 flags.go:64] FLAG: --lock-file=""
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297281    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297284    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297287    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297293    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297297    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297300    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297302    2577 flags.go:64] FLAG: --logging-format="text"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297305    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297308    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297311    2577 flags.go:64] FLAG: --manifest-url=""
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297314    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297318    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297321    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297326    2577 flags.go:64] FLAG: --max-pods="110"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297328    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297332    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297335    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297337    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297340    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297343    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 14:19:49.304647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297346    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297353    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297356    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297359    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297362    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297365    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297370    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297373    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297376    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297379    2577 flags.go:64] FLAG: --port="10250"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297382    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297385    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bd58effda7793aa9"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297390    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297393    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297396    2577 flags.go:64] FLAG: --register-node="true"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297399    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297405    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297408    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297411    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297414    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297417    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297421    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297424    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297427    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297430    2577 flags.go:64] FLAG: --runonce="false"
Sep 10 14:19:49.305562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297433    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297436    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297439    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297442    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297445    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297448    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297451    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297454    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297457    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297459    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297462    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297465    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297468    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297471    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297474    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297480    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297482    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297485    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297488    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297492    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297495    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297498    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297501    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297505    2577 flags.go:64] FLAG: --v="2"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297509    2577 flags.go:64] FLAG: --version="false"
Sep 10 14:19:49.306210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297513    2577 flags.go:64] FLAG: --vmodule=""
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297517    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.297520    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297641    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297645    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297648    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297651    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297653    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297657    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297659    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297662    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297665    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297668    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297670    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297673    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297676    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297678    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297681    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297683    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297686    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:49.306800 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297688    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297691    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297694    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297697    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297699    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297702    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297705    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297707    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297712    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297715    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297720    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297723    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297725    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297728    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297731    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297733    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297736    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297738    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297740    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297743    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:49.307289 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297745    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297748    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297750    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297753    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297756    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297758    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297760    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297763    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297767    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297770    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297773    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297776    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297780    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297783    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297786    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297790    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297793    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297796    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297799    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:49.307761 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297802    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297804    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297807    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297811    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297813    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297816    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297819    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297821    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297823    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297826    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297829    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297831    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297834    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297836    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297839    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297856    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297859    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297862    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297864    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297867    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:49.308288 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297870    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297872    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297876    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297880    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297884    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297889    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297892    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297895    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297897    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297901    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297904    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297906    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297909    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297912    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297914    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297919    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297921    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297924    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297926    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:49.308763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297929    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297932    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297934    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.297937    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.298492    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.306546    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.306563    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.306583    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.306589    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306645    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306651    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306655    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306659    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306662    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:49.309269 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306664    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306667    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306671    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306674    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306678    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306681    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306684    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306686    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306689    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306692    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306695    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306697    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306700    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306703    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306706    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306708    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306711    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306714    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306717    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:49.309639 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306720    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306723    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306725    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306728    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306731    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306734    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306737    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306740    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306743    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306745    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306748    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306751    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306753    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306756    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306758    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306761    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306763    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306766    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306768    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:49.310133 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306771    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306773    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306776    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306779    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306782    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306784    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306788    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306791    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306794    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306796    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306798    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306801    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306803    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306806    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306809    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306812    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306814    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306818    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306820    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306823    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:49.310594 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306825    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306828    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306830    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306833    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306835    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306837    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306853    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306856    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306859    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306861    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306864    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306867    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306870    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306872    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306875    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306877    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306881    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306883    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306886    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306889    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:49.311084 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306891    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306893    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306896    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306898    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306901    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306903    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306906    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306909    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306911    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306914    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306917    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306919    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306922    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306924    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306927    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:49.311586 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.306929    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.306934    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307047    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307052    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307055    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307057    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307059    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307063    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307067    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307070    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307073    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307076    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307079    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307081    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307085    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:49.311966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307087    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307090    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307092    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307095    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307098    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307100    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307103    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307105    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307107    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307110    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307112    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307115    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307117    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307120    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307122    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307125    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307127    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307130    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307132    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:49.312326 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307135    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307138    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307142    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307144    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307147    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307149    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307152    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307154    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307156    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307159    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307161    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307163    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307166    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307170    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307172    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307175    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307177    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307180    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307183    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:49.312782 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307186    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307188    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307190    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307193    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307196    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307199    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307201    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307204    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307206    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307209    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307211    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307213    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307216    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307218    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307221    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307223    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307225    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307228    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307230    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307233    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:49.313286 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307235    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307238    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307240    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307242    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307245    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307247    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307250    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307253    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307255    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307257    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307262    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307265    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307267    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307270    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307273    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307276    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307278    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307281    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307284    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:49.313775 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307286    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307289    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307291    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307294    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307297    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307300    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307303    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307305    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:49.307308    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.307312    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.307439    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.310836    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.311799    2577 server.go:1019] "Starting client certificate rotation"
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.311898    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:19:49.314272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.311936    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:19:49.314613 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.313990    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:19:49.316547 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.316527    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:19:49.327685 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.327663    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 10 14:19:49.330356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.330342    2577 log.go:25] "Validated CRI v1 image API"
Sep 10 14:19:49.331153 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.331139    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 14:19:49.334115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.334090    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85123b47-0b01-447d-a6a6-6ada7e107454:/dev/nvme0n1p3 951d7616-0235-4df7-ab66-19e5621fa4e9:/dev/nvme0n1p4]
Sep 10 14:19:49.334175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.334114    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 14:19:49.339958 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.339799    2577 manager.go:216] Machine: {Timestamp:2026-09-10 14:19:49.338838867 +0000 UTC m=+0.315968212 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3135445 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f0850d234ed427078b302b70cb092 SystemUUID:ec2f0850-d234-ed42-7078-b302b70cb092 BootID:2634d324-e304-47f5-8497-1cb11d924bb7 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:1a:45:4e:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:1a:45:4e:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:30:9d:86:39:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 14:19:49.339958 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.339949    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 14:19:49.340096 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.340070    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 14:19:49.342303 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.342273    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:19:49.342946 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.342921    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 14:19:49.343075 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.342948    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 14:19:49.344042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.344032    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 14:19:49.344075 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.344045    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 14:19:49.344075 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.344052    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:19:49.344687 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.344676    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:19:49.345340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.345330    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 14:19:49.347892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.347881    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:19:49.348008 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.347998    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 14:19:49.348050 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.348028    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 14:19:49.348050 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.348037    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 14:19:49.348050 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.348050    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 14:19:49.348158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.348060    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 10 14:19:49.348158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.348068    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 14:19:49.348434 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.348424    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:19:49.348494 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.348459    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:19:49.350361 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.350345    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 14:19:49.352200 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.352187    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 14:19:49.352263 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.352216    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 14:19:49.353091 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353080    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 14:19:49.353132 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353095    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 14:19:49.353132 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353102    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 14:19:49.353132 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353107    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 14:19:49.353132 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353116    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 14:19:49.353132 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353122    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 14:19:49.353281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353136    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 14:19:49.353281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353142    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 14:19:49.353281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353149    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 14:19:49.353281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353154    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 14:19:49.353281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353163    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 14:19:49.353281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353169    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 14:19:49.353712 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353703    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 14:19:49.353741 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.353713    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 14:19:49.357286 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.357271    2577 server.go:1268] "Started kubelet"
Sep 10 14:19:49.357410 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.357376    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 14:19:49.357520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.357365    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 14:19:49.357603 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.357551    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 14:19:49.358293 ip-10-0-135-201 systemd[1]: Started Kubernetes Kubelet.
Sep 10 14:19:49.358547 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.358512    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 14:19:49.359240 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.359215    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 14:19:49.360089 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.360022    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 14:19:49.360263 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.360233    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 14:19:49.360857 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.360458    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 14:19:49.363190 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.363172    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 14:19:49.363436 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.362410    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c8d0e13dc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.357245404 +0000 UTC m=+0.334374749,LastTimestamp:2026-09-10 14:19:49.357245404 +0000 UTC m=+0.334374749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.363904 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.363891    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 14:19:49.363948 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.363906    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 14:19:49.364065 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.364046    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:49.364670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.364521    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 14:19:49.364670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.364541    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 14:19:49.364670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.364513    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 14:19:49.364830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.364703    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 14:19:49.364830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.364711    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 14:19:49.365186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365170    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 14:19:49.365186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365184    2577 factory.go:55] Registering systemd factory
Sep 10 14:19:49.365186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365191    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 10 14:19:49.365402 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365388    2577 factory.go:153] Registering CRI-O factory
Sep 10 14:19:49.365451 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365406    2577 factory.go:223] Registration of the crio container factory successfully
Sep 10 14:19:49.365451 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365424    2577 factory.go:103] Registering Raw factory
Sep 10 14:19:49.365451 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365437    2577 manager.go:1196] Started watching for new ooms in manager
Sep 10 14:19:49.365944 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.365930    2577 manager.go:349] Starting recovery of all containers
Sep 10 14:19:49.374337 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.374315    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 14:19:49.375909 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.375868    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 14:19:49.379544 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.379527    2577 manager.go:354] Recovery completed
Sep 10 14:19:49.384255 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.384243    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:49.386274 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.386250    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:49.386341 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.386285    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:49.386341 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.386295    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:49.386811 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.386797    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 14:19:49.386811 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.386811    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 14:19:49.386921 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.386818    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:49.386921 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.386829    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:19:49.387489 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.387474    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:49.387558 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.387498    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:49.387558 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.387507    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:49.388478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.388466    2577 policy_none.go:49] "None policy: Start"
Sep 10 14:19:49.388523 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.388481    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 14:19:49.388523 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.388491    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 14:19:49.389315 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.389303    2577 policy_none.go:47] "Start"
Sep 10 14:19:49.394091 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.394032    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c8ec90038  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-201.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.386272824 +0000 UTC m=+0.363402168,LastTimestamp:2026-09-10 14:19:49.386272824 +0000 UTC m=+0.363402168,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.397013 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.396945    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c8ec943b9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-201.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.386290105 +0000 UTC m=+0.363419450,LastTimestamp:2026-09-10 14:19:49.386290105 +0000 UTC m=+0.363419450,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.402818 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.402760    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c8ec96956  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-201.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.386299734 +0000 UTC m=+0.363429078,LastTimestamp:2026-09-10 14:19:49.386299734 +0000 UTC m=+0.363429078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.405821 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.405764    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-201.ec2.internal.18d3fb7c8ec90038\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c8ec90038  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-201.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.386272824 +0000 UTC m=+0.363402168,LastTimestamp:2026-09-10 14:19:49.38748697 +0000 UTC m=+0.364616317,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.412709 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.412635    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-201.ec2.internal.18d3fb7c8ec943b9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c8ec943b9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-201.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.386290105 +0000 UTC m=+0.363419450,LastTimestamp:2026-09-10 14:19:49.387502579 +0000 UTC m=+0.364631926,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.415470 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.415457    2577 manager.go:337] "Starting Device Plugin manager"
Sep 10 14:19:49.415541 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.415490    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 14:19:49.415541 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.415502    2577 server.go:87] "Starting device plugin registration server"
Sep 10 14:19:49.416042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.415755    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 14:19:49.416042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.415771    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 14:19:49.416042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.415978    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 14:19:49.416211 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.416054    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 14:19:49.416211 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.416064    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 14:19:49.416479 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.416460    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 14:19:49.416556 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.416434    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-201.ec2.internal.18d3fb7c8ec96956\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c8ec96956  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-201.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.386299734 +0000 UTC m=+0.363429078,LastTimestamp:2026-09-10 14:19:49.387511001 +0000 UTC m=+0.364640345,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.416556 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.416511    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:49.419782 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.419722    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-201.ec2.internal.18d3fb7c90a9e71e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-201.ec2.internal,UID:ip-10-0-135-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-135-201.ec2.internal,},FirstTimestamp:2026-09-10 14:19:49.417789214 +0000 UTC m=+0.394918551,LastTimestamp:2026-09-10 14:19:49.417789214 +0000 UTC m=+0.394918551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-201.ec2.internal,}"
Sep 10 14:19:49.449013 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.448980    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mq4z2"
Sep 10 14:19:49.456835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.456815    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mq4z2"
Sep 10 14:19:49.502202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.502169    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 14:19:49.503477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.503452    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 14:19:49.503578 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.503517    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 14:19:49.503578 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.503550    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 14:19:49.503684 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.503595    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 14:19:49.506006 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.505979    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 10 14:19:49.516060 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.516047    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:49.516870 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.516837    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:49.516952 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.516884    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:49.516952 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.516895    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:49.516952 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.516918    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.533973 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.533955    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.534053 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.533979    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-201.ec2.internal\": node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:49.552128 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.552080    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:49.604712 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.604687    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal"]
Sep 10 14:19:49.604799 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.604751    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:49.606295 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.606280    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:49.606360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.606307    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:49.606360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.606316    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:49.607537 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.607525    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:49.607639 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.607625    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.607688 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.607653    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:49.608286 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.608272    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:49.608342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.608299    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:49.608342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.608308    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:49.608342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.608319    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:49.608342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.608339    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:49.608463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.608347    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:49.609352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.609336    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.609437 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.609362    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:49.610050 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.610026    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:49.610139 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.610055    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:49.610139 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.610066    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:49.634439 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.634420    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-201.ec2.internal\" not found" node="ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.638810 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.638794    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-201.ec2.internal\" not found" node="ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.653175 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.653156    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:49.665801 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.665784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2f6b5702b027da2342207c9447b842c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-201.ec2.internal\" (UID: \"c2f6b5702b027da2342207c9447b842c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.665906 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.665807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59072bbf50c8f3e626da75a501f73c36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"59072bbf50c8f3e626da75a501f73c36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.665906 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.665823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59072bbf50c8f3e626da75a501f73c36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"59072bbf50c8f3e626da75a501f73c36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.753935 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.753899    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:49.766298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.766263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59072bbf50c8f3e626da75a501f73c36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"59072bbf50c8f3e626da75a501f73c36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.766386 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.766311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59072bbf50c8f3e626da75a501f73c36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"59072bbf50c8f3e626da75a501f73c36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.766386 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.766342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2f6b5702b027da2342207c9447b842c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-201.ec2.internal\" (UID: \"c2f6b5702b027da2342207c9447b842c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.766386 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.766351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59072bbf50c8f3e626da75a501f73c36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"59072bbf50c8f3e626da75a501f73c36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.766386 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.766369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2f6b5702b027da2342207c9447b842c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-201.ec2.internal\" (UID: \"c2f6b5702b027da2342207c9447b842c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.766535 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.766414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59072bbf50c8f3e626da75a501f73c36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"59072bbf50c8f3e626da75a501f73c36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.854732 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.854664    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:49.936163 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.936121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.942019 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:49.941894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:49.955202 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:49.955172    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:50.055756 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.055719    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:50.155894 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.155834    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found"
Sep 10 14:19:50.201205 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.201175    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:50.264511 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.264476    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:50.277013 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.276992    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:19:50.278607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.278594    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal"
Sep 10 14:19:50.287831 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.287813    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:19:50.312852 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.312816    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 14:19:50.313279 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.312974    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 14:19:50.350929 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.350896    2577 apiserver.go:52] "Watching apiserver"
Sep 10 14:19:50.364258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.364227    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 14:19:50.365307 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.365291    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 14:19:50.365630 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.365611    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-bj4nk","kube-system/konnectivity-agent-pdnp7","kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal","openshift-multus/multus-blcrs","openshift-multus/network-metrics-daemon-bfpgk","openshift-ovn-kubernetes/ovnkube-node-5fmnl","kube-system/global-pull-secret-syncer-d7fcl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8","openshift-cluster-node-tuning-operator/tuned-d6r4d","openshift-dns/node-resolver-h7d2p","openshift-image-registry/node-ca-4szv6","openshift-multus/multus-additional-cni-plugins-65ppf","openshift-network-diagnostics/network-check-target-9c5g9"]
Sep 10 14:19:50.367117 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.367100    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.368244 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.368224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.369146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.369124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.369300 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.369279    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 14:19:50.369425 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.369403    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:19:50.369700 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.369682    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7wlvw\""
Sep 10 14:19:50.369940 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.369924    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 14:19:50.370255 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.370239    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 14:19:50.370301 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.370271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.370484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.370459    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 14:19:50.370564 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.370475    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-shvcc\""
Sep 10 14:19:50.370724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.370707    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 14:19:50.370823 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.370808    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 14:19:50.370862 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.370846    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 14:19:50.371154 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.371140    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:19:50.371335 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.371321    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 14:19:50.371529 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.371516    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.372586 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.372569    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.372672 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.372604    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wksrg\""
Sep 10 14:19:50.373298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.373276    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 14:19:50.373384 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.373284    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 14:19:50.373483 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.373467    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 14:19:50.373541 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.373518    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 14:19:50.373625 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.373596    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jq5qb\""
Sep 10 14:19:50.373700 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.373685    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 14:19:50.373873 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.373844    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:50.373956 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.373934    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:19:50.374210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.374193    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 14:19:50.374278 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.374242    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 14:19:50.374355 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.374337    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2hcfz\""
Sep 10 14:19:50.375033 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.375007    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 14:19:50.375140 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.375036    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 14:19:50.375990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.375293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.375990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.375725    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 14:19:50.376146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.376017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lh5rx\""
Sep 10 14:19:50.377141 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.377121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.377505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.377485    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m7jbv\""
Sep 10 14:19:50.377773 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.377750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 14:19:50.377976 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.377959    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 14:19:50.378603 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.378581    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:19:50.378790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.378773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.379197 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.379178    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6gnkr\""
Sep 10 14:19:50.379500 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.379481    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 14:19:50.379598 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.379574    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 14:19:50.379948 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.379931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.380034 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.380015    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:19:50.381128 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.381112    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 14:19:50.381210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.381158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:50.381266 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.381211    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:19:50.381447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.381430    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 14:19:50.381501 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.381468    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 14:19:50.381501 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.381489    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t8v7h\""
Sep 10 14:19:50.402042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.402021    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9ngcv"
Sep 10 14:19:50.413680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.413658    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9ngcv"
Sep 10 14:19:50.461047 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.461000    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 14:14:49 +0000 UTC" deadline="2028-02-17 18:04:10.974878843 +0000 UTC"
Sep 10 14:19:50.461047 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.461045    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12603h44m20.513838082s"
Sep 10 14:19:50.466023 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.466007    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 14:19:50.471051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-cnibin\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.471148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-netns\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.471148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95gz\" (UniqueName: \"kubernetes.io/projected/7ff275a5-cead-4c8f-8566-70d4518b543b-kube-api-access-b95gz\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.471148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-cni-bin\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.471148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f4440b5-f048-4eec-9320-3e3417e6235e-kubelet-config\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.471148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-cni-multus\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.471320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-kubelet\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.471320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-654q6\" (UniqueName: \"kubernetes.io/projected/316800cc-cd67-42e6-921e-b15d3781b63f-kube-api-access-654q6\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.471320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysctl-d\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.471320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-lib-modules\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.471320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-etc-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.471320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.471320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84vvf\" (UniqueName: \"kubernetes.io/projected/0247963a-2fc0-49a4-8cb2-5f7834cfd990-kube-api-access-84vvf\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-cni-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471385    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-etc-kubernetes\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-run-netns\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-k8s-cni-cncf-io\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471433    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-systemd\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-systemd-units\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d4da659-33c3-4c05-adab-1b3614777fe0-agent-certs\") pod \"konnectivity-agent-pdnp7\" (UID: \"5d4da659-33c3-4c05-adab-1b3614777fe0\") " pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-system-cni-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.471526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pkht\" (UniqueName: \"kubernetes.io/projected/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-kube-api-access-4pkht\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-socket-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-registration-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysconfig\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471624    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-cni-bin\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-cni-binary-copy\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-socket-dir-parent\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-kubelet\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/316800cc-cd67-42e6-921e-b15d3781b63f-host\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-run\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ff275a5-cead-4c8f-8566-70d4518b543b-tmp\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-var-lib-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-ovn\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-log-socket\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-cni-netd\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovnkube-script-lib\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxrlk\" (UniqueName: \"kubernetes.io/projected/3f3b4437-66f7-459d-b8d1-df60d8436024-kube-api-access-qxrlk\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.472148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-cnibin\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovnkube-config\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.471998    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xknnw\" (UniqueName: \"kubernetes.io/projected/ac25a174-3eea-404a-80a9-33dac61a6a7d-kube-api-access-xknnw\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-conf-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-host\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-iptables-alerter-script\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvwcr\" (UniqueName: \"kubernetes.io/projected/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-kube-api-access-zvwcr\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysctl-conf\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-systemd\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-hostroot\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovn-node-metrics-cert\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.472883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-system-cni-dir\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f4440b5-f048-4eec-9320-3e3417e6235e-dbus\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pr6s\" (UniqueName: \"kubernetes.io/projected/94ff6d83-2107-4f30-81de-6a7cb1ead18c-kube-api-access-9pr6s\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-daemon-config\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-multus-certs\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-var-lib-kubelet\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-kubernetes\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-sys\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-tuned\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f3b4437-66f7-459d-b8d1-df60d8436024-hosts-file\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrsv\" (UniqueName: \"kubernetes.io/projected/3452b014-375b-406a-aa70-470bce2af0cb-kube-api-access-xnrsv\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-modprobe-d\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-sys-fs\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d4da659-33c3-4c05-adab-1b3614777fe0-konnectivity-ca\") pod \"konnectivity-agent-pdnp7\" (UID: \"5d4da659-33c3-4c05-adab-1b3614777fe0\") " pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.473588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-slash\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.472968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.473025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-device-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.473076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f3b4437-66f7-459d-b8d1-df60d8436024-tmp-dir\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.473106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/316800cc-cd67-42e6-921e-b15d3781b63f-serviceca\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.473136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-host-slash\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.473196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-node-log\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.474225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.473244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-env-overrides\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.542186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.542145    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:50.562216 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.562180    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59072bbf50c8f3e626da75a501f73c36.slice/crio-79b85058ddf08b8fbf062a2db13bca02b68762acfd43b1a33f058b909c8dc362 WatchSource:0}: Error finding container 79b85058ddf08b8fbf062a2db13bca02b68762acfd43b1a33f058b909c8dc362: Status 404 returned error can't find the container with id 79b85058ddf08b8fbf062a2db13bca02b68762acfd43b1a33f058b909c8dc362
Sep 10 14:19:50.562982 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.562944    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f6b5702b027da2342207c9447b842c.slice/crio-ac1e569107573940645bd621e1026ec2c1860497c53669161f9d9b6f1e105bb3 WatchSource:0}: Error finding container ac1e569107573940645bd621e1026ec2c1860497c53669161f9d9b6f1e105bb3: Status 404 returned error can't find the container with id ac1e569107573940645bd621e1026ec2c1860497c53669161f9d9b6f1e105bb3
Sep 10 14:19:50.568909 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.568887    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:19:50.573669 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-system-cni-dir\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.573790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f4440b5-f048-4eec-9320-3e3417e6235e-dbus\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.573790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pr6s\" (UniqueName: \"kubernetes.io/projected/94ff6d83-2107-4f30-81de-6a7cb1ead18c-kube-api-access-9pr6s\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.573790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-system-cni-dir\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.573989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-daemon-config\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.573989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-multus-certs\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.573989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-var-lib-kubelet\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.573989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-kubernetes\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.573989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-sys\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.573989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-tuned\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.573989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f3b4437-66f7-459d-b8d1-df60d8436024-hosts-file\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-kubernetes\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrsv\" (UniqueName: \"kubernetes.io/projected/3452b014-375b-406a-aa70-470bce2af0cb-kube-api-access-xnrsv\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f4440b5-f048-4eec-9320-3e3417e6235e-dbus\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-multus-certs\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-sys\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.573997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-var-lib-kubelet\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f3b4437-66f7-459d-b8d1-df60d8436024-hosts-file\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-modprobe-d\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-sys-fs\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d4da659-33c3-4c05-adab-1b3614777fe0-konnectivity-ca\") pod \"konnectivity-agent-pdnp7\" (UID: \"5d4da659-33c3-4c05-adab-1b3614777fe0\") " pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.574191    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574215    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-modprobe-d\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.574256    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret podName:3f4440b5-f048-4eec-9320-3e3417e6235e nodeName:}" failed. No retries permitted until 2026-09-10 14:19:51.074233945 +0000 UTC m=+2.051363300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret") pod "global-pull-secret-syncer-d7fcl" (UID: "3f4440b5-f048-4eec-9320-3e3417e6235e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:50.574345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574257    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-sys-fs\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-slash\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574327    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-device-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f3b4437-66f7-459d-b8d1-df60d8436024-tmp-dir\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/316800cc-cd67-42e6-921e-b15d3781b63f-serviceca\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-daemon-config\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-host-slash\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-node-log\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-env-overrides\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574531    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-slash\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-cnibin\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-cnibin\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-netns\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b95gz\" (UniqueName: \"kubernetes.io/projected/7ff275a5-cead-4c8f-8566-70d4518b543b-kube-api-access-b95gz\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-cni-bin\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.575312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-node-log\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f4440b5-f048-4eec-9320-3e3417e6235e-kubelet-config\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-cni-multus\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-kubelet\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654q6\" (UniqueName: \"kubernetes.io/projected/316800cc-cd67-42e6-921e-b15d3781b63f-kube-api-access-654q6\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysctl-d\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-lib-modules\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-etc-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d4da659-33c3-4c05-adab-1b3614777fe0-konnectivity-ca\") pod \"konnectivity-agent-pdnp7\" (UID: \"5d4da659-33c3-4c05-adab-1b3614777fe0\") " pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84vvf\" (UniqueName: \"kubernetes.io/projected/0247963a-2fc0-49a4-8cb2-5f7834cfd990-kube-api-access-84vvf\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-cni-multus\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-cni-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-etc-kubernetes\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-netns\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.576395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-device-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-run-netns\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-cni-bin\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-k8s-cni-cncf-io\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.574622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-host-slash\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-systemd\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-systemd-units\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d4da659-33c3-4c05-adab-1b3614777fe0-agent-certs\") pod \"konnectivity-agent-pdnp7\" (UID: \"5d4da659-33c3-4c05-adab-1b3614777fe0\") " pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-env-overrides\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/316800cc-cd67-42e6-921e-b15d3781b63f-serviceca\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-system-cni-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-etc-kubernetes\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-system-cni-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pkht\" (UniqueName: \"kubernetes.io/projected/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-kube-api-access-4pkht\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-cni-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f3b4437-66f7-459d-b8d1-df60d8436024-tmp-dir\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-socket-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.577340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-registration-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-socket-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysconfig\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575442    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-run-k8s-cni-cncf-io\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3452b014-375b-406a-aa70-470bce2af0cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-cni-bin\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-cni-binary-copy\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysctl-d\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-systemd\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-socket-dir-parent\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-systemd-units\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575538    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-registration-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-run-netns\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575494    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-cni-bin\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysconfig\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-lib-modules\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-socket-dir-parent\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f4440b5-f048-4eec-9320-3e3417e6235e-kubelet-config\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:50.578383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-kubelet\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575660    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-kubelet\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/316800cc-cd67-42e6-921e-b15d3781b63f-host\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/316800cc-cd67-42e6-921e-b15d3781b63f-host\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-run\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ff275a5-cead-4c8f-8566-70d4518b543b-tmp\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-host-var-lib-kubelet\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-var-lib-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-ovn\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-log-socket\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-cni-netd\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575851    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovnkube-script-lib\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-host-cni-netd\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-etc-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrlk\" (UniqueName: \"kubernetes.io/projected/3f3b4437-66f7-459d-b8d1-df60d8436024-kube-api-access-qxrlk\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-cnibin\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.579123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-var-lib-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-log-socket\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-ovn\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-run\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-cnibin\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-cni-binary-copy\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.575973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovnkube-config\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xknnw\" (UniqueName: \"kubernetes.io/projected/ac25a174-3eea-404a-80a9-33dac61a6a7d-kube-api-access-xknnw\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576214    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-conf-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-host\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-iptables-alerter-script\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvwcr\" (UniqueName: \"kubernetes.io/projected/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-kube-api-access-zvwcr\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysctl-conf\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.579670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-systemd\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-hostroot\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovn-node-metrics-cert\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576528    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-multus-conf-dir\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovnkube-config\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-host\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovnkube-script-lib\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576627    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-systemd\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94ff6d83-2107-4f30-81de-6a7cb1ead18c-run-openvswitch\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-sysctl-conf\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac25a174-3eea-404a-80a9-33dac61a6a7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.576713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-hostroot\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.576734    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.576786    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:51.076766617 +0000 UTC m=+2.053895955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.577132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3452b014-375b-406a-aa70-470bce2af0cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.580298 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.577262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-iptables-alerter-script\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.580886 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.578704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7ff275a5-cead-4c8f-8566-70d4518b543b-etc-tuned\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.580886 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.578745    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ff275a5-cead-4c8f-8566-70d4518b543b-tmp\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.580886 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.578906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d4da659-33c3-4c05-adab-1b3614777fe0-agent-certs\") pod \"konnectivity-agent-pdnp7\" (UID: \"5d4da659-33c3-4c05-adab-1b3614777fe0\") " pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.580886 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.579053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94ff6d83-2107-4f30-81de-6a7cb1ead18c-ovn-node-metrics-cert\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.583769 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.583749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pr6s\" (UniqueName: \"kubernetes.io/projected/94ff6d83-2107-4f30-81de-6a7cb1ead18c-kube-api-access-9pr6s\") pod \"ovnkube-node-5fmnl\" (UID: \"94ff6d83-2107-4f30-81de-6a7cb1ead18c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.587905 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.587821    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:50.587905 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.587847    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:50.587905 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.587861    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wtgk6 for pod openshift-network-diagnostics/network-check-target-9c5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:50.588114 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:50.587963    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6 podName:f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd nodeName:}" failed. No retries permitted until 2026-09-10 14:19:51.087940126 +0000 UTC m=+2.065069472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wtgk6" (UniqueName: "kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6") pod "network-check-target-9c5g9" (UID: "f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:50.589151 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.589088    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pkht\" (UniqueName: \"kubernetes.io/projected/32ea59b4-2294-48e2-aaef-7481d1e7b0a8-kube-api-access-4pkht\") pod \"iptables-alerter-bj4nk\" (UID: \"32ea59b4-2294-48e2-aaef-7481d1e7b0a8\") " pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.589496 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.589462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95gz\" (UniqueName: \"kubernetes.io/projected/7ff275a5-cead-4c8f-8566-70d4518b543b-kube-api-access-b95gz\") pod \"tuned-d6r4d\" (UID: \"7ff275a5-cead-4c8f-8566-70d4518b543b\") " pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.590108 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.590071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrsv\" (UniqueName: \"kubernetes.io/projected/3452b014-375b-406a-aa70-470bce2af0cb-kube-api-access-xnrsv\") pod \"multus-additional-cni-plugins-65ppf\" (UID: \"3452b014-375b-406a-aa70-470bce2af0cb\") " pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.590437 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.590405    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvwcr\" (UniqueName: \"kubernetes.io/projected/2695030e-e942-4e9e-9e50-3cd0d2b1fe7d-kube-api-access-zvwcr\") pod \"multus-blcrs\" (UID: \"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d\") " pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.590539 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.590441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84vvf\" (UniqueName: \"kubernetes.io/projected/0247963a-2fc0-49a4-8cb2-5f7834cfd990-kube-api-access-84vvf\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:50.590628 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.590603    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxrlk\" (UniqueName: \"kubernetes.io/projected/3f3b4437-66f7-459d-b8d1-df60d8436024-kube-api-access-qxrlk\") pod \"node-resolver-h7d2p\" (UID: \"3f3b4437-66f7-459d-b8d1-df60d8436024\") " pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.591333 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.591316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-654q6\" (UniqueName: \"kubernetes.io/projected/316800cc-cd67-42e6-921e-b15d3781b63f-kube-api-access-654q6\") pod \"node-ca-4szv6\" (UID: \"316800cc-cd67-42e6-921e-b15d3781b63f\") " pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.591426 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.591411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xknnw\" (UniqueName: \"kubernetes.io/projected/ac25a174-3eea-404a-80a9-33dac61a6a7d-kube-api-access-xknnw\") pod \"aws-ebs-csi-driver-node-t9md8\" (UID: \"ac25a174-3eea-404a-80a9-33dac61a6a7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.708416 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.708320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d6r4d"
Sep 10 14:19:50.716007 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.715983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-65ppf"
Sep 10 14:19:50.718681 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.718658    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff275a5_cead_4c8f_8566_70d4518b543b.slice/crio-879eb770222f6330f3f3dbc2199380817ab88917da676cda68563c341ef43795 WatchSource:0}: Error finding container 879eb770222f6330f3f3dbc2199380817ab88917da676cda68563c341ef43795: Status 404 returned error can't find the container with id 879eb770222f6330f3f3dbc2199380817ab88917da676cda68563c341ef43795
Sep 10 14:19:50.725265 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.725243    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3452b014_375b_406a_aa70_470bce2af0cb.slice/crio-4f92c98cf26e45573fe46e41eaab8a79dae9914e3fef40a5b6a851445da80e84 WatchSource:0}: Error finding container 4f92c98cf26e45573fe46e41eaab8a79dae9914e3fef40a5b6a851445da80e84: Status 404 returned error can't find the container with id 4f92c98cf26e45573fe46e41eaab8a79dae9914e3fef40a5b6a851445da80e84
Sep 10 14:19:50.736760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.736741    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bj4nk"
Sep 10 14:19:50.746360 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.746340    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ea59b4_2294_48e2_aaef_7481d1e7b0a8.slice/crio-77a530f56f3e9b3092b0e24a5f19f49b9198fbc73f66395a87edfb7d4fb9fa28 WatchSource:0}: Error finding container 77a530f56f3e9b3092b0e24a5f19f49b9198fbc73f66395a87edfb7d4fb9fa28: Status 404 returned error can't find the container with id 77a530f56f3e9b3092b0e24a5f19f49b9198fbc73f66395a87edfb7d4fb9fa28
Sep 10 14:19:50.748839 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.748818    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:19:50.759374 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.759354    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ff6d83_2107_4f30_81de_6a7cb1ead18c.slice/crio-91d3784f8ae7bea51a10a01c26cde38513d327e3563e941c60b5adf7aa011115 WatchSource:0}: Error finding container 91d3784f8ae7bea51a10a01c26cde38513d327e3563e941c60b5adf7aa011115: Status 404 returned error can't find the container with id 91d3784f8ae7bea51a10a01c26cde38513d327e3563e941c60b5adf7aa011115
Sep 10 14:19:50.765629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.765611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blcrs"
Sep 10 14:19:50.773720 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.773699    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2695030e_e942_4e9e_9e50_3cd0d2b1fe7d.slice/crio-331c7169370f38eaf0e7e607085308d0db94d906294354e0d8bf72a13a480336 WatchSource:0}: Error finding container 331c7169370f38eaf0e7e607085308d0db94d906294354e0d8bf72a13a480336: Status 404 returned error can't find the container with id 331c7169370f38eaf0e7e607085308d0db94d906294354e0d8bf72a13a480336
Sep 10 14:19:50.781090 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.781064    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8"
Sep 10 14:19:50.789324 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.789301    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac25a174_3eea_404a_80a9_33dac61a6a7d.slice/crio-b11e376f8b38a663d6bf4a8eff7fde95f3bfafbf24901c6089d1ef80490b6c46 WatchSource:0}: Error finding container b11e376f8b38a663d6bf4a8eff7fde95f3bfafbf24901c6089d1ef80490b6c46: Status 404 returned error can't find the container with id b11e376f8b38a663d6bf4a8eff7fde95f3bfafbf24901c6089d1ef80490b6c46
Sep 10 14:19:50.798053 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.798038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:19:50.806565 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.806546    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4da659_33c3_4c05_adab_1b3614777fe0.slice/crio-f10f253e93affab6b7ac3b427bfd1711bbc10feb1bf15635d47e2221d1e170ea WatchSource:0}: Error finding container f10f253e93affab6b7ac3b427bfd1711bbc10feb1bf15635d47e2221d1e170ea: Status 404 returned error can't find the container with id f10f253e93affab6b7ac3b427bfd1711bbc10feb1bf15635d47e2221d1e170ea
Sep 10 14:19:50.810446 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.810427    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:50.815071 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.815054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7d2p"
Sep 10 14:19:50.819947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:50.819933    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4szv6"
Sep 10 14:19:50.824614 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.824595    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3b4437_66f7_459d_b8d1_df60d8436024.slice/crio-be4031db038010ac4ae37f7820d2576e362847b5c4972e93ba6231bf55fa311d WatchSource:0}: Error finding container be4031db038010ac4ae37f7820d2576e362847b5c4972e93ba6231bf55fa311d: Status 404 returned error can't find the container with id be4031db038010ac4ae37f7820d2576e362847b5c4972e93ba6231bf55fa311d
Sep 10 14:19:50.829101 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:19:50.829081    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316800cc_cd67_42e6_921e_b15d3781b63f.slice/crio-3ecbd442bae499d0a2a9e37f3d9f86f0b5e19b0c6b552a9b426b6d89a459a606 WatchSource:0}: Error finding container 3ecbd442bae499d0a2a9e37f3d9f86f0b5e19b0c6b552a9b426b6d89a459a606: Status 404 returned error can't find the container with id 3ecbd442bae499d0a2a9e37f3d9f86f0b5e19b0c6b552a9b426b6d89a459a606
Sep 10 14:19:51.080685 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.080598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:51.080685 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.080641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:51.080868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.080748    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:51.080868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.080762    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:51.080868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.080813    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:52.080797398 +0000 UTC m=+3.057926746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:51.080868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.080862    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret podName:3f4440b5-f048-4eec-9320-3e3417e6235e nodeName:}" failed. No retries permitted until 2026-09-10 14:19:52.080824662 +0000 UTC m=+3.057954000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret") pod "global-pull-secret-syncer-d7fcl" (UID: "3f4440b5-f048-4eec-9320-3e3417e6235e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:51.094200 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.094180    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:51.181996 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.181941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:51.182206 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.182101    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:51.182206 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.182124    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:51.182206 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.182137    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wtgk6 for pod openshift-network-diagnostics/network-check-target-9c5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:51.182206 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.182206    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6 podName:f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd nodeName:}" failed. No retries permitted until 2026-09-10 14:19:52.182185769 +0000 UTC m=+3.159315121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtgk6" (UniqueName: "kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6") pod "network-check-target-9c5g9" (UID: "f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:51.415609 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.415541    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:14:50 +0000 UTC" deadline="2028-04-17 10:19:36.681942927 +0000 UTC"
Sep 10 14:19:51.415609 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.415606    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14035h59m45.266340908s"
Sep 10 14:19:51.507416 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.507383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:51.507599 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:51.507517    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:19:51.532531 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.532366    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7d2p" event={"ID":"3f3b4437-66f7-459d-b8d1-df60d8436024","Type":"ContainerStarted","Data":"be4031db038010ac4ae37f7820d2576e362847b5c4972e93ba6231bf55fa311d"}
Sep 10 14:19:51.560044 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.559959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8" event={"ID":"ac25a174-3eea-404a-80a9-33dac61a6a7d","Type":"ContainerStarted","Data":"b11e376f8b38a663d6bf4a8eff7fde95f3bfafbf24901c6089d1ef80490b6c46"}
Sep 10 14:19:51.573518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.573384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"91d3784f8ae7bea51a10a01c26cde38513d327e3563e941c60b5adf7aa011115"}
Sep 10 14:19:51.602422 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.602183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerStarted","Data":"4f92c98cf26e45573fe46e41eaab8a79dae9914e3fef40a5b6a851445da80e84"}
Sep 10 14:19:51.632960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.632606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4szv6" event={"ID":"316800cc-cd67-42e6-921e-b15d3781b63f","Type":"ContainerStarted","Data":"3ecbd442bae499d0a2a9e37f3d9f86f0b5e19b0c6b552a9b426b6d89a459a606"}
Sep 10 14:19:51.643115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.643075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pdnp7" event={"ID":"5d4da659-33c3-4c05-adab-1b3614777fe0","Type":"ContainerStarted","Data":"f10f253e93affab6b7ac3b427bfd1711bbc10feb1bf15635d47e2221d1e170ea"}
Sep 10 14:19:51.659927 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.659844    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blcrs" event={"ID":"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d","Type":"ContainerStarted","Data":"331c7169370f38eaf0e7e607085308d0db94d906294354e0d8bf72a13a480336"}
Sep 10 14:19:51.679141 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.679055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bj4nk" event={"ID":"32ea59b4-2294-48e2-aaef-7481d1e7b0a8","Type":"ContainerStarted","Data":"77a530f56f3e9b3092b0e24a5f19f49b9198fbc73f66395a87edfb7d4fb9fa28"}
Sep 10 14:19:51.687683 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.687646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d6r4d" event={"ID":"7ff275a5-cead-4c8f-8566-70d4518b543b","Type":"ContainerStarted","Data":"879eb770222f6330f3f3dbc2199380817ab88917da676cda68563c341ef43795"}
Sep 10 14:19:51.705300 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.705261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" event={"ID":"c2f6b5702b027da2342207c9447b842c","Type":"ContainerStarted","Data":"ac1e569107573940645bd621e1026ec2c1860497c53669161f9d9b6f1e105bb3"}
Sep 10 14:19:51.717166 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:51.717063    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" event={"ID":"59072bbf50c8f3e626da75a501f73c36","Type":"ContainerStarted","Data":"79b85058ddf08b8fbf062a2db13bca02b68762acfd43b1a33f058b909c8dc362"}
Sep 10 14:19:52.088950 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.088770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:52.088950 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.088834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:52.089191 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.089021    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:52.089191 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.089088    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret podName:3f4440b5-f048-4eec-9320-3e3417e6235e nodeName:}" failed. No retries permitted until 2026-09-10 14:19:54.089068157 +0000 UTC m=+5.066197494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret") pod "global-pull-secret-syncer-d7fcl" (UID: "3f4440b5-f048-4eec-9320-3e3417e6235e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:52.089845 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.089822    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:52.089995 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.089885    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:54.089867186 +0000 UTC m=+5.066996539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:52.190868 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.190173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:52.190868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.190380    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:52.190868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.190404    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:52.190868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.190418    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wtgk6 for pod openshift-network-diagnostics/network-check-target-9c5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:52.190868 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.190484    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6 podName:f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd nodeName:}" failed. No retries permitted until 2026-09-10 14:19:54.19046415 +0000 UTC m=+5.167593507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtgk6" (UniqueName: "kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6") pod "network-check-target-9c5g9" (UID: "f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:52.328006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.327759    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:52.416210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.416122    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:14:50 +0000 UTC" deadline="2028-06-19 13:13:33.584714466 +0000 UTC"
Sep 10 14:19:52.416210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.416158    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15550h53m41.168560414s"
Sep 10 14:19:52.505006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.504164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:52.505006 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.504285    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:19:52.505006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:52.504714    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:52.505006 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:52.504818    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:19:53.507731 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:53.507167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:53.507731 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:53.507301    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:19:54.108585 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:54.108540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:54.108792 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:54.108652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:54.108891 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.108796    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:54.108891 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.108863    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:58.108843943 +0000 UTC m=+9.085973280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:54.109336 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.109315    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:54.109430 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.109374    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret podName:3f4440b5-f048-4eec-9320-3e3417e6235e nodeName:}" failed. No retries permitted until 2026-09-10 14:19:58.109358806 +0000 UTC m=+9.086488145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret") pod "global-pull-secret-syncer-d7fcl" (UID: "3f4440b5-f048-4eec-9320-3e3417e6235e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:54.209321 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:54.209255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:54.209515 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.209452    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:54.209515 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.209474    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:54.209515 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.209489    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wtgk6 for pod openshift-network-diagnostics/network-check-target-9c5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:54.209721 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.209551    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6 podName:f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd nodeName:}" failed. No retries permitted until 2026-09-10 14:19:58.20953153 +0000 UTC m=+9.186660870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtgk6" (UniqueName: "kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6") pod "network-check-target-9c5g9" (UID: "f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:54.505246 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:54.505210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:54.505445 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.505359    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:19:54.505755 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:54.505734    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:54.505882 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:54.505854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:19:55.505221 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:55.504663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:55.505221 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:55.504820    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:19:56.504087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:56.504054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:56.504274 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:56.504054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:56.504274 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:56.504196    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:19:56.504348 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:56.504298    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:19:57.504951 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:57.504918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:57.505387 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:57.505048    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:19:58.146365 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:58.146239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:58.146365 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:58.146304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:58.146600 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.146398    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:58.146600 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.146435    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:58.146600 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.146478    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:06.146455797 +0000 UTC m=+17.123585131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:58.146600 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.146499    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret podName:3f4440b5-f048-4eec-9320-3e3417e6235e nodeName:}" failed. No retries permitted until 2026-09-10 14:20:06.146489077 +0000 UTC m=+17.123618408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret") pod "global-pull-secret-syncer-d7fcl" (UID: "3f4440b5-f048-4eec-9320-3e3417e6235e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:58.246820 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:58.246766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:58.247020 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.246927    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:58.247020 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.246941    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:58.247020 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.246950    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wtgk6 for pod openshift-network-diagnostics/network-check-target-9c5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:58.247020 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.246993    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6 podName:f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd nodeName:}" failed. No retries permitted until 2026-09-10 14:20:06.246981215 +0000 UTC m=+17.224110559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtgk6" (UniqueName: "kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6") pod "network-check-target-9c5g9" (UID: "f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:58.504346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:58.504016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:19:58.504346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:58.504192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:19:58.504346 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.504185    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:19:58.504346 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:58.504271    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:19:59.506315 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:19:59.506277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:19:59.506744 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:19:59.506424    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:00.504346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:00.504308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:00.504489 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:00.504322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:00.504489 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:00.504439    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:00.504489 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:00.504482    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:01.503965 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:01.503931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:01.504442 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:01.504045    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:02.503936 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:02.503905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:02.504100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:02.503910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:02.504100 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:02.504004    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:02.504396 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:02.504099    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:03.504906 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:03.504870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:03.505308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:03.504975    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:04.504175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:04.504141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:04.504353 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:04.504141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:04.504353 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:04.504276    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:04.504479 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:04.504344    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:05.504589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:05.504553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:05.505017 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:05.504685    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:06.204757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:06.204723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:06.205003 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:06.204787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:06.205003 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.204889    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:20:06.205003 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.204890    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:20:06.205003 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.204944    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:22.204931345 +0000 UTC m=+33.182060677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:20:06.205003 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.204958    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret podName:3f4440b5-f048-4eec-9320-3e3417e6235e nodeName:}" failed. No retries permitted until 2026-09-10 14:20:22.204951599 +0000 UTC m=+33.182080931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret") pod "global-pull-secret-syncer-d7fcl" (UID: "3f4440b5-f048-4eec-9320-3e3417e6235e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:20:06.306071 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:06.306036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:06.306235 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.306163    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:20:06.306235 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.306186    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:20:06.306235 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.306196    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wtgk6 for pod openshift-network-diagnostics/network-check-target-9c5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:20:06.306385 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.306245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6 podName:f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd nodeName:}" failed. No retries permitted until 2026-09-10 14:20:22.306231884 +0000 UTC m=+33.283361215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtgk6" (UniqueName: "kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6") pod "network-check-target-9c5g9" (UID: "f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:20:06.504664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:06.504575    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:06.505154 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.504707    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:06.505154 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:06.504766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:06.505154 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:06.504909    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:07.504753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:07.504704    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:07.505243 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:07.504867    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:08.504079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:08.504043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:08.504254 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:08.504090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:08.504254 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:08.504172    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:08.504386 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:08.504315    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:09.504730 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:09.504690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:09.505129 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:09.504794    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:10.504580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.504411    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:10.504674 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.504430    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:10.504719 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:10.504669    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:10.504760 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:10.504729    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:10.777171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.776885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blcrs" event={"ID":"2695030e-e942-4e9e-9e50-3cd0d2b1fe7d","Type":"ContainerStarted","Data":"d14037774081a17fdbde7b24a57c8bd80d6828136f5b7594f4338508604a7292"}
Sep 10 14:20:10.782426 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.782393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d6r4d" event={"ID":"7ff275a5-cead-4c8f-8566-70d4518b543b","Type":"ContainerStarted","Data":"7f812094a96af008e5651ac062200f368ebfee93a874fa00addc5d6bffb822cc"}
Sep 10 14:20:10.798255 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.798193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" event={"ID":"c2f6b5702b027da2342207c9447b842c","Type":"ContainerStarted","Data":"d7f6d71d27b7bfebd1f8823b6052fd92d146cdb1458677e824f3769ca9b1ec09"}
Sep 10 14:20:10.802343 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.802283    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-blcrs" podStartSLOduration=2.081359727 podStartE2EDuration="21.802264688s" totalImagesPullingTime="19.720904961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:10.801758798 +0000 UTC m=+21.778888164" watchObservedRunningTime="2026-09-10 14:20:10.802264688 +0000 UTC m=+21.779394042"
Sep 10 14:20:10.805754 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.805670    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:20:10.807838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.807462    2577 generic.go:356] "Generic (PLEG): container finished" podID="94ff6d83-2107-4f30-81de-6a7cb1ead18c" containerID="545f881f1815948b59092b366783bca39f10071fdab1a4a94be723a082fe60cd" exitCode=1
Sep 10 14:20:10.807838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.807509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"9c450e48650da0c8f11367c5f8e8be083293cf84b299b560cb92bbf05a5c5f06"}
Sep 10 14:20:10.807838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.807585    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"27e0048b5dd6b444fd0179c083461f83190e6bebda2f8d320d7f785fce3d7937"}
Sep 10 14:20:10.807838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.807635    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerDied","Data":"545f881f1815948b59092b366783bca39f10071fdab1a4a94be723a082fe60cd"}
Sep 10 14:20:10.807838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.807687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"300e24b3a0c97e9654e514019272e1f4b95f1f4525d788f42398c21466878eea"}
Sep 10 14:20:10.822864 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.822811    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" podStartSLOduration=20.822795661 podStartE2EDuration="20.822795661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:10.82259118 +0000 UTC m=+21.799720632" watchObservedRunningTime="2026-09-10 14:20:10.822795661 +0000 UTC m=+21.799925076"
Sep 10 14:20:10.843505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:10.842099    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d6r4d" podStartSLOduration=2.283517859 podStartE2EDuration="21.842079534s" totalImagesPullingTime="19.558561675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:10.841036643 +0000 UTC m=+21.818165997" watchObservedRunningTime="2026-09-10 14:20:10.842079534 +0000 UTC m=+21.819208890"
Sep 10 14:20:11.504162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.504137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:11.504284 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:11.504238    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:11.811088 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.811048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7d2p" event={"ID":"3f3b4437-66f7-459d-b8d1-df60d8436024","Type":"ContainerStarted","Data":"dffeb81253c391ecaded9edf742f627727f7ccba60fe83e0a301f6f1aa0cd4aa"}
Sep 10 14:20:11.812477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.812449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8" event={"ID":"ac25a174-3eea-404a-80a9-33dac61a6a7d","Type":"ContainerStarted","Data":"aee1500c61561064531c4dc3b6c1eb70e85e9733ef07478c64835f24244755e6"}
Sep 10 14:20:11.815221 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.815202    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:20:11.815638 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.815607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"39639b3929b98ca1d52978fb921725aa731fcfa513629ee48ca8e9a8cb74c8a2"}
Sep 10 14:20:11.815757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.815686    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"1bd67a042cc49b4b0f7828c24b1f4b75fb33a07431e52de6e696c879d7eed702"}
Sep 10 14:20:11.817272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.817248    2577 generic.go:356] "Generic (PLEG): container finished" podID="3452b014-375b-406a-aa70-470bce2af0cb" containerID="42d8c0aa524c0dec25b5e6777123c258d751c6cd381df08a00a3a03d8fb6d27f" exitCode=0
Sep 10 14:20:11.817369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.817325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerDied","Data":"42d8c0aa524c0dec25b5e6777123c258d751c6cd381df08a00a3a03d8fb6d27f"}
Sep 10 14:20:11.820814 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.820793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4szv6" event={"ID":"316800cc-cd67-42e6-921e-b15d3781b63f","Type":"ContainerStarted","Data":"430a3b57a72136c95db985f2b039a27df2655947728d76b076f96b05c0bf3070"}
Sep 10 14:20:11.823363 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.823340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pdnp7" event={"ID":"5d4da659-33c3-4c05-adab-1b3614777fe0","Type":"ContainerStarted","Data":"434227c7c085ebd672670c678541424aa4749194ec53fed5adbf6ab41f3e7943"}
Sep 10 14:20:11.824987 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.824964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bj4nk" event={"ID":"32ea59b4-2294-48e2-aaef-7481d1e7b0a8","Type":"ContainerStarted","Data":"02552e8d26dc8d2ce10069fc31bb5f988060cd52889a542ef84d05fd6281629a"}
Sep 10 14:20:11.826647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.826610    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h7d2p" podStartSLOduration=2.406053257 podStartE2EDuration="21.826593444s" totalImagesPullingTime="19.420540187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:11.825978928 +0000 UTC m=+22.803108283" watchObservedRunningTime="2026-09-10 14:20:11.826593444 +0000 UTC m=+22.803722798"
Sep 10 14:20:11.826647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.826641    2577 generic.go:356] "Generic (PLEG): container finished" podID="59072bbf50c8f3e626da75a501f73c36" containerID="ab03f9e39d80e1eb66892fa7378120fa4b1781dd91e0d37a8739a7fdb45742d9" exitCode=0
Sep 10 14:20:11.826807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.826718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" event={"ID":"59072bbf50c8f3e626da75a501f73c36","Type":"ContainerDied","Data":"ab03f9e39d80e1eb66892fa7378120fa4b1781dd91e0d37a8739a7fdb45742d9"}
Sep 10 14:20:11.840790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.840752    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pdnp7" podStartSLOduration=9.863810338 podStartE2EDuration="21.840739532s" totalImagesPullingTime="11.976929194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:11.840671055 +0000 UTC m=+22.817800410" watchObservedRunningTime="2026-09-10 14:20:11.840739532 +0000 UTC m=+22.817868885"
Sep 10 14:20:11.855289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.855248    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4szv6" podStartSLOduration=2.420174344 podStartE2EDuration="21.855234075s" totalImagesPullingTime="19.435059731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:11.855044034 +0000 UTC m=+22.832173391" watchObservedRunningTime="2026-09-10 14:20:11.855234075 +0000 UTC m=+22.832363428"
Sep 10 14:20:11.868014 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:11.867976    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bj4nk" podStartSLOduration=7.292409168 podStartE2EDuration="22.867960949s" totalImagesPullingTime="15.575551781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:11.867397956 +0000 UTC m=+22.844527313" watchObservedRunningTime="2026-09-10 14:20:11.867960949 +0000 UTC m=+22.845090343"
Sep 10 14:20:12.290265 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.290064    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 14:20:12.430556 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.430446    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T14:20:12.290263556Z","UUID":"86b77530-00c3-4898-8cf0-51b3ca44b125","Handler":null,"Name":"","Endpoint":""}
Sep 10 14:20:12.432240 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.432217    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 14:20:12.432240 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.432246    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 14:20:12.504170 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.504141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:12.504423 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.504141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:12.504423 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:12.504253    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:12.504423 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:12.504325    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:12.831674 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.831591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8" event={"ID":"ac25a174-3eea-404a-80a9-33dac61a6a7d","Type":"ContainerStarted","Data":"429af34fe4b3a6c055e1988e79e1d1a0e6f8d6a51aa0931884732207dcbf31c9"}
Sep 10 14:20:12.834138 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.834103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" event={"ID":"59072bbf50c8f3e626da75a501f73c36","Type":"ContainerStarted","Data":"3b59c84c027b97d00408012acc739afc40602d20f13156f2a5672a5e9f53c69c"}
Sep 10 14:20:12.847654 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:12.847610    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" podStartSLOduration=22.84759105 podStartE2EDuration="22.84759105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:12.847052718 +0000 UTC m=+23.824182072" watchObservedRunningTime="2026-09-10 14:20:12.84759105 +0000 UTC m=+23.824720404"
Sep 10 14:20:13.504342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:13.504307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:13.504539 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:13.504431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:13.838831 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:13.838749    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8" event={"ID":"ac25a174-3eea-404a-80a9-33dac61a6a7d","Type":"ContainerStarted","Data":"9aba6ac6be636ae1e8f336f0522cf7809a7987cd43625c3de45408c721b8487f"}
Sep 10 14:20:13.842647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:13.842619    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:20:13.843160 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:13.843129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"362aa4592be471a980e26cfddf46db4c2eb1d07e0f80c043a4687a6cb2a94340"}
Sep 10 14:20:13.857970 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:13.857921    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t9md8" podStartSLOduration=2.904133734 podStartE2EDuration="24.857905879s" totalImagesPullingTime="21.953772145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:13.85758235 +0000 UTC m=+24.834711710" watchObservedRunningTime="2026-09-10 14:20:13.857905879 +0000 UTC m=+24.835035229"
Sep 10 14:20:14.504769 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:14.504737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:14.504971 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:14.504736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:14.504971 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:14.504857    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:14.505068 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:14.504978    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:15.504764 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:15.504682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:15.505219 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:15.504821    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:15.626793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:15.626752    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:20:15.627384 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:15.627362    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:20:15.850332 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:15.850310    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:20:16.504579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.504392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:16.504779 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.504396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:16.504779 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:16.504663    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:16.504779 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:16.504731    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:16.855926 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.855838    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:20:16.856255 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.856232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"1d36ca0d842e526f017e558072c61e0ba138a29131f3834a2e73be32a81eb8ad"}
Sep 10 14:20:16.856497 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.856467    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:20:16.856618 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.856600    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:20:16.856709 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.856663    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:20:16.856709 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.856661    2577 scope.go:117] "RemoveContainer" containerID="545f881f1815948b59092b366783bca39f10071fdab1a4a94be723a082fe60cd"
Sep 10 14:20:16.858660 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.858633    2577 generic.go:356] "Generic (PLEG): container finished" podID="3452b014-375b-406a-aa70-470bce2af0cb" containerID="7c87c19119f53cd93d288ce859aca6fd38d65e8ae5652f681769b945c32807fe" exitCode=0
Sep 10 14:20:16.858763 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.858687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerDied","Data":"7c87c19119f53cd93d288ce859aca6fd38d65e8ae5652f681769b945c32807fe"}
Sep 10 14:20:16.873616 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.873590    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:20:16.874079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:16.874059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:20:17.161877 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.161827    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:20:17.162099 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.162022    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 14:20:17.162999 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.162892    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pdnp7"
Sep 10 14:20:17.504314 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.504285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:17.504453 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:17.504387    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:17.721914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.721631    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d7fcl"]
Sep 10 14:20:17.722612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.722010    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:17.722612 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:17.722119    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:17.722612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.722352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bfpgk"]
Sep 10 14:20:17.722612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.722453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:17.722612 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:17.722533    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:17.724141 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.724115    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9c5g9"]
Sep 10 14:20:17.866396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.866361    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:20:17.866857 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.866770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:17.866857 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.866776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" event={"ID":"94ff6d83-2107-4f30-81de-6a7cb1ead18c","Type":"ContainerStarted","Data":"c85358c3b1acd0fb9b71c3e7d5576eb1746ce473a500f7aaf85b61ca18f54704"}
Sep 10 14:20:17.867067 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:17.867025    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:17.890024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:17.889889    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl" podStartSLOduration=9.350632484 podStartE2EDuration="28.889866994s" totalImagesPullingTime="19.53923451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:17.889604703 +0000 UTC m=+28.866734083" watchObservedRunningTime="2026-09-10 14:20:17.889866994 +0000 UTC m=+28.866996347"
Sep 10 14:20:18.870761 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:18.870732    2577 generic.go:356] "Generic (PLEG): container finished" podID="3452b014-375b-406a-aa70-470bce2af0cb" containerID="104c049fb8bf96d9efc529811497fc9c45aff6f7a1a4ce76183e4195d7140d20" exitCode=0
Sep 10 14:20:18.871242 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:18.870820    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerDied","Data":"104c049fb8bf96d9efc529811497fc9c45aff6f7a1a4ce76183e4195d7140d20"}
Sep 10 14:20:19.504601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:19.504566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:19.504776 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:19.504702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:19.504776 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:19.504716    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:19.504924 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:19.504813    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:19.504924 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:19.504900    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:19.505021 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:19.504984    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:20.877987 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:20.877945    2577 generic.go:356] "Generic (PLEG): container finished" podID="3452b014-375b-406a-aa70-470bce2af0cb" containerID="05ce448e8781c2367b524b951810787ec02ec43bde54e2491e0eb6cace135951" exitCode=0
Sep 10 14:20:20.878423 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:20.877989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerDied","Data":"05ce448e8781c2367b524b951810787ec02ec43bde54e2491e0eb6cace135951"}
Sep 10 14:20:21.503963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:21.503929    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:21.503963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:21.503961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:21.504228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:21.503934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:21.504228 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:21.504209    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9c5g9" podUID="f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd"
Sep 10 14:20:21.504342 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:21.504260    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d7fcl" podUID="3f4440b5-f048-4eec-9320-3e3417e6235e"
Sep 10 14:20:21.504342 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:21.504320    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:20:22.227508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:22.227460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:22.227971 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:22.227520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:22.227971 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.227620    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:20:22.227971 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.227662    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:20:22.227971 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.227706    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:54.227685094 +0000 UTC m=+65.204814442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:20:22.227971 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.227726    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret podName:3f4440b5-f048-4eec-9320-3e3417e6235e nodeName:}" failed. No retries permitted until 2026-09-10 14:20:54.227717569 +0000 UTC m=+65.204846901 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret") pod "global-pull-secret-syncer-d7fcl" (UID: "3f4440b5-f048-4eec-9320-3e3417e6235e") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:20:22.328234 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:22.328195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:22.328423 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.328364    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:20:22.328423 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.328392    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:20:22.328525 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.328405    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wtgk6 for pod openshift-network-diagnostics/network-check-target-9c5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:20:22.328570 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:22.328532    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6 podName:f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd nodeName:}" failed. No retries permitted until 2026-09-10 14:20:54.328513131 +0000 UTC m=+65.305642477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtgk6" (UniqueName: "kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6") pod "network-check-target-9c5g9" (UID: "f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:20:23.318809 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.318782    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeReady"
Sep 10 14:20:23.319291 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.318941    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 14:20:23.355082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.355052    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-7gzhh"]
Sep 10 14:20:23.356809 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.356784    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5487677d96-npq5g"]
Sep 10 14:20:23.356941 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.356920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:23.358487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.358468    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.358780 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.358757    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 14:20:23.358896 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.358777    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bb6j2\""
Sep 10 14:20:23.358896 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.358827    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 14:20:23.360199 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.360172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 14:20:23.360364 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.360349    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vzc7d\""
Sep 10 14:20:23.360440 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.360363    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 14:20:23.360440 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.360431    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 14:20:23.365671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.365646    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 14:20:23.368319 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.368294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-7gzhh"]
Sep 10 14:20:23.371680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.371591    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5487677d96-npq5g"]
Sep 10 14:20:23.372370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.372255    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zn59b"]
Sep 10 14:20:23.374897 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.374879    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d7p75"]
Sep 10 14:20:23.375048 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.375027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.376740 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.376722    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:23.377258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.377222    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-587sj\""
Sep 10 14:20:23.377359 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.377275    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 14:20:23.377359 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.377322    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 14:20:23.379157 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.378788    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 14:20:23.379157 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.379012    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 14:20:23.379157 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.379051    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-45wsb\""
Sep 10 14:20:23.379354 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.379313    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 14:20:23.388239 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.388217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d7p75"]
Sep 10 14:20:23.389337 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.389316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zn59b"]
Sep 10 14:20:23.436855 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.436798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:23.437034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.436890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae25126e-e0bc-47a8-beb1-46281402bded-cert\") pod \"ingress-canary-d7p75\" (UID: \"ae25126e-e0bc-47a8-beb1-46281402bded\") " pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:23.437034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.436926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.436953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-bound-sa-token\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.436987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c0136e8-a85c-4317-ae2a-f1c966c7f316-tmp-dir\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.437034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c76b\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-kube-api-access-9c76b\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-image-registry-private-configuration\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-installation-pull-secrets\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zpmv\" (UniqueName: \"kubernetes.io/projected/1c0136e8-a85c-4317-ae2a-f1c966c7f316-kube-api-access-7zpmv\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.437258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhdlj\" (UniqueName: \"kubernetes.io/projected/ae25126e-e0bc-47a8-beb1-46281402bded-kube-api-access-hhdlj\") pod \"ingress-canary-d7p75\" (UID: \"ae25126e-e0bc-47a8-beb1-46281402bded\") " pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:23.437258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c0136e8-a85c-4317-ae2a-f1c966c7f316-config-volume\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.437258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.437498 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-ca-trust-extracted\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437498 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-certificates\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437498 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-trusted-ca\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.437498 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.437362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-nginx-conf\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:23.504212 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.504173    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:23.504390 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.504223    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:23.504390 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.504178    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:23.506512 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.506487    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:20:23.506512 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.506507    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6szzq\""
Sep 10 14:20:23.506719 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.506700    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:20:23.506912 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.506895    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:20:23.507210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.507162    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-flc9p\""
Sep 10 14:20:23.507307 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.507240    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:20:23.538184 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-nginx-conf\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:23.538319 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:23.538319 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae25126e-e0bc-47a8-beb1-46281402bded-cert\") pod \"ingress-canary-d7p75\" (UID: \"ae25126e-e0bc-47a8-beb1-46281402bded\") " pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:23.538319 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.538319 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-bound-sa-token\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.538319 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c0136e8-a85c-4317-ae2a-f1c966c7f316-tmp-dir\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c76b\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-kube-api-access-9c76b\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-image-registry-private-configuration\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-installation-pull-secrets\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zpmv\" (UniqueName: \"kubernetes.io/projected/1c0136e8-a85c-4317-ae2a-f1c966c7f316-kube-api-access-7zpmv\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:23.538453    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhdlj\" (UniqueName: \"kubernetes.io/projected/ae25126e-e0bc-47a8-beb1-46281402bded-kube-api-access-hhdlj\") pod \"ingress-canary-d7p75\" (UID: \"ae25126e-e0bc-47a8-beb1-46281402bded\") " pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c0136e8-a85c-4317-ae2a-f1c966c7f316-config-volume\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-ca-trust-extracted\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.538576 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:23.538580    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:20:24.038557824 +0000 UTC m=+35.015687176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:23.539133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-certificates\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.539133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-trusted-ca\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.539133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.538921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-ca-trust-extracted\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.539133 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:23.539036    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:23.539133 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:23.539051    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:20:23.539133 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:23.539110    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:24.039092026 +0000 UTC m=+35.016221358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:20:23.539830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.539541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-nginx-conf\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:23.539830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.539594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-trusted-ca\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.539830 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:23.539632    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:23.539830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.539673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c0136e8-a85c-4317-ae2a-f1c966c7f316-tmp-dir\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.539830 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:23.539696    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:24.039679997 +0000 UTC m=+35.016809330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:23.540329 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.540309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-certificates\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.540616 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.540583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c0136e8-a85c-4317-ae2a-f1c966c7f316-config-volume\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.544051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.543927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-installation-pull-secrets\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.544162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.543995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae25126e-e0bc-47a8-beb1-46281402bded-cert\") pod \"ingress-canary-d7p75\" (UID: \"ae25126e-e0bc-47a8-beb1-46281402bded\") " pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:23.544162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.543999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-image-registry-private-configuration\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.547403 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.547375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhdlj\" (UniqueName: \"kubernetes.io/projected/ae25126e-e0bc-47a8-beb1-46281402bded-kube-api-access-hhdlj\") pod \"ingress-canary-d7p75\" (UID: \"ae25126e-e0bc-47a8-beb1-46281402bded\") " pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:23.547506 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.547457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-bound-sa-token\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.547506 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.547486    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zpmv\" (UniqueName: \"kubernetes.io/projected/1c0136e8-a85c-4317-ae2a-f1c966c7f316-kube-api-access-7zpmv\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:23.548370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.548350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c76b\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-kube-api-access-9c76b\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:23.699380 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:23.699335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d7p75"
Sep 10 14:20:24.044219 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:24.044184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:24.044406 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:24.044233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:24.044406 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:24.044269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:24.044406 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:24.044349    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:24.044406 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:24.044388    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:24.044406 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:24.044401    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:20:24.044637 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:24.044411    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:24.044637 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:24.044434    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:25.044414242 +0000 UTC m=+36.021543575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:24.044637 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:24.044452    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:25.044445968 +0000 UTC m=+36.021575300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:20:24.044637 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:24.044478    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:20:25.044460115 +0000 UTC m=+36.021589452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:25.055543 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:25.055509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:25.055596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:25.055637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:25.055671    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:25.055693    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:25.055720    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:25.055720    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:25.055759    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:27.055739106 +0000 UTC m=+38.032868455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:25.055776    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:27.055765174 +0000 UTC m=+38.032894505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:25.056381 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:25.055787    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:20:27.055781354 +0000 UTC m=+38.032910686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:25.095550 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:25.095478    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d7p75"]
Sep 10 14:20:25.099144 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:20:25.099117    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae25126e_e0bc_47a8_beb1_46281402bded.slice/crio-fcd7b27dc4889fe09f9715adcce57570dcd38e964ab60fd9b8b2a1558150d8c1 WatchSource:0}: Error finding container fcd7b27dc4889fe09f9715adcce57570dcd38e964ab60fd9b8b2a1558150d8c1: Status 404 returned error can't find the container with id fcd7b27dc4889fe09f9715adcce57570dcd38e964ab60fd9b8b2a1558150d8c1
Sep 10 14:20:25.895798 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:25.895760    2577 generic.go:356] "Generic (PLEG): container finished" podID="3452b014-375b-406a-aa70-470bce2af0cb" containerID="44f90f91852e241a9e4707f49284e0374bd628306257203dfa996948d2d6b0e1" exitCode=0
Sep 10 14:20:25.896000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:25.895865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerDied","Data":"44f90f91852e241a9e4707f49284e0374bd628306257203dfa996948d2d6b0e1"}
Sep 10 14:20:25.897457 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:25.897406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d7p75" event={"ID":"ae25126e-e0bc-47a8-beb1-46281402bded","Type":"ContainerStarted","Data":"fcd7b27dc4889fe09f9715adcce57570dcd38e964ab60fd9b8b2a1558150d8c1"}
Sep 10 14:20:26.904111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:26.904070    2577 generic.go:356] "Generic (PLEG): container finished" podID="3452b014-375b-406a-aa70-470bce2af0cb" containerID="928b2bcdce73d44eabf0678853727a73a2416e712c3f916d13f99260970cd40e" exitCode=0
Sep 10 14:20:26.904614 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:26.904135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerDied","Data":"928b2bcdce73d44eabf0678853727a73a2416e712c3f916d13f99260970cd40e"}
Sep 10 14:20:27.073117 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:27.073076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:27.073309 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:27.073140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:27.073309 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:27.073179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:27.073309 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:27.073232    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:27.073309 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:27.073283    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:27.073309 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:27.073287    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:27.073309 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:27.073303    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:31.073283417 +0000 UTC m=+42.050412752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:27.073581 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:27.073345    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:20:31.073331878 +0000 UTC m=+42.050461223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:27.073581 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:27.073297    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:20:27.073581 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:27.073377    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:31.073369408 +0000 UTC m=+42.050498740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:20:27.910648 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:27.910306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-65ppf" event={"ID":"3452b014-375b-406a-aa70-470bce2af0cb","Type":"ContainerStarted","Data":"aef849afbe8b1d4744b9f0c9c45038da51ef1fc88300c50c69a91e27e4a8db44"}
Sep 10 14:20:27.912078 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:27.912054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d7p75" event={"ID":"ae25126e-e0bc-47a8-beb1-46281402bded","Type":"ContainerStarted","Data":"8e89ab781006b1a21b34bdc9bc58c4a2e19ec6d4fb3cb6fadc82e8e9857eb943"}
Sep 10 14:20:27.933257 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:27.933156    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-65ppf" podStartSLOduration=8.367831884 podStartE2EDuration="38.933137633s" totalImagesPullingTime="30.565305749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:27.931722743 +0000 UTC m=+38.908852119" watchObservedRunningTime="2026-09-10 14:20:27.933137633 +0000 UTC m=+38.910266990"
Sep 10 14:20:27.947295 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:27.947235    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d7p75" podStartSLOduration=2.374430723 podStartE2EDuration="4.947218118s" totalImagesPullingTime="2.572787395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:27.946540143 +0000 UTC m=+38.923669522" watchObservedRunningTime="2026-09-10 14:20:27.947218118 +0000 UTC m=+38.924347471"
Sep 10 14:20:31.104840 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:31.104796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:31.104840 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:31.104869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:31.104924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:31.104957    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:31.105005    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:31.105010    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:31.105024    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:31.105036    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:20:39.105020149 +0000 UTC m=+50.082149498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:31.105050    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:39.10504388 +0000 UTC m=+50.082173211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:31.105305 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:31.105061    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:39.105055307 +0000 UTC m=+50.082184639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:20:39.164528 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:39.164483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:39.164542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:39.164580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:39.164652    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:39.164690    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:39.164730    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:39.164745    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:39.164731    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:55.164708673 +0000 UTC m=+66.141838019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:39.164816    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:20:55.164799837 +0000 UTC m=+66.141929176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:39.165082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:39.164832    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:55.164821814 +0000 UTC m=+66.141951146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:20:48.888168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:48.888138    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5fmnl"
Sep 10 14:20:54.293443 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.293386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:20:54.293443 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.293446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:54.295638 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.295616    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:20:54.295708 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.295616    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:20:54.303743 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:54.303723    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 14:20:54.303795 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:54.303786    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:21:58.30376955 +0000 UTC m=+129.280898886 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : secret "metrics-daemon-secret" not found
Sep 10 14:20:54.306645 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.306612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f4440b5-f048-4eec-9320-3e3417e6235e-original-pull-secret\") pod \"global-pull-secret-syncer-d7fcl\" (UID: \"3f4440b5-f048-4eec-9320-3e3417e6235e\") " pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:54.393928 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.393894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:54.399662 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.399640    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:20:54.406187 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.406167    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:20:54.416044 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.416024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d7fcl"
Sep 10 14:20:54.417042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.417023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtgk6\" (UniqueName: \"kubernetes.io/projected/f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd-kube-api-access-wtgk6\") pod \"network-check-target-9c5g9\" (UID: \"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd\") " pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:54.432179 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.432156    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6szzq\""
Sep 10 14:20:54.440572 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.440551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:54.685877 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.685828    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d7fcl"]
Sep 10 14:20:54.718683 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.718655    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9c5g9"]
Sep 10 14:20:54.722002 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:20:54.721981    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63d2622_6b34_4a1f_a2fc_a0b7af2a10dd.slice/crio-fe0d9286bb69f7ac371bcd5b89f826b96193b853787a317e11c1d960c001a5b5 WatchSource:0}: Error finding container fe0d9286bb69f7ac371bcd5b89f826b96193b853787a317e11c1d960c001a5b5: Status 404 returned error can't find the container with id fe0d9286bb69f7ac371bcd5b89f826b96193b853787a317e11c1d960c001a5b5
Sep 10 14:20:54.977005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.976920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9c5g9" event={"ID":"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd","Type":"ContainerStarted","Data":"fe0d9286bb69f7ac371bcd5b89f826b96193b853787a317e11c1d960c001a5b5"}
Sep 10 14:20:54.977944 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:54.977921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d7fcl" event={"ID":"3f4440b5-f048-4eec-9320-3e3417e6235e","Type":"ContainerStarted","Data":"008b2c8d4588349b2d6042e7d07dcb8acdb9b971c15e32f5ffb159bac56e116f"}
Sep 10 14:20:55.201077 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:55.201018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:20:55.201077 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:55.201083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:55.201122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:55.201174    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:55.201218    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:55.201227    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:55.201243    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:55.201244    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:21:27.201226018 +0000 UTC m=+98.178355352 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:55.201292    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:21:27.201279448 +0000 UTC m=+98.178408781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:55.201308 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:20:55.201302    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:21:27.201296575 +0000 UTC m=+98.178425907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:20:59.993378 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:59.993335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9c5g9" event={"ID":"f63d2622-6b34-4a1f-a2fc-a0b7af2a10dd","Type":"ContainerStarted","Data":"e87cb65489117b4703128277bb059aec3b4c32d0b0ce1e7ebc4153a41b450a33"}
Sep 10 14:20:59.993819 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:59.993398    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:20:59.994807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:20:59.994782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d7fcl" event={"ID":"3f4440b5-f048-4eec-9320-3e3417e6235e","Type":"ContainerStarted","Data":"aff56628109b1d1daab5739fb25b0a7589e450680785329cd44f9a56cbe22aa9"}
Sep 10 14:21:00.028881 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:00.028813    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d7fcl" podStartSLOduration=65.522296523 podStartE2EDuration="1m10.028797163s" totalImagesPullingTime="4.50650064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:00.028270986 +0000 UTC m=+71.005400339" watchObservedRunningTime="2026-09-10 14:21:00.028797163 +0000 UTC m=+71.005926517"
Sep 10 14:21:00.029305 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:00.029283    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9c5g9" podStartSLOduration=65.558638603 podStartE2EDuration="1m10.029275643s" totalImagesPullingTime="4.47063704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:00.011295167 +0000 UTC m=+70.988424522" watchObservedRunningTime="2026-09-10 14:21:00.029275643 +0000 UTC m=+71.006404997"
Sep 10 14:21:17.470335 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.470205    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"]
Sep 10 14:21:17.472470 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.472453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:17.475429 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.475401    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 14:21:17.475429 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.475403    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 14:21:17.475612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.475403    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 14:21:17.475910 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.475887    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 14:21:17.476257 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.476235    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qvm8g\""
Sep 10 14:21:17.480233 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.480214    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"]
Sep 10 14:21:17.572220 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.572180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ccfab8c-287f-4c38-a9d0-a8926e9326d2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7947d4c4d-fj8jv\" (UID: \"3ccfab8c-287f-4c38-a9d0-a8926e9326d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:17.572388 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.572232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcltm\" (UniqueName: \"kubernetes.io/projected/3ccfab8c-287f-4c38-a9d0-a8926e9326d2-kube-api-access-dcltm\") pod \"managed-serviceaccount-addon-agent-7947d4c4d-fj8jv\" (UID: \"3ccfab8c-287f-4c38-a9d0-a8926e9326d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:17.673167 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.673072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcltm\" (UniqueName: \"kubernetes.io/projected/3ccfab8c-287f-4c38-a9d0-a8926e9326d2-kube-api-access-dcltm\") pod \"managed-serviceaccount-addon-agent-7947d4c4d-fj8jv\" (UID: \"3ccfab8c-287f-4c38-a9d0-a8926e9326d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:17.673330 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.673253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ccfab8c-287f-4c38-a9d0-a8926e9326d2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7947d4c4d-fj8jv\" (UID: \"3ccfab8c-287f-4c38-a9d0-a8926e9326d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:17.675638 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.675619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ccfab8c-287f-4c38-a9d0-a8926e9326d2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7947d4c4d-fj8jv\" (UID: \"3ccfab8c-287f-4c38-a9d0-a8926e9326d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:17.681315 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.681288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcltm\" (UniqueName: \"kubernetes.io/projected/3ccfab8c-287f-4c38-a9d0-a8926e9326d2-kube-api-access-dcltm\") pod \"managed-serviceaccount-addon-agent-7947d4c4d-fj8jv\" (UID: \"3ccfab8c-287f-4c38-a9d0-a8926e9326d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:17.794651 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:17.794551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"
Sep 10 14:21:18.058155 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:18.058071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv"]
Sep 10 14:21:18.061820 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:21:18.061792    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ccfab8c_287f_4c38_a9d0_a8926e9326d2.slice/crio-abd8492e5a5eb4d9e073bfa560276ed00815a29e97e5c3b32e62d34a44b092eb WatchSource:0}: Error finding container abd8492e5a5eb4d9e073bfa560276ed00815a29e97e5c3b32e62d34a44b092eb: Status 404 returned error can't find the container with id abd8492e5a5eb4d9e073bfa560276ed00815a29e97e5c3b32e62d34a44b092eb
Sep 10 14:21:19.043284 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:19.043245    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv" event={"ID":"3ccfab8c-287f-4c38-a9d0-a8926e9326d2","Type":"ContainerStarted","Data":"abd8492e5a5eb4d9e073bfa560276ed00815a29e97e5c3b32e62d34a44b092eb"}
Sep 10 14:21:21.049808 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:21.049771    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv" event={"ID":"3ccfab8c-287f-4c38-a9d0-a8926e9326d2","Type":"ContainerStarted","Data":"96be4462b0734bc3b4f616ab67a3118d437353a309f8f64856c7c5e173ee6ec2"}
Sep 10 14:21:21.065360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:21.065306    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv" podStartSLOduration=1.95875923 podStartE2EDuration="4.065288764s" totalImagesPullingTime="2.106529534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:21.065142185 +0000 UTC m=+92.042271542" watchObservedRunningTime="2026-09-10 14:21:21.065288764 +0000 UTC m=+92.042418118"
Sep 10 14:21:27.246544 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:27.246496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:21:27.246544 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:27.246553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:27.246581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:27.246674    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:27.246703    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:27.246680    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:27.246782    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:27.246768    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:22:31.246752095 +0000 UTC m=+162.223881432 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:27.246840    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:22:31.24682599 +0000 UTC m=+162.223955322 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:21:27.247126 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:27.246873    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:22:31.246866661 +0000 UTC m=+162.223995994 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:21:30.999772 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:30.999738    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9c5g9"
Sep 10 14:21:58.374210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:21:58.374172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:21:58.374621 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:58.374338    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 14:21:58.374621 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:21:58.374403    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:00.374386303 +0000 UTC m=+251.351515647 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : secret "metrics-daemon-secret" not found
Sep 10 14:22:26.370397 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:26.370347    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh" podUID="1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae"
Sep 10 14:22:26.376464 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:26.376436    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5487677d96-npq5g" podUID="4a81f81d-4c62-4d58-a2cb-416ddc42aa70"
Sep 10 14:22:26.388629 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:26.388598    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zn59b" podUID="1c0136e8-a85c-4317-ae2a-f1c966c7f316"
Sep 10 14:22:26.524082 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:26.524032    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:22:27.207452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:22:27.207422    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:22:27.207452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:22:27.207440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn59b"
Sep 10 14:22:27.207652 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:22:27.207427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:22:31.300281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:22:31.300229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:22:31.300300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:22:31.300344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:31.300394    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:31.300448    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:31.300456    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:33.300436739 +0000 UTC m=+284.277566088 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:31.300461    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:31.300506    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:33.300492923 +0000 UTC m=+284.277622272 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:31.300447    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:22:31.300691 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:22:31.300575    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:24:33.300559701 +0000 UTC m=+284.277689033 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:22:38.504768 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:22:38.504714    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:23:20.339533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:23:20.339500    2577 generic.go:356] "Generic (PLEG): container finished" podID="3ccfab8c-287f-4c38-a9d0-a8926e9326d2" containerID="96be4462b0734bc3b4f616ab67a3118d437353a309f8f64856c7c5e173ee6ec2" exitCode=255
Sep 10 14:23:20.339953 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:23:20.339553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv" event={"ID":"3ccfab8c-287f-4c38-a9d0-a8926e9326d2","Type":"ContainerDied","Data":"96be4462b0734bc3b4f616ab67a3118d437353a309f8f64856c7c5e173ee6ec2"}
Sep 10 14:23:20.339953 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:23:20.339825    2577 scope.go:117] "RemoveContainer" containerID="96be4462b0734bc3b4f616ab67a3118d437353a309f8f64856c7c5e173ee6ec2"
Sep 10 14:23:21.344889 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:23:21.344837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7947d4c4d-fj8jv" event={"ID":"3ccfab8c-287f-4c38-a9d0-a8926e9326d2","Type":"ContainerStarted","Data":"f7681159b9977a2bdc026098c061ec0b2e5de85b6930e3853a5ba893d98a08fc"}
Sep 10 14:24:00.425703 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:00.425649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:24:00.426242 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:00.425763    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 14:24:00.426242 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:00.425831    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs podName:0247963a-2fc0-49a4-8cb2-5f7834cfd990 nodeName:}" failed. No retries permitted until 2026-09-10 14:26:02.425815356 +0000 UTC m=+373.402944688 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs") pod "network-metrics-daemon-bfpgk" (UID: "0247963a-2fc0-49a4-8cb2-5f7834cfd990") : secret "metrics-daemon-secret" not found
Sep 10 14:24:20.587305 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.587222    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"]
Sep 10 14:24:20.589049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.589032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"
Sep 10 14:24:20.597195 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.597175    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 14:24:20.597294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.597180    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:24:20.597354 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.597308    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ngq62\""
Sep 10 14:24:20.632617 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.632579    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"]
Sep 10 14:24:20.654678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.654643    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-w9rl7"]
Sep 10 14:24:20.656423 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.656406    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"]
Sep 10 14:24:20.656543 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.656526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7"
Sep 10 14:24:20.657914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.657896    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-sl8gl"]
Sep 10 14:24:20.658017 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.658001    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.659115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.659097    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zs4kj\""
Sep 10 14:24:20.659860 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.659826    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"]
Sep 10 14:24:20.659918 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.659910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.660554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.660536    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:24:20.660630 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.660545    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 14:24:20.660761 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.660732    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 14:24:20.661085 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.661068    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 14:24:20.661182 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.661166    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l6j8x\""
Sep 10 14:24:20.661568 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.661550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.662329 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.662310    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 14:24:20.662654 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.662637    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 14:24:20.662731 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.662656    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 14:24:20.663206 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.663190    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 14:24:20.663814 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.663720    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 14:24:20.664016 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.663997    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vsc2m\""
Sep 10 14:24:20.664305 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.664271    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 14:24:20.664733 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.664719    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 14:24:20.664793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.664750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-l7gcx\""
Sep 10 14:24:20.665859 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.665823    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 14:24:20.670155 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.670134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4kj\" (UniqueName: \"kubernetes.io/projected/f78bfc43-91e7-4292-9295-38ee69a47ea1-kube-api-access-4v4kj\") pod \"volume-data-source-validator-695c895bd6-p7m4f\" (UID: \"f78bfc43-91e7-4292-9295-38ee69a47ea1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"
Sep 10 14:24:20.671457 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.671439    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 14:24:20.678811 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.678787    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-sl8gl"]
Sep 10 14:24:20.680153 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.680131    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"]
Sep 10 14:24:20.681364 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.681333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"]
Sep 10 14:24:20.701165 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.701128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-w9rl7"]
Sep 10 14:24:20.770470 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-862xj\" (UniqueName: \"kubernetes.io/projected/8ba4a21d-201d-44ae-aff0-295b9e1b4311-kube-api-access-862xj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.770667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba4a21d-201d-44ae-aff0-295b9e1b4311-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.770667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qdd\" (UniqueName: \"kubernetes.io/projected/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-kube-api-access-s2qdd\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.770667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdvx\" (UniqueName: \"kubernetes.io/projected/745a8a7f-f842-47c6-9825-2b54b1190523-kube-api-access-6rdvx\") pod \"network-check-source-685456655f-w9rl7\" (UID: \"745a8a7f-f842-47c6-9825-2b54b1190523\") " pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7"
Sep 10 14:24:20.770667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ba4a21d-201d-44ae-aff0-295b9e1b4311-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.770667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4kj\" (UniqueName: \"kubernetes.io/projected/f78bfc43-91e7-4292-9295-38ee69a47ea1-kube-api-access-4v4kj\") pod \"volume-data-source-validator-695c895bd6-p7m4f\" (UID: \"f78bfc43-91e7-4292-9295-38ee69a47ea1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad6563f0-8643-4b37-b96c-4c29c702edbb-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad6563f0-8643-4b37-b96c-4c29c702edbb-serving-cert\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad6563f0-8643-4b37-b96c-4c29c702edbb-tmp\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.770950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad6563f0-8643-4b37-b96c-4c29c702edbb-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.771007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7qlg\" (UniqueName: \"kubernetes.io/projected/ad6563f0-8643-4b37-b96c-4c29c702edbb-kube-api-access-d7qlg\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.771046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.771043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ad6563f0-8643-4b37-b96c-4c29c702edbb-snapshots\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.782891 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.782863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4kj\" (UniqueName: \"kubernetes.io/projected/f78bfc43-91e7-4292-9295-38ee69a47ea1-kube-api-access-4v4kj\") pod \"volume-data-source-validator-695c895bd6-p7m4f\" (UID: \"f78bfc43-91e7-4292-9295-38ee69a47ea1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"
Sep 10 14:24:20.871888 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.871837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-862xj\" (UniqueName: \"kubernetes.io/projected/8ba4a21d-201d-44ae-aff0-295b9e1b4311-kube-api-access-862xj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.872082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.871901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba4a21d-201d-44ae-aff0-295b9e1b4311-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.872082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.871934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2qdd\" (UniqueName: \"kubernetes.io/projected/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-kube-api-access-s2qdd\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.872082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.871979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdvx\" (UniqueName: \"kubernetes.io/projected/745a8a7f-f842-47c6-9825-2b54b1190523-kube-api-access-6rdvx\") pod \"network-check-source-685456655f-w9rl7\" (UID: \"745a8a7f-f842-47c6-9825-2b54b1190523\") " pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7"
Sep 10 14:24:20.872082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ba4a21d-201d-44ae-aff0-295b9e1b4311-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.872082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.872082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad6563f0-8643-4b37-b96c-4c29c702edbb-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.872382 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:20.872178    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:20.872382 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.872382 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:20.872245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls podName:5cde8ca2-2cd5-437c-94d5-6510b3b4527a nodeName:}" failed. No retries permitted until 2026-09-10 14:24:21.372225716 +0000 UTC m=+272.349355068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8mlt8" (UID: "5cde8ca2-2cd5-437c-94d5-6510b3b4527a") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:20.872382 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad6563f0-8643-4b37-b96c-4c29c702edbb-serving-cert\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.872382 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad6563f0-8643-4b37-b96c-4c29c702edbb-tmp\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.872382 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad6563f0-8643-4b37-b96c-4c29c702edbb-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.872382 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7qlg\" (UniqueName: \"kubernetes.io/projected/ad6563f0-8643-4b37-b96c-4c29c702edbb-kube-api-access-d7qlg\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.872728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ad6563f0-8643-4b37-b96c-4c29c702edbb-snapshots\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.872728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872708    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad6563f0-8643-4b37-b96c-4c29c702edbb-tmp\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.872977 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.872952    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.873064 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.873054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ad6563f0-8643-4b37-b96c-4c29c702edbb-snapshots\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.873201 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.873176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ba4a21d-201d-44ae-aff0-295b9e1b4311-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.873277 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.873180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad6563f0-8643-4b37-b96c-4c29c702edbb-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.873501 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.873483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad6563f0-8643-4b37-b96c-4c29c702edbb-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.874450 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.874422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ba4a21d-201d-44ae-aff0-295b9e1b4311-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.874581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.874563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad6563f0-8643-4b37-b96c-4c29c702edbb-serving-cert\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.880988 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.880967    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdvx\" (UniqueName: \"kubernetes.io/projected/745a8a7f-f842-47c6-9825-2b54b1190523-kube-api-access-6rdvx\") pod \"network-check-source-685456655f-w9rl7\" (UID: \"745a8a7f-f842-47c6-9825-2b54b1190523\") " pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7"
Sep 10 14:24:20.881087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.880986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7qlg\" (UniqueName: \"kubernetes.io/projected/ad6563f0-8643-4b37-b96c-4c29c702edbb-kube-api-access-d7qlg\") pod \"insights-operator-76bcd6ccf5-sl8gl\" (UID: \"ad6563f0-8643-4b37-b96c-4c29c702edbb\") " pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:20.881087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.881020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-862xj\" (UniqueName: \"kubernetes.io/projected/8ba4a21d-201d-44ae-aff0-295b9e1b4311-kube-api-access-862xj\") pod \"kube-storage-version-migrator-operator-8d7dd4675-l9ffd\" (UID: \"8ba4a21d-201d-44ae-aff0-295b9e1b4311\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.881160 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.881088    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2qdd\" (UniqueName: \"kubernetes.io/projected/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-kube-api-access-s2qdd\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:20.896837 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.896801    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"
Sep 10 14:24:20.968308 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.968279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7"
Sep 10 14:24:20.973585 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.973561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"
Sep 10 14:24:20.981297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:20.981274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl"
Sep 10 14:24:21.162407 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.162316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f"]
Sep 10 14:24:21.166122 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:21.166089    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78bfc43_91e7_4292_9295_38ee69a47ea1.slice/crio-056d773f54c74080579977807959a9c10c88b2102abe71501cc232cd04cd1123 WatchSource:0}: Error finding container 056d773f54c74080579977807959a9c10c88b2102abe71501cc232cd04cd1123: Status 404 returned error can't find the container with id 056d773f54c74080579977807959a9c10c88b2102abe71501cc232cd04cd1123
Sep 10 14:24:21.242218 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.242172    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-w9rl7"]
Sep 10 14:24:21.246969 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.246938    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd"]
Sep 10 14:24:21.252794 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:21.252771    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba4a21d_201d_44ae_aff0_295b9e1b4311.slice/crio-514b80a4b993629a556982ff8c5861b724a1375b55a7b0ef9fca6c0a2b017754 WatchSource:0}: Error finding container 514b80a4b993629a556982ff8c5861b724a1375b55a7b0ef9fca6c0a2b017754: Status 404 returned error can't find the container with id 514b80a4b993629a556982ff8c5861b724a1375b55a7b0ef9fca6c0a2b017754
Sep 10 14:24:21.260098 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.260072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-sl8gl"]
Sep 10 14:24:21.262651 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:21.262630    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6563f0_8643_4b37_b96c_4c29c702edbb.slice/crio-4689af94c8ab057d23102b689a33ed08b13392ef75e93130cef6dca70fa4ecc1 WatchSource:0}: Error finding container 4689af94c8ab057d23102b689a33ed08b13392ef75e93130cef6dca70fa4ecc1: Status 404 returned error can't find the container with id 4689af94c8ab057d23102b689a33ed08b13392ef75e93130cef6dca70fa4ecc1
Sep 10 14:24:21.376521 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.376475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:21.376672 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:21.376628    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:21.376735 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:21.376700    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls podName:5cde8ca2-2cd5-437c-94d5-6510b3b4527a nodeName:}" failed. No retries permitted until 2026-09-10 14:24:22.376684647 +0000 UTC m=+273.353813978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8mlt8" (UID: "5cde8ca2-2cd5-437c-94d5-6510b3b4527a") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:21.517884 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.517779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl" event={"ID":"ad6563f0-8643-4b37-b96c-4c29c702edbb","Type":"ContainerStarted","Data":"4689af94c8ab057d23102b689a33ed08b13392ef75e93130cef6dca70fa4ecc1"}
Sep 10 14:24:21.518899 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.518874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f" event={"ID":"f78bfc43-91e7-4292-9295-38ee69a47ea1","Type":"ContainerStarted","Data":"056d773f54c74080579977807959a9c10c88b2102abe71501cc232cd04cd1123"}
Sep 10 14:24:21.519970 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.519946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd" event={"ID":"8ba4a21d-201d-44ae-aff0-295b9e1b4311","Type":"ContainerStarted","Data":"514b80a4b993629a556982ff8c5861b724a1375b55a7b0ef9fca6c0a2b017754"}
Sep 10 14:24:21.521374 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.521354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7" event={"ID":"745a8a7f-f842-47c6-9825-2b54b1190523","Type":"ContainerStarted","Data":"047a37511021e25fd4ac27d31acc1f57d82ada54060a1cb203265ca82a174546"}
Sep 10 14:24:21.521448 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.521388    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7" event={"ID":"745a8a7f-f842-47c6-9825-2b54b1190523","Type":"ContainerStarted","Data":"40a3e6998e53d4bb7d920f9eb6dcf8997637d341f6c8f428be7298de12d45809"}
Sep 10 14:24:21.541971 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:21.541926    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-w9rl7" podStartSLOduration=1.54190762 podStartE2EDuration="1.54190762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:21.540517904 +0000 UTC m=+272.517647252" watchObservedRunningTime="2026-09-10 14:24:21.54190762 +0000 UTC m=+272.519036986"
Sep 10 14:24:22.384759 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:22.384581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:22.385246 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:22.384787    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:22.385246 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:22.384903    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls podName:5cde8ca2-2cd5-437c-94d5-6510b3b4527a nodeName:}" failed. No retries permitted until 2026-09-10 14:24:24.384880178 +0000 UTC m=+275.362009513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8mlt8" (UID: "5cde8ca2-2cd5-437c-94d5-6510b3b4527a") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:24.400259 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:24.400212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:24.400650 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:24.400367    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:24.400650 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:24.400434    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls podName:5cde8ca2-2cd5-437c-94d5-6510b3b4527a nodeName:}" failed. No retries permitted until 2026-09-10 14:24:28.400418557 +0000 UTC m=+279.377547888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8mlt8" (UID: "5cde8ca2-2cd5-437c-94d5-6510b3b4527a") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:24.535495 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:24.535456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl" event={"ID":"ad6563f0-8643-4b37-b96c-4c29c702edbb","Type":"ContainerStarted","Data":"ff8934573284b6d5aa0aa9c7f891e3974af4083ef7a1e1cd1e0158a1b7ad44c8"}
Sep 10 14:24:24.537213 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:24.537184    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f" event={"ID":"f78bfc43-91e7-4292-9295-38ee69a47ea1","Type":"ContainerStarted","Data":"454b507301821c00457ac4ce4791e537a54275501803a74f5afa16b02288a529"}
Sep 10 14:24:24.538766 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:24.538736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd" event={"ID":"8ba4a21d-201d-44ae-aff0-295b9e1b4311","Type":"ContainerStarted","Data":"c13ed6fc9f61928ab48bfa36cea4387dddc92a7299eb149b1807adc2cc4ffcde"}
Sep 10 14:24:24.557078 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:24.557031    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl" podStartSLOduration=1.9169840470000001 podStartE2EDuration="4.557015777s" totalImagesPullingTime="2.64003173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:24.55582269 +0000 UTC m=+275.532952049" watchObservedRunningTime="2026-09-10 14:24:24.557015777 +0000 UTC m=+275.534145174"
Sep 10 14:24:24.572078 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:24.572029    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-p7m4f" podStartSLOduration=1.8353920000000001 podStartE2EDuration="4.572013298s" totalImagesPullingTime="2.736621298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:24.570738373 +0000 UTC m=+275.547867744" watchObservedRunningTime="2026-09-10 14:24:24.572013298 +0000 UTC m=+275.549142681"
Sep 10 14:24:24.590453 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:24.590401    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd" podStartSLOduration=1.9358044049999998 podStartE2EDuration="4.590385562s" totalImagesPullingTime="2.654581157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:24.589110519 +0000 UTC m=+275.566239866" watchObservedRunningTime="2026-09-10 14:24:24.590385562 +0000 UTC m=+275.567514916"
Sep 10 14:24:25.697567 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.697530    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-62jvc"]
Sep 10 14:24:25.700926 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.700906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.703108 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.703088    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mxclh\""
Sep 10 14:24:25.703313 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.703298    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 14:24:25.703313 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.703306    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 14:24:25.752100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.752069    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-62jvc"]
Sep 10 14:24:25.815492 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.815450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.815492 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.815495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42034a5-5519-49bc-a4ae-ba773951b072-data-volume\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.815738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.815520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ffg6\" (UniqueName: \"kubernetes.io/projected/f42034a5-5519-49bc-a4ae-ba773951b072-kube-api-access-5ffg6\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.815738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.815598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.815738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.815724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42034a5-5519-49bc-a4ae-ba773951b072-crio-socket\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.916232 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.916195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.916232 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.916239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42034a5-5519-49bc-a4ae-ba773951b072-data-volume\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.916459 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.916260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ffg6\" (UniqueName: \"kubernetes.io/projected/f42034a5-5519-49bc-a4ae-ba773951b072-kube-api-access-5ffg6\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.916459 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.916283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.916459 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:25.916340    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:24:25.916459 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:25.916381    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:25.916459 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:25.916432    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:26.41641405 +0000 UTC m=+277.393543401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:25.916459 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:25.916451    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:26.416444121 +0000 UTC m=+277.393573452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : configmap "kube-rbac-proxy" not found
Sep 10 14:24:25.916685 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.916493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42034a5-5519-49bc-a4ae-ba773951b072-crio-socket\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.916685 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.916572    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42034a5-5519-49bc-a4ae-ba773951b072-crio-socket\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.916685 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.916632    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42034a5-5519-49bc-a4ae-ba773951b072-data-volume\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:25.924222 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:25.924194    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ffg6\" (UniqueName: \"kubernetes.io/projected/f42034a5-5519-49bc-a4ae-ba773951b072-kube-api-access-5ffg6\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:26.420266 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:26.420227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:26.420449 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:26.420344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:26.420449 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:26.420393    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:26.420449 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:26.420435    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:24:26.420547 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:26.420476    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:27.420453284 +0000 UTC m=+278.397582616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:26.420547 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:26.420500    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:27.420487896 +0000 UTC m=+278.397617228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : configmap "kube-rbac-proxy" not found
Sep 10 14:24:27.428800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.428760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:27.429262 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.428827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:27.429262 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:27.428908    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:24:27.429262 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:27.428981    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:27.429262 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:27.429044    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:29.429024074 +0000 UTC m=+280.406153422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:27.429262 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:27.429065    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:29.429054497 +0000 UTC m=+280.406183833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : configmap "kube-rbac-proxy" not found
Sep 10 14:24:27.718432 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.718348    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-m7z2h"]
Sep 10 14:24:27.721464 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.721448    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.723508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.723485    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 10 14:24:27.723508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.723499    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-khd5q\""
Sep 10 14:24:27.723694 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.723498    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 10 14:24:27.724095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.724080    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 10 14:24:27.724167 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.724086    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 10 14:24:27.730779 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.730757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-m7z2h"]
Sep 10 14:24:27.832404 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.832370    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-signing-key\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.832606 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.832447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-signing-cabundle\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.832606 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.832502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgw5r\" (UniqueName: \"kubernetes.io/projected/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-kube-api-access-bgw5r\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.933442 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.933402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-signing-key\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.933629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.933482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-signing-cabundle\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.933629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.933499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgw5r\" (UniqueName: \"kubernetes.io/projected/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-kube-api-access-bgw5r\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.934246 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.934220    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-signing-cabundle\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.935797 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.935776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-signing-key\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:27.941555 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:27.941534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgw5r\" (UniqueName: \"kubernetes.io/projected/d1e0992f-9986-40cd-b4ff-e5d306b0b90c-kube-api-access-bgw5r\") pod \"service-ca-75d99c484-m7z2h\" (UID: \"d1e0992f-9986-40cd-b4ff-e5d306b0b90c\") " pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:28.031227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:28.031154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-m7z2h"
Sep 10 14:24:28.229863 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:28.229814    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7d2p_3f3b4437-66f7-459d-b8d1-df60d8436024/dns-node-resolver/0.log"
Sep 10 14:24:28.301360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:28.301287    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-m7z2h"]
Sep 10 14:24:28.304481 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:28.304457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e0992f_9986_40cd_b4ff_e5d306b0b90c.slice/crio-6410ffd26fa80812144d95c8fb19c6b550096a70f679c213f7f727ba974d614a WatchSource:0}: Error finding container 6410ffd26fa80812144d95c8fb19c6b550096a70f679c213f7f727ba974d614a: Status 404 returned error can't find the container with id 6410ffd26fa80812144d95c8fb19c6b550096a70f679c213f7f727ba974d614a
Sep 10 14:24:28.438182 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:28.438147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:28.438559 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:28.438290    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:28.438559 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:28.438356    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls podName:5cde8ca2-2cd5-437c-94d5-6510b3b4527a nodeName:}" failed. No retries permitted until 2026-09-10 14:24:36.438338773 +0000 UTC m=+287.415468107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8mlt8" (UID: "5cde8ca2-2cd5-437c-94d5-6510b3b4527a") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:28.556292 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:28.556199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-m7z2h" event={"ID":"d1e0992f-9986-40cd-b4ff-e5d306b0b90c","Type":"ContainerStarted","Data":"6410ffd26fa80812144d95c8fb19c6b550096a70f679c213f7f727ba974d614a"}
Sep 10 14:24:29.425707 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:29.425670    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4szv6_316800cc-cd67-42e6-921e-b15d3781b63f/node-ca/0.log"
Sep 10 14:24:29.446140 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:29.446104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:29.446500 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:29.446156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:29.446500 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:29.446221    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:24:29.446500 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:29.446252    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:29.446500 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:29.446283    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:33.446267062 +0000 UTC m=+284.423396394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : configmap "kube-rbac-proxy" not found
Sep 10 14:24:29.446500 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:29.446297    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:33.446290679 +0000 UTC m=+284.423420011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:30.208080 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:30.208036    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zn59b" podUID="1c0136e8-a85c-4317-ae2a-f1c966c7f316"
Sep 10 14:24:30.208080 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:30.208070    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh" podUID="1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae"
Sep 10 14:24:30.208283 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:30.208074    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5487677d96-npq5g" podUID="4a81f81d-4c62-4d58-a2cb-416ddc42aa70"
Sep 10 14:24:30.226200 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:30.226173    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d7p75_ae25126e-e0bc-47a8-beb1-46281402bded/serve-healthcheck-canary/0.log"
Sep 10 14:24:30.564401 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:30.564371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:24:30.564879 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:30.564423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-m7z2h" event={"ID":"d1e0992f-9986-40cd-b4ff-e5d306b0b90c","Type":"ContainerStarted","Data":"ec6e4767f52202249427c4a5c750eec28135928dc1050400ecae28c7801bc84e"}
Sep 10 14:24:30.564879 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:30.564587    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn59b"
Sep 10 14:24:30.564879 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:30.564731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:24:30.580047 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:30.580002    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-m7z2h" podStartSLOduration=1.870930279 podStartE2EDuration="3.579988224s" totalImagesPullingTime="1.709057945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:30.579692877 +0000 UTC m=+281.556822234" watchObservedRunningTime="2026-09-10 14:24:30.579988224 +0000 UTC m=+281.557117570"
Sep 10 14:24:31.027632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:31.027600    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l9ffd_8ba4a21d-201d-44ae-aff0-295b9e1b4311/kube-storage-version-migrator-operator/0.log"
Sep 10 14:24:33.381587 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:33.381551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:33.381595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:33.381654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") pod \"image-registry-5487677d96-npq5g\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") " pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.381708    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.381744    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.381754    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5487677d96-npq5g: secret "image-registry-tls" not found
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.381757    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.381782    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls podName:1c0136e8-a85c-4317-ae2a-f1c966c7f316 nodeName:}" failed. No retries permitted until 2026-09-10 14:26:35.381765805 +0000 UTC m=+406.358895145 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls") pod "dns-default-zn59b" (UID: "1c0136e8-a85c-4317-ae2a-f1c966c7f316") : secret "dns-default-metrics-tls" not found
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.381797    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls podName:4a81f81d-4c62-4d58-a2cb-416ddc42aa70 nodeName:}" failed. No retries permitted until 2026-09-10 14:26:35.38179123 +0000 UTC m=+406.358920562 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls") pod "image-registry-5487677d96-npq5g" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70") : secret "image-registry-tls" not found
Sep 10 14:24:33.382074 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.381808    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert podName:1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae nodeName:}" failed. No retries permitted until 2026-09-10 14:26:35.381802239 +0000 UTC m=+406.358931571 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7gzhh" (UID: "1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae") : secret "networking-console-plugin-cert" not found
Sep 10 14:24:33.482659 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:33.482622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:33.482833 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:33.482673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:33.482833 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.482744    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:24:33.482833 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.482808    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:33.482833 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.482819    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:41.48280405 +0000 UTC m=+292.459933382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : configmap "kube-rbac-proxy" not found
Sep 10 14:24:33.483009 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:33.482873    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:41.482838768 +0000 UTC m=+292.459968099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:36.507336 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:36.507300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:36.507750 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:36.507445    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:36.507750 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:36.507504    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls podName:5cde8ca2-2cd5-437c-94d5-6510b3b4527a nodeName:}" failed. No retries permitted until 2026-09-10 14:24:52.507490263 +0000 UTC m=+303.484619594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8mlt8" (UID: "5cde8ca2-2cd5-437c-94d5-6510b3b4527a") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:24:41.505339 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:41.505297    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bfpgk" podUID="0247963a-2fc0-49a4-8cb2-5f7834cfd990"
Sep 10 14:24:41.555242 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:41.555206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:41.555441 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:41.555385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:41.555441 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:41.555407    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:41.555558 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:41.555504    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls podName:f42034a5-5519-49bc-a4ae-ba773951b072 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:57.555478904 +0000 UTC m=+308.532608252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls") pod "insights-runtime-extractor-62jvc" (UID: "f42034a5-5519-49bc-a4ae-ba773951b072") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:24:41.555834 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:41.555812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42034a5-5519-49bc-a4ae-ba773951b072-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:49.378249 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:49.378222    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:24:49.378641 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:49.378226    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:24:49.383177 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:49.383152    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 14:24:52.543165 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:52.543116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:52.545657 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:52.545628    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cde8ca2-2cd5-437c-94d5-6510b3b4527a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8mlt8\" (UID: \"5cde8ca2-2cd5-437c-94d5-6510b3b4527a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:52.789186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:52.789145    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-l7gcx\""
Sep 10 14:24:52.797874 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:52.797800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"
Sep 10 14:24:53.064334 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:53.064260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8"]
Sep 10 14:24:53.067045 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:53.067022    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cde8ca2_2cd5_437c_94d5_6510b3b4527a.slice/crio-0f54cee84e09e183b28b7297dc704369c460f1c1a70a1ecbe2e241a554dd0f44 WatchSource:0}: Error finding container 0f54cee84e09e183b28b7297dc704369c460f1c1a70a1ecbe2e241a554dd0f44: Status 404 returned error can't find the container with id 0f54cee84e09e183b28b7297dc704369c460f1c1a70a1ecbe2e241a554dd0f44
Sep 10 14:24:53.068905 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:53.068886    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:24:53.637524 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:53.637482    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8" event={"ID":"5cde8ca2-2cd5-437c-94d5-6510b3b4527a","Type":"ContainerStarted","Data":"0f54cee84e09e183b28b7297dc704369c460f1c1a70a1ecbe2e241a554dd0f44"}
Sep 10 14:24:54.504126 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:54.504091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:24:55.307631 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.307591    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"]
Sep 10 14:24:55.309924 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.309905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:55.312094 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.312068    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 14:24:55.312252 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.312079    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5cl9h\""
Sep 10 14:24:55.320208 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.320146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"]
Sep 10 14:24:55.367827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.367788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d0982f2d-662c-4205-bb48-cf51e28bdc89-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-ccq4r\" (UID: \"d0982f2d-662c-4205-bb48-cf51e28bdc89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:55.469122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.469086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d0982f2d-662c-4205-bb48-cf51e28bdc89-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-ccq4r\" (UID: \"d0982f2d-662c-4205-bb48-cf51e28bdc89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:55.473030 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:55.469563    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 14:24:55.473030 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:24:55.469667    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0982f2d-662c-4205-bb48-cf51e28bdc89-tls-certificates podName:d0982f2d-662c-4205-bb48-cf51e28bdc89 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:55.96962282 +0000 UTC m=+306.946752155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d0982f2d-662c-4205-bb48-cf51e28bdc89-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-ccq4r" (UID: "d0982f2d-662c-4205-bb48-cf51e28bdc89") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 14:24:55.648162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.648122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8" event={"ID":"5cde8ca2-2cd5-437c-94d5-6510b3b4527a","Type":"ContainerStarted","Data":"fb55e4a9d0564065ea2b517d395a1c64079609b64bdfd513e446db412eeb3ee0"}
Sep 10 14:24:55.663137 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.663084    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8mlt8" podStartSLOduration=33.897654582 podStartE2EDuration="35.663066136s" totalImagesPullingTime="1.765411554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:55.662173568 +0000 UTC m=+306.639302916" watchObservedRunningTime="2026-09-10 14:24:55.663066136 +0000 UTC m=+306.640195483"
Sep 10 14:24:55.973691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.973606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d0982f2d-662c-4205-bb48-cf51e28bdc89-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-ccq4r\" (UID: \"d0982f2d-662c-4205-bb48-cf51e28bdc89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:55.976021 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:55.975992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d0982f2d-662c-4205-bb48-cf51e28bdc89-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-ccq4r\" (UID: \"d0982f2d-662c-4205-bb48-cf51e28bdc89\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:56.220589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:56.220538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:56.485270 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:56.485196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"]
Sep 10 14:24:56.488368 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:56.488328    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0982f2d_662c_4205_bb48_cf51e28bdc89.slice/crio-b8b81529f34827d08425c66c9d4c11eeaa2c7b26e17d892fc34f81efd3292eb1 WatchSource:0}: Error finding container b8b81529f34827d08425c66c9d4c11eeaa2c7b26e17d892fc34f81efd3292eb1: Status 404 returned error can't find the container with id b8b81529f34827d08425c66c9d4c11eeaa2c7b26e17d892fc34f81efd3292eb1
Sep 10 14:24:56.652131 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:56.652093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r" event={"ID":"d0982f2d-662c-4205-bb48-cf51e28bdc89","Type":"ContainerStarted","Data":"b8b81529f34827d08425c66c9d4c11eeaa2c7b26e17d892fc34f81efd3292eb1"}
Sep 10 14:24:57.587185 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.587153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:57.589791 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.589766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42034a5-5519-49bc-a4ae-ba773951b072-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62jvc\" (UID: \"f42034a5-5519-49bc-a4ae-ba773951b072\") " pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:57.811650 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.811606    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mxclh\""
Sep 10 14:24:57.820237 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.820208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-62jvc"
Sep 10 14:24:57.826361 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.826336    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568c75f44-xgrrg"]
Sep 10 14:24:57.828609 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.828588    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.831445 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831299    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 14:24:57.831445 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831337    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 14:24:57.831445 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831344    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 14:24:57.831445 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831388    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 14:24:57.831731 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831682    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 14:24:57.831731 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831693    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zf5dh\""
Sep 10 14:24:57.831837 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831738    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 14:24:57.831921 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.831912    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 14:24:57.839113 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.839060    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568c75f44-xgrrg"]
Sep 10 14:24:57.890376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.890321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzl6h\" (UniqueName: \"kubernetes.io/projected/eba667a0-dced-4ffe-a87b-b256a95d610a-kube-api-access-qzl6h\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.890520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.890438    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-console-config\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.890520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.890488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-oauth-serving-cert\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.890598 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.890525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-serving-cert\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.890631 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.890593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-service-ca\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.890631 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.890622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-oauth-config\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.991557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.991524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-oauth-serving-cert\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.991557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.991562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-serving-cert\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.991789 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.991606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-service-ca\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.991789 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.991623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-oauth-config\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.991789 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.991670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzl6h\" (UniqueName: \"kubernetes.io/projected/eba667a0-dced-4ffe-a87b-b256a95d610a-kube-api-access-qzl6h\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.991975 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.991920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-console-config\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.992327 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.992298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-service-ca\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.992433 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.992345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-oauth-serving-cert\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.992490 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.992444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-console-config\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.994014 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.993998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-serving-cert\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.994014 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.994006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-oauth-config\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:57.998421 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:57.998399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzl6h\" (UniqueName: \"kubernetes.io/projected/eba667a0-dced-4ffe-a87b-b256a95d610a-kube-api-access-qzl6h\") pod \"console-568c75f44-xgrrg\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") " pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:58.139875 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.139831    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:24:58.143817 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.143790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-62jvc"]
Sep 10 14:24:58.147261 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:58.147237    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42034a5_5519_49bc_a4ae_ba773951b072.slice/crio-5620e95261c252ba836e2374d3a9b2aa1b049fca140649f0b5f45f80701c7d4f WatchSource:0}: Error finding container 5620e95261c252ba836e2374d3a9b2aa1b049fca140649f0b5f45f80701c7d4f: Status 404 returned error can't find the container with id 5620e95261c252ba836e2374d3a9b2aa1b049fca140649f0b5f45f80701c7d4f
Sep 10 14:24:58.408861 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.408772    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568c75f44-xgrrg"]
Sep 10 14:24:58.411612 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:58.411586    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba667a0_dced_4ffe_a87b_b256a95d610a.slice/crio-3c339622b7ca20242d342a088cbdd282e93a7177d957bbb091a23c721e5c8a2f WatchSource:0}: Error finding container 3c339622b7ca20242d342a088cbdd282e93a7177d957bbb091a23c721e5c8a2f: Status 404 returned error can't find the container with id 3c339622b7ca20242d342a088cbdd282e93a7177d957bbb091a23c721e5c8a2f
Sep 10 14:24:58.660579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.660485    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62jvc" event={"ID":"f42034a5-5519-49bc-a4ae-ba773951b072","Type":"ContainerStarted","Data":"b3749b9b63a24b7965106f2c788809cdf3739b172215ae017fcb7f531fb16df4"}
Sep 10 14:24:58.660579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.660549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62jvc" event={"ID":"f42034a5-5519-49bc-a4ae-ba773951b072","Type":"ContainerStarted","Data":"5620e95261c252ba836e2374d3a9b2aa1b049fca140649f0b5f45f80701c7d4f"}
Sep 10 14:24:58.662021 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.661996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r" event={"ID":"d0982f2d-662c-4205-bb48-cf51e28bdc89","Type":"ContainerStarted","Data":"d969e22b798211c3dbce72f6f3236df2ba2a08ff47863624c34419c226d8b194"}
Sep 10 14:24:58.662202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.662175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:58.663327 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.663305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568c75f44-xgrrg" event={"ID":"eba667a0-dced-4ffe-a87b-b256a95d610a","Type":"ContainerStarted","Data":"3c339622b7ca20242d342a088cbdd282e93a7177d957bbb091a23c721e5c8a2f"}
Sep 10 14:24:58.666855 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.666823    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r"
Sep 10 14:24:58.675474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:58.675430    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-ccq4r" podStartSLOduration=2.260351539 podStartE2EDuration="3.675416224s" totalImagesPullingTime="1.415064685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:58.674184674 +0000 UTC m=+309.651314029" watchObservedRunningTime="2026-09-10 14:24:58.675416224 +0000 UTC m=+309.652545578"
Sep 10 14:24:59.371295 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.371259    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"]
Sep 10 14:24:59.376826 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.374668    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.379394 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.377075    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 14:24:59.379394 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.377424    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7j6mz\""
Sep 10 14:24:59.379394 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.377673    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 14:24:59.379394 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.377979    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 14:24:59.382226 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.382198    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"]
Sep 10 14:24:59.405386 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.405343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c6046be-c8b2-4563-840e-5e72792ff601-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.405536 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.405449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c6046be-c8b2-4563-840e-5e72792ff601-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.405536 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.405499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6046be-c8b2-4563-840e-5e72792ff601-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.405536 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.405522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtgvj\" (UniqueName: \"kubernetes.io/projected/2c6046be-c8b2-4563-840e-5e72792ff601-kube-api-access-rtgvj\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.505952 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.505913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6046be-c8b2-4563-840e-5e72792ff601-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.506369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.506025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtgvj\" (UniqueName: \"kubernetes.io/projected/2c6046be-c8b2-4563-840e-5e72792ff601-kube-api-access-rtgvj\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.506369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.506104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c6046be-c8b2-4563-840e-5e72792ff601-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.506369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.506171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c6046be-c8b2-4563-840e-5e72792ff601-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.506914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.506890    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c6046be-c8b2-4563-840e-5e72792ff601-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.508714 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.508689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6046be-c8b2-4563-840e-5e72792ff601-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.508939 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.508917    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c6046be-c8b2-4563-840e-5e72792ff601-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.514968 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.514909    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtgvj\" (UniqueName: \"kubernetes.io/projected/2c6046be-c8b2-4563-840e-5e72792ff601-kube-api-access-rtgvj\") pod \"prometheus-operator-6f4946db56-pc2wj\" (UID: \"2c6046be-c8b2-4563-840e-5e72792ff601\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.668953 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.668861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62jvc" event={"ID":"f42034a5-5519-49bc-a4ae-ba773951b072","Type":"ContainerStarted","Data":"7dc050cfaa29ed9265286d432169d0e7d9b2c7f9680e14f3be9e2de871df383e"}
Sep 10 14:24:59.689437 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.689407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"
Sep 10 14:24:59.985787 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:24:59.985760    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-pc2wj"]
Sep 10 14:24:59.988279 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:24:59.988246    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6046be_c8b2_4563_840e_5e72792ff601.slice/crio-e54355908352a8e8aff0b2e1d882a282febe6b46108476bbbd3debf37e57ad5d WatchSource:0}: Error finding container e54355908352a8e8aff0b2e1d882a282febe6b46108476bbbd3debf37e57ad5d: Status 404 returned error can't find the container with id e54355908352a8e8aff0b2e1d882a282febe6b46108476bbbd3debf37e57ad5d
Sep 10 14:25:00.675889 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:00.675834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj" event={"ID":"2c6046be-c8b2-4563-840e-5e72792ff601","Type":"ContainerStarted","Data":"e54355908352a8e8aff0b2e1d882a282febe6b46108476bbbd3debf37e57ad5d"}
Sep 10 14:25:00.678295 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:00.678268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62jvc" event={"ID":"f42034a5-5519-49bc-a4ae-ba773951b072","Type":"ContainerStarted","Data":"c9a099f6d812a82773b8c389583d99c86e546182554fd051c0b9475cc6806a9f"}
Sep 10 14:25:00.699351 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:00.699295    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-62jvc" podStartSLOduration=33.357330686 podStartE2EDuration="35.699272119s" totalImagesPullingTime="2.341941433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:24:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:00.697322564 +0000 UTC m=+311.674451942" watchObservedRunningTime="2026-09-10 14:25:00.699272119 +0000 UTC m=+311.676401474"
Sep 10 14:25:02.688267 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:02.688235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568c75f44-xgrrg" event={"ID":"eba667a0-dced-4ffe-a87b-b256a95d610a","Type":"ContainerStarted","Data":"7bafb1102d5a311c8288b2bd6603e8b0b5d37bebcd9050118f02ec808cbeed61"}
Sep 10 14:25:02.707619 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:02.707556    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568c75f44-xgrrg" podStartSLOduration=2.150005188 podStartE2EDuration="5.70753363s" totalImagesPullingTime="3.557528442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:02.705916295 +0000 UTC m=+313.683045650" watchObservedRunningTime="2026-09-10 14:25:02.70753363 +0000 UTC m=+313.684663038"
Sep 10 14:25:03.693615 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:03.693566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj" event={"ID":"2c6046be-c8b2-4563-840e-5e72792ff601","Type":"ContainerStarted","Data":"4c70aee057bc41f5aeb30955f5bb3f547ec859a5b37b2e0a52382ed4fce12b63"}
Sep 10 14:25:03.694059 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:03.693639    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj" event={"ID":"2c6046be-c8b2-4563-840e-5e72792ff601","Type":"ContainerStarted","Data":"ea95c335860189effb22d76b6c630399e0de21321f26b869d544a0aba9a69c66"}
Sep 10 14:25:03.711938 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:03.711877    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-pc2wj" podStartSLOduration=1.860506182 podStartE2EDuration="4.711839374s" totalImagesPullingTime="2.851333192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:03.711653188 +0000 UTC m=+314.688782541" watchObservedRunningTime="2026-09-10 14:25:03.711839374 +0000 UTC m=+314.688968728"
Sep 10 14:25:06.260746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.260706    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fblfg"]
Sep 10 14:25:06.264249 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.264231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.276111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.276087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 14:25:06.276259 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.276167    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 14:25:06.276259 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.276191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4vtq9\""
Sep 10 14:25:06.276366 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.276325    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 14:25:06.365405 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-textfile\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365405 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-accelerators-collector-config\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw7kf\" (UniqueName: \"kubernetes.io/projected/01332b02-953c-4fd3-8e30-9aff14896209-kube-api-access-tw7kf\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01332b02-953c-4fd3-8e30-9aff14896209-metrics-client-ca\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-wtmp\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-tls\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-sys\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.365871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.365739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-root\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466176 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-sys\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-root\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-textfile\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-accelerators-collector-config\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-sys\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw7kf\" (UniqueName: \"kubernetes.io/projected/01332b02-953c-4fd3-8e30-9aff14896209-kube-api-access-tw7kf\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01332b02-953c-4fd3-8e30-9aff14896209-metrics-client-ca\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-root\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-wtmp\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-tls\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-wtmp\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-textfile\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.466993 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-accelerators-collector-config\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.467038 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.466996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01332b02-953c-4fd3-8e30-9aff14896209-metrics-client-ca\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.468816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.468786    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.468917 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.468894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01332b02-953c-4fd3-8e30-9aff14896209-node-exporter-tls\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.481417 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.481390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw7kf\" (UniqueName: \"kubernetes.io/projected/01332b02-953c-4fd3-8e30-9aff14896209-kube-api-access-tw7kf\") pod \"node-exporter-fblfg\" (UID: \"01332b02-953c-4fd3-8e30-9aff14896209\") " pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.573927 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.573823    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fblfg"
Sep 10 14:25:06.585363 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:25:06.585330    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01332b02_953c_4fd3_8e30_9aff14896209.slice/crio-4303c434460a09d7b36dd9ae757cf57476a8eb8fee07725fc1b59dbb3d19b30e WatchSource:0}: Error finding container 4303c434460a09d7b36dd9ae757cf57476a8eb8fee07725fc1b59dbb3d19b30e: Status 404 returned error can't find the container with id 4303c434460a09d7b36dd9ae757cf57476a8eb8fee07725fc1b59dbb3d19b30e
Sep 10 14:25:06.705901 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:06.705862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fblfg" event={"ID":"01332b02-953c-4fd3-8e30-9aff14896209","Type":"ContainerStarted","Data":"4303c434460a09d7b36dd9ae757cf57476a8eb8fee07725fc1b59dbb3d19b30e"}
Sep 10 14:25:08.140236 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:08.140196    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:25:08.140695 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:08.140257    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:25:08.144968 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:08.144943    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:25:08.715490 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:08.715452    2577 generic.go:356] "Generic (PLEG): container finished" podID="01332b02-953c-4fd3-8e30-9aff14896209" containerID="8c89f863b6dbd8c3d385dcf8996e1ccfe84a57bfa3fbf5902b7ba71083671285" exitCode=0
Sep 10 14:25:08.715684 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:08.715532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fblfg" event={"ID":"01332b02-953c-4fd3-8e30-9aff14896209","Type":"ContainerDied","Data":"8c89f863b6dbd8c3d385dcf8996e1ccfe84a57bfa3fbf5902b7ba71083671285"}
Sep 10 14:25:08.719801 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:08.719780    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:25:09.720629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:09.720591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fblfg" event={"ID":"01332b02-953c-4fd3-8e30-9aff14896209","Type":"ContainerStarted","Data":"ab71311af86f0d659dc43b3080d8557a2ff1127da5a98d0fee84bdb159b5c1fb"}
Sep 10 14:25:09.721036 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:09.720653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fblfg" event={"ID":"01332b02-953c-4fd3-8e30-9aff14896209","Type":"ContainerStarted","Data":"49c2740f3f2504bd0895379aac69ae2f2ffbf19f22af8065800db11ad0e17f96"}
Sep 10 14:25:09.749688 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:09.749638    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fblfg" podStartSLOduration=2.355826067 podStartE2EDuration="3.749622254s" totalImagesPullingTime="1.331112866s" totalInitContainerRuntime="62.683321ms" isStatefulPod=true podCreationTimestamp="2026-09-10 14:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:09.74853388 +0000 UTC m=+320.725663233" watchObservedRunningTime="2026-09-10 14:25:09.749622254 +0000 UTC m=+320.726751647"
Sep 10 14:25:10.696027 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.695993    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"]
Sep 10 14:25:10.699121 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.699099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:10.701586 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.701559    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 10 14:25:10.701727 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.701636    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6mn7p\""
Sep 10 14:25:10.717783 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.717758    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"]
Sep 10 14:25:10.797279 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.797239    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858749c565-cqv6m"]
Sep 10 14:25:10.800402 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.800376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.806258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.806133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsg6w\" (UniqueName: \"kubernetes.io/projected/12818a0a-237e-4764-bc73-b96c07a3f33c-kube-api-access-gsg6w\") pod \"monitoring-plugin-85bbbbbf4-s67cp\" (UID: \"12818a0a-237e-4764-bc73-b96c07a3f33c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:10.806258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.806218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12818a0a-237e-4764-bc73-b96c07a3f33c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-s67cp\" (UID: \"12818a0a-237e-4764-bc73-b96c07a3f33c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:10.817349 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.817310    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 14:25:10.830711 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.830684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858749c565-cqv6m"]
Sep 10 14:25:10.906822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.906786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-oauth-serving-cert\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.907017 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.906854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12818a0a-237e-4764-bc73-b96c07a3f33c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-s67cp\" (UID: \"12818a0a-237e-4764-bc73-b96c07a3f33c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:10.907017 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.906933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-trusted-ca-bundle\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.907017 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.906983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-serving-cert\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.907118 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.907060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-oauth-config\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.907118 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.907094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-console-config\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.907208 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.907116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-service-ca\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.907208 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.907132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65psx\" (UniqueName: \"kubernetes.io/projected/2a62f36f-c899-4127-b967-fdf151f6dc95-kube-api-access-65psx\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:10.907208 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.907153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsg6w\" (UniqueName: \"kubernetes.io/projected/12818a0a-237e-4764-bc73-b96c07a3f33c-kube-api-access-gsg6w\") pod \"monitoring-plugin-85bbbbbf4-s67cp\" (UID: \"12818a0a-237e-4764-bc73-b96c07a3f33c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:10.909283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.909260    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12818a0a-237e-4764-bc73-b96c07a3f33c-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-s67cp\" (UID: \"12818a0a-237e-4764-bc73-b96c07a3f33c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:10.915446 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:10.915421    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsg6w\" (UniqueName: \"kubernetes.io/projected/12818a0a-237e-4764-bc73-b96c07a3f33c-kube-api-access-gsg6w\") pod \"monitoring-plugin-85bbbbbf4-s67cp\" (UID: \"12818a0a-237e-4764-bc73-b96c07a3f33c\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:11.008294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:11.008433 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-oauth-config\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.008473 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-console-config\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.008518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-service-ca\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.008518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65psx\" (UniqueName: \"kubernetes.io/projected/2a62f36f-c899-4127-b967-fdf151f6dc95-kube-api-access-65psx\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.008625 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-oauth-serving-cert\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.008625 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-trusted-ca-bundle\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.008625 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.008611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-serving-cert\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.009311 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.009287    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-oauth-serving-cert\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.009463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.009336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-service-ca\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.009463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.009336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-console-config\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.009681 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.009658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-trusted-ca-bundle\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.011615 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.011585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-oauth-config\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.011729 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.011692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-serving-cert\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.017260 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.017236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65psx\" (UniqueName: \"kubernetes.io/projected/2a62f36f-c899-4127-b967-fdf151f6dc95-kube-api-access-65psx\") pod \"console-858749c565-cqv6m\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") " pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.108574 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.108529    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:11.278778 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.278752    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"]
Sep 10 14:25:11.281086 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:25:11.281061    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12818a0a_237e_4764_bc73_b96c07a3f33c.slice/crio-f7df47b8769bcb0f5539e13cc42d0008fc78aad4a40115c9f2e7f621d4bf0afb WatchSource:0}: Error finding container f7df47b8769bcb0f5539e13cc42d0008fc78aad4a40115c9f2e7f621d4bf0afb: Status 404 returned error can't find the container with id f7df47b8769bcb0f5539e13cc42d0008fc78aad4a40115c9f2e7f621d4bf0afb
Sep 10 14:25:11.373098 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.373066    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-ff9598449-nkcsd"]
Sep 10 14:25:11.378197 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.378179    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.380306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.380284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w6ts4\""
Sep 10 14:25:11.380306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.380294    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 14:25:11.380485 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.380312    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 14:25:11.380485 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.380320    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 14:25:11.380686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.380669    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 14:25:11.380765 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.380696    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 14:25:11.383683 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.383661    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858749c565-cqv6m"]
Sep 10 14:25:11.386498 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.386476    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 14:25:11.386797 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:25:11.386690    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a62f36f_c899_4127_b967_fdf151f6dc95.slice/crio-d02b83bf62dd3069b2ff9cff3afc4bf4b5ac6c542cad386bedff019d1899b96b WatchSource:0}: Error finding container d02b83bf62dd3069b2ff9cff3afc4bf4b5ac6c542cad386bedff019d1899b96b: Status 404 returned error can't find the container with id d02b83bf62dd3069b2ff9cff3afc4bf4b5ac6c542cad386bedff019d1899b96b
Sep 10 14:25:11.389608 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.389585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ff9598449-nkcsd"]
Sep 10 14:25:11.513166 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcbhf\" (UniqueName: \"kubernetes.io/projected/bc7c2b14-0407-4add-9864-8acc78bb6639-kube-api-access-rcbhf\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.513306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.513306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-metrics-client-ca\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.513306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-secret-telemeter-client\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.513418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-telemeter-client-tls\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.513418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.513418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-federate-client-tls\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.513527 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.513493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-serving-certs-ca-bundle\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614440 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-serving-certs-ca-bundle\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcbhf\" (UniqueName: \"kubernetes.io/projected/bc7c2b14-0407-4add-9864-8acc78bb6639-kube-api-access-rcbhf\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-metrics-client-ca\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-secret-telemeter-client\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-telemeter-client-tls\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.614800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.614711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-federate-client-tls\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.615289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.615261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-serving-certs-ca-bundle\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.615484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.615427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-metrics-client-ca\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.616095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.616068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc7c2b14-0407-4add-9864-8acc78bb6639-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.617239 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.617212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-telemeter-client-tls\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.617343 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.617323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-secret-telemeter-client\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.617511 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.617495    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-federate-client-tls\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.617547 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.617507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc7c2b14-0407-4add-9864-8acc78bb6639-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.622220 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.622201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcbhf\" (UniqueName: \"kubernetes.io/projected/bc7c2b14-0407-4add-9864-8acc78bb6639-kube-api-access-rcbhf\") pod \"telemeter-client-ff9598449-nkcsd\" (UID: \"bc7c2b14-0407-4add-9864-8acc78bb6639\") " pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.690076 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.690043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd"
Sep 10 14:25:11.729166 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.729083    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858749c565-cqv6m" event={"ID":"2a62f36f-c899-4127-b967-fdf151f6dc95","Type":"ContainerStarted","Data":"85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34"}
Sep 10 14:25:11.729166 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.729141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858749c565-cqv6m" event={"ID":"2a62f36f-c899-4127-b967-fdf151f6dc95","Type":"ContainerStarted","Data":"d02b83bf62dd3069b2ff9cff3afc4bf4b5ac6c542cad386bedff019d1899b96b"}
Sep 10 14:25:11.730600 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.730566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp" event={"ID":"12818a0a-237e-4764-bc73-b96c07a3f33c","Type":"ContainerStarted","Data":"f7df47b8769bcb0f5539e13cc42d0008fc78aad4a40115c9f2e7f621d4bf0afb"}
Sep 10 14:25:11.747510 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.747461    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858749c565-cqv6m" podStartSLOduration=1.747444782 podStartE2EDuration="1.747444782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:11.747226063 +0000 UTC m=+322.724355431" watchObservedRunningTime="2026-09-10 14:25:11.747444782 +0000 UTC m=+322.724574136"
Sep 10 14:25:11.994170 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:11.994088    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ff9598449-nkcsd"]
Sep 10 14:25:11.997415 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:25:11.997381    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7c2b14_0407_4add_9864_8acc78bb6639.slice/crio-5ded27c2246e04f1142af5d448d8899264ca727cba344eb1a2118163fce3566d WatchSource:0}: Error finding container 5ded27c2246e04f1142af5d448d8899264ca727cba344eb1a2118163fce3566d: Status 404 returned error can't find the container with id 5ded27c2246e04f1142af5d448d8899264ca727cba344eb1a2118163fce3566d
Sep 10 14:25:12.525832 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.525797    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:25:12.530536 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.530508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.533039 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.533012    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 14:25:12.533163 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.533012    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 14:25:12.533427 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.533400    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 14:25:12.534171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534149    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d4c3b4q4kkoo4\""
Sep 10 14:25:12.534264 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534215    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 14:25:12.534264 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534195    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 14:25:12.534581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534549    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 14:25:12.534581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mkr5j\""
Sep 10 14:25:12.534728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534669    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 14:25:12.534728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534692    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 14:25:12.534728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534697    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 14:25:12.534889 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534732    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 14:25:12.534889 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 14:25:12.534889 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.534870    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 14:25:12.537824 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.535074    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 14:25:12.537824 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.537629    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 14:25:12.539643 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.539620    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 14:25:12.546051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.546032    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:25:12.625501 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.625678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.625678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-config\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.625678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.625830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-config-out\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.625830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.625830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626018 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626018 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626018 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626018 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.625930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626293 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626293 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5frj\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-kube-api-access-f5frj\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626293 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626293 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626293 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626293 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-web-config\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.626601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.626384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727194 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5frj\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-kube-api-access-f5frj\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-web-config\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.727607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.727957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-config\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-config-out\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.728884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.729055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.729169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.729913 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.729873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.730516 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.730487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.730616 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.730532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.730616 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.730558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.731355 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.731328    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.731793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.731767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.733232 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.733207    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.734819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.735461    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.735580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-config-out\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.735920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.736060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.736079    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.736357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-web-config\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.736774 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.736471    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.737912 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.737885    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5frj\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-kube-api-access-f5frj\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.739478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.739451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-config\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.739563 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.739474    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.739563 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.739537    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:12.740169 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.740144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd" event={"ID":"bc7c2b14-0407-4add-9864-8acc78bb6639","Type":"ContainerStarted","Data":"5ded27c2246e04f1142af5d448d8899264ca727cba344eb1a2118163fce3566d"}
Sep 10 14:25:12.812472 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.812444    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5487677d96-npq5g"]
Sep 10 14:25:12.812765 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:25:12.812742    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5487677d96-npq5g" podUID="4a81f81d-4c62-4d58-a2cb-416ddc42aa70"
Sep 10 14:25:12.850108 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:12.849820    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:13.137232 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.137199    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:25:13.140690 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:25:13.140657    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ab8c32_7215_4161_bdc7_cb679d392540.slice/crio-7f640860144d0fe53d7d4c8b254c04ee1f98f66610c06d2a71e1b533983f5fd0 WatchSource:0}: Error finding container 7f640860144d0fe53d7d4c8b254c04ee1f98f66610c06d2a71e1b533983f5fd0: Status 404 returned error can't find the container with id 7f640860144d0fe53d7d4c8b254c04ee1f98f66610c06d2a71e1b533983f5fd0
Sep 10 14:25:13.747788 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.747384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp" event={"ID":"12818a0a-237e-4764-bc73-b96c07a3f33c","Type":"ContainerStarted","Data":"bae3c0d2d6c56c01d4b64f0ff2e3528373202847437da0117d41a56d715dcdf5"}
Sep 10 14:25:13.747788 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.747673    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:13.749117 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.749092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:25:13.749252 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.749117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerStarted","Data":"7f640860144d0fe53d7d4c8b254c04ee1f98f66610c06d2a71e1b533983f5fd0"}
Sep 10 14:25:13.754237 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.754191    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp"
Sep 10 14:25:13.757864 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.757802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:25:13.762266 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.762163    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-s67cp" podStartSLOduration=2.240114566 podStartE2EDuration="3.762142883s" totalImagesPullingTime="1.522028317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:13.761655745 +0000 UTC m=+324.738785101" watchObservedRunningTime="2026-09-10 14:25:13.762142883 +0000 UTC m=+324.739272239"
Sep 10 14:25:13.843282 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843148    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-trusted-ca\") pod \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") "
Sep 10 14:25:13.843282 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843210    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c76b\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-kube-api-access-9c76b\") pod \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") "
Sep 10 14:25:13.843594 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843572    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-installation-pull-secrets\") pod \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") "
Sep 10 14:25:13.843675 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843639    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-bound-sa-token\") pod \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") "
Sep 10 14:25:13.843675 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843652    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4a81f81d-4c62-4d58-a2cb-416ddc42aa70" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:13.843675 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843668    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-image-registry-private-configuration\") pod \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") "
Sep 10 14:25:13.843825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843711    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-ca-trust-extracted\") pod \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") "
Sep 10 14:25:13.843825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.843748    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-certificates\") pod \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\" (UID: \"4a81f81d-4c62-4d58-a2cb-416ddc42aa70\") "
Sep 10 14:25:13.844753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.844163    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-trusted-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:13.844753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.844662    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4a81f81d-4c62-4d58-a2cb-416ddc42aa70" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:13.844753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.844723    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4a81f81d-4c62-4d58-a2cb-416ddc42aa70" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:25:13.847898 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.847870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4a81f81d-4c62-4d58-a2cb-416ddc42aa70" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:13.848027 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.848008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4a81f81d-4c62-4d58-a2cb-416ddc42aa70" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:13.848104 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.848085    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-kube-api-access-9c76b" (OuterVolumeSpecName: "kube-api-access-9c76b") pod "4a81f81d-4c62-4d58-a2cb-416ddc42aa70" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70"). InnerVolumeSpecName "kube-api-access-9c76b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:25:13.848228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.848201    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4a81f81d-4c62-4d58-a2cb-416ddc42aa70" (UID: "4a81f81d-4c62-4d58-a2cb-416ddc42aa70"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:25:13.945482 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.945443    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c76b\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-kube-api-access-9c76b\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:13.945482 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.945474    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-installation-pull-secrets\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:13.945482 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.945484    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-bound-sa-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:13.945691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.945495    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-image-registry-private-configuration\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:13.945691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.945504    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-ca-trust-extracted\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:13.945691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:13.945512    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-certificates\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:14.753244 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:14.753222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5487677d96-npq5g"
Sep 10 14:25:14.793039 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:14.793008    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5487677d96-npq5g"]
Sep 10 14:25:14.794700 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:14.794360    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5487677d96-npq5g"]
Sep 10 14:25:14.955480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:14.955414    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a81f81d-4c62-4d58-a2cb-416ddc42aa70-registry-tls\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:15.508896 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.508862    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a81f81d-4c62-4d58-a2cb-416ddc42aa70" path="/var/lib/kubelet/pods/4a81f81d-4c62-4d58-a2cb-416ddc42aa70/volumes"
Sep 10 14:25:15.758323 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.758287    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab8c32-7215-4161-bdc7-cb679d392540" containerID="1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4" exitCode=0
Sep 10 14:25:15.758713 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.758384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4"}
Sep 10 14:25:15.760654 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.760627    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd" event={"ID":"bc7c2b14-0407-4add-9864-8acc78bb6639","Type":"ContainerStarted","Data":"1eb29c5e05f6c4387cdf207526ef265f6d47f168d06eac4b2652f836abdd13de"}
Sep 10 14:25:15.760734 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.760687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd" event={"ID":"bc7c2b14-0407-4add-9864-8acc78bb6639","Type":"ContainerStarted","Data":"86da14f602f72640e9459c439bbb9241f49f91f138c1700ba1a04d01a2882098"}
Sep 10 14:25:15.760734 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.760708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd" event={"ID":"bc7c2b14-0407-4add-9864-8acc78bb6639","Type":"ContainerStarted","Data":"662daf1e28f0a71c851c882471ed2a1ac66bc4f16dc440dad216069ac16df30b"}
Sep 10 14:25:15.824368 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.824319    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-ff9598449-nkcsd" podStartSLOduration=2.11887665 podStartE2EDuration="4.824304517s" totalImagesPullingTime="2.705427867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:15.823202251 +0000 UTC m=+326.800331605" watchObservedRunningTime="2026-09-10 14:25:15.824304517 +0000 UTC m=+326.801433870"
Sep 10 14:25:15.917023 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:15.916988    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858749c565-cqv6m"]
Sep 10 14:25:19.784293 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:19.784257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerStarted","Data":"224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb"}
Sep 10 14:25:19.784668 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:19.784322    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerStarted","Data":"de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c"}
Sep 10 14:25:21.109255 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:21.109218    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:21.795121 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:21.795088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerStarted","Data":"32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b"}
Sep 10 14:25:21.795320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:21.795163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerStarted","Data":"8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58"}
Sep 10 14:25:21.795320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:21.795240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerStarted","Data":"3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8"}
Sep 10 14:25:21.795320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:21.795276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerStarted","Data":"8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b"}
Sep 10 14:25:21.824237 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:21.824178    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.892682674 podStartE2EDuration="9.824162026s" totalImagesPullingTime="6.889979892s" totalInitContainerRuntime="41.49946ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:25:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:21.821676292 +0000 UTC m=+332.798805684" watchObservedRunningTime="2026-09-10 14:25:21.824162026 +0000 UTC m=+332.801291379"
Sep 10 14:25:22.850604 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:22.850559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:25:26.752121 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:26.752069    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568c75f44-xgrrg"]
Sep 10 14:25:39.870147 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:39.870115    2577 generic.go:356] "Generic (PLEG): container finished" podID="8ba4a21d-201d-44ae-aff0-295b9e1b4311" containerID="c13ed6fc9f61928ab48bfa36cea4387dddc92a7299eb149b1807adc2cc4ffcde" exitCode=0
Sep 10 14:25:39.870549 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:39.870159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd" event={"ID":"8ba4a21d-201d-44ae-aff0-295b9e1b4311","Type":"ContainerDied","Data":"c13ed6fc9f61928ab48bfa36cea4387dddc92a7299eb149b1807adc2cc4ffcde"}
Sep 10 14:25:39.870549 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:39.870443    2577 scope.go:117] "RemoveContainer" containerID="c13ed6fc9f61928ab48bfa36cea4387dddc92a7299eb149b1807adc2cc4ffcde"
Sep 10 14:25:40.876362 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:40.876324    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-l9ffd" event={"ID":"8ba4a21d-201d-44ae-aff0-295b9e1b4311","Type":"ContainerStarted","Data":"06e59b477237e60fd926046d3d69c8e17bd5929dc226bc565291fd3ac4a99b00"}
Sep 10 14:25:40.936465 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:40.936401    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-858749c565-cqv6m" podUID="2a62f36f-c899-4127-b967-fdf151f6dc95" containerName="console" containerID="cri-o://85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34" gracePeriod=15
Sep 10 14:25:41.178051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.178025    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:41.304505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.304472    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-console-config\") pod \"2a62f36f-c899-4127-b967-fdf151f6dc95\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") "
Sep 10 14:25:41.304505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.304516    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-trusted-ca-bundle\") pod \"2a62f36f-c899-4127-b967-fdf151f6dc95\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") "
Sep 10 14:25:41.304757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.304546    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-oauth-serving-cert\") pod \"2a62f36f-c899-4127-b967-fdf151f6dc95\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") "
Sep 10 14:25:41.304757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.304568    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-serving-cert\") pod \"2a62f36f-c899-4127-b967-fdf151f6dc95\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") "
Sep 10 14:25:41.304757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.304596    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-oauth-config\") pod \"2a62f36f-c899-4127-b967-fdf151f6dc95\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") "
Sep 10 14:25:41.304757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.304663    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-service-ca\") pod \"2a62f36f-c899-4127-b967-fdf151f6dc95\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") "
Sep 10 14:25:41.304757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.304745    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65psx\" (UniqueName: \"kubernetes.io/projected/2a62f36f-c899-4127-b967-fdf151f6dc95-kube-api-access-65psx\") pod \"2a62f36f-c899-4127-b967-fdf151f6dc95\" (UID: \"2a62f36f-c899-4127-b967-fdf151f6dc95\") "
Sep 10 14:25:41.305045 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.305000    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-console-config" (OuterVolumeSpecName: "console-config") pod "2a62f36f-c899-4127-b967-fdf151f6dc95" (UID: "2a62f36f-c899-4127-b967-fdf151f6dc95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:41.305045 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.305026    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2a62f36f-c899-4127-b967-fdf151f6dc95" (UID: "2a62f36f-c899-4127-b967-fdf151f6dc95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:41.305166 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.305055    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-service-ca" (OuterVolumeSpecName: "service-ca") pod "2a62f36f-c899-4127-b967-fdf151f6dc95" (UID: "2a62f36f-c899-4127-b967-fdf151f6dc95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:41.305216 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.305190    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-console-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:41.305266 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.305212    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-trusted-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:41.305266 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.305248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2a62f36f-c899-4127-b967-fdf151f6dc95" (UID: "2a62f36f-c899-4127-b967-fdf151f6dc95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:41.307011 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.306981    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a62f36f-c899-4127-b967-fdf151f6dc95-kube-api-access-65psx" (OuterVolumeSpecName: "kube-api-access-65psx") pod "2a62f36f-c899-4127-b967-fdf151f6dc95" (UID: "2a62f36f-c899-4127-b967-fdf151f6dc95"). InnerVolumeSpecName "kube-api-access-65psx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:25:41.307122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.307003    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2a62f36f-c899-4127-b967-fdf151f6dc95" (UID: "2a62f36f-c899-4127-b967-fdf151f6dc95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:41.307122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.307015    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2a62f36f-c899-4127-b967-fdf151f6dc95" (UID: "2a62f36f-c899-4127-b967-fdf151f6dc95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:41.406133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.406092    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:41.406133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.406124    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a62f36f-c899-4127-b967-fdf151f6dc95-console-oauth-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:41.406133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.406134    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:41.406133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.406143    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65psx\" (UniqueName: \"kubernetes.io/projected/2a62f36f-c899-4127-b967-fdf151f6dc95-kube-api-access-65psx\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:41.406393 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.406152    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a62f36f-c899-4127-b967-fdf151f6dc95-oauth-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:41.881012 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.880980    2577 generic.go:356] "Generic (PLEG): container finished" podID="2a62f36f-c899-4127-b967-fdf151f6dc95" containerID="85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34" exitCode=0
Sep 10 14:25:41.881469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.881027    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858749c565-cqv6m"
Sep 10 14:25:41.881469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.881047    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858749c565-cqv6m" event={"ID":"2a62f36f-c899-4127-b967-fdf151f6dc95","Type":"ContainerDied","Data":"85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34"}
Sep 10 14:25:41.881469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.881099    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858749c565-cqv6m" event={"ID":"2a62f36f-c899-4127-b967-fdf151f6dc95","Type":"ContainerDied","Data":"d02b83bf62dd3069b2ff9cff3afc4bf4b5ac6c542cad386bedff019d1899b96b"}
Sep 10 14:25:41.881469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.881127    2577 scope.go:117] "RemoveContainer" containerID="85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34"
Sep 10 14:25:41.889919 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.889901    2577 scope.go:117] "RemoveContainer" containerID="85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34"
Sep 10 14:25:41.890217 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:25:41.890189    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34\": container with ID starting with 85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34 not found: ID does not exist" containerID="85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34"
Sep 10 14:25:41.890283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.890223    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34"} err="failed to get container status \"85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34\": rpc error: code = NotFound desc = could not find container \"85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34\": container with ID starting with 85ff3ca9e2ea61f0d991e6a29fefd977f485b0dcf275a6ab665817b3bacaea34 not found: ID does not exist"
Sep 10 14:25:41.896189 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.896166    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858749c565-cqv6m"]
Sep 10 14:25:41.899965 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:41.899943    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-858749c565-cqv6m"]
Sep 10 14:25:43.509054 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:43.509023    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a62f36f-c899-4127-b967-fdf151f6dc95" path="/var/lib/kubelet/pods/2a62f36f-c899-4127-b967-fdf151f6dc95/volumes"
Sep 10 14:25:51.776637 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:51.776582    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-568c75f44-xgrrg" podUID="eba667a0-dced-4ffe-a87b-b256a95d610a" containerName="console" containerID="cri-o://7bafb1102d5a311c8288b2bd6603e8b0b5d37bebcd9050118f02ec808cbeed61" gracePeriod=15
Sep 10 14:25:51.922277 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:51.922240    2577 generic.go:356] "Generic (PLEG): container finished" podID="eba667a0-dced-4ffe-a87b-b256a95d610a" containerID="7bafb1102d5a311c8288b2bd6603e8b0b5d37bebcd9050118f02ec808cbeed61" exitCode=0
Sep 10 14:25:51.922454 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:51.922277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568c75f44-xgrrg" event={"ID":"eba667a0-dced-4ffe-a87b-b256a95d610a","Type":"ContainerDied","Data":"7bafb1102d5a311c8288b2bd6603e8b0b5d37bebcd9050118f02ec808cbeed61"}
Sep 10 14:25:52.032371 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.032316    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:25:52.108664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.108614    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-service-ca\") pod \"eba667a0-dced-4ffe-a87b-b256a95d610a\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") "
Sep 10 14:25:52.108664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.108665    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-oauth-serving-cert\") pod \"eba667a0-dced-4ffe-a87b-b256a95d610a\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") "
Sep 10 14:25:52.108925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.108773    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzl6h\" (UniqueName: \"kubernetes.io/projected/eba667a0-dced-4ffe-a87b-b256a95d610a-kube-api-access-qzl6h\") pod \"eba667a0-dced-4ffe-a87b-b256a95d610a\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") "
Sep 10 14:25:52.108925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.108810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-oauth-config\") pod \"eba667a0-dced-4ffe-a87b-b256a95d610a\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") "
Sep 10 14:25:52.108925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.108874    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-console-config\") pod \"eba667a0-dced-4ffe-a87b-b256a95d610a\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") "
Sep 10 14:25:52.108925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.108900    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-serving-cert\") pod \"eba667a0-dced-4ffe-a87b-b256a95d610a\" (UID: \"eba667a0-dced-4ffe-a87b-b256a95d610a\") "
Sep 10 14:25:52.109125 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.109035    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-service-ca" (OuterVolumeSpecName: "service-ca") pod "eba667a0-dced-4ffe-a87b-b256a95d610a" (UID: "eba667a0-dced-4ffe-a87b-b256a95d610a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:52.109179 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.109117    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eba667a0-dced-4ffe-a87b-b256a95d610a" (UID: "eba667a0-dced-4ffe-a87b-b256a95d610a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:52.109348 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.109322    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-console-config" (OuterVolumeSpecName: "console-config") pod "eba667a0-dced-4ffe-a87b-b256a95d610a" (UID: "eba667a0-dced-4ffe-a87b-b256a95d610a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:52.109348 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.109336    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:52.109500 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.109363    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-oauth-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:52.111138 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.111115    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eba667a0-dced-4ffe-a87b-b256a95d610a" (UID: "eba667a0-dced-4ffe-a87b-b256a95d610a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:52.111229 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.111138    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba667a0-dced-4ffe-a87b-b256a95d610a-kube-api-access-qzl6h" (OuterVolumeSpecName: "kube-api-access-qzl6h") pod "eba667a0-dced-4ffe-a87b-b256a95d610a" (UID: "eba667a0-dced-4ffe-a87b-b256a95d610a"). InnerVolumeSpecName "kube-api-access-qzl6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:25:52.111229 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.111209    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eba667a0-dced-4ffe-a87b-b256a95d610a" (UID: "eba667a0-dced-4ffe-a87b-b256a95d610a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:52.210730 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.210689    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzl6h\" (UniqueName: \"kubernetes.io/projected/eba667a0-dced-4ffe-a87b-b256a95d610a-kube-api-access-qzl6h\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:52.210730 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.210723    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-oauth-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:52.210730 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.210736    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eba667a0-dced-4ffe-a87b-b256a95d610a-console-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:52.211007 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.210748    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eba667a0-dced-4ffe-a87b-b256a95d610a-console-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:25:52.926857 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.926809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568c75f44-xgrrg" event={"ID":"eba667a0-dced-4ffe-a87b-b256a95d610a","Type":"ContainerDied","Data":"3c339622b7ca20242d342a088cbdd282e93a7177d957bbb091a23c721e5c8a2f"}
Sep 10 14:25:52.926857 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.926855    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568c75f44-xgrrg"
Sep 10 14:25:52.927450 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.926892    2577 scope.go:117] "RemoveContainer" containerID="7bafb1102d5a311c8288b2bd6603e8b0b5d37bebcd9050118f02ec808cbeed61"
Sep 10 14:25:52.948061 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.948032    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568c75f44-xgrrg"]
Sep 10 14:25:52.951146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:52.951122    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568c75f44-xgrrg"]
Sep 10 14:25:53.509473 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:53.509442    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eba667a0-dced-4ffe-a87b-b256a95d610a" path="/var/lib/kubelet/pods/eba667a0-dced-4ffe-a87b-b256a95d610a/volumes"
Sep 10 14:25:54.944415 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:54.944382    2577 generic.go:356] "Generic (PLEG): container finished" podID="ad6563f0-8643-4b37-b96c-4c29c702edbb" containerID="ff8934573284b6d5aa0aa9c7f891e3974af4083ef7a1e1cd1e0158a1b7ad44c8" exitCode=0
Sep 10 14:25:54.944808 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:54.944451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl" event={"ID":"ad6563f0-8643-4b37-b96c-4c29c702edbb","Type":"ContainerDied","Data":"ff8934573284b6d5aa0aa9c7f891e3974af4083ef7a1e1cd1e0158a1b7ad44c8"}
Sep 10 14:25:54.944808 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:54.944779    2577 scope.go:117] "RemoveContainer" containerID="ff8934573284b6d5aa0aa9c7f891e3974af4083ef7a1e1cd1e0158a1b7ad44c8"
Sep 10 14:25:55.843568 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:55.843542    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7d2p_3f3b4437-66f7-459d-b8d1-df60d8436024/dns-node-resolver/0.log"
Sep 10 14:25:55.949728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:25:55.949695    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-sl8gl" event={"ID":"ad6563f0-8643-4b37-b96c-4c29c702edbb","Type":"ContainerStarted","Data":"90a01b52d4208f273ef340ae6b67e4ada24914ff8e5edaef7786c3fabe7e012e"}
Sep 10 14:26:02.510114 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:02.510072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:26:02.512439 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:02.512411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0247963a-2fc0-49a4-8cb2-5f7834cfd990-metrics-certs\") pod \"network-metrics-daemon-bfpgk\" (UID: \"0247963a-2fc0-49a4-8cb2-5f7834cfd990\") " pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:26:02.606524 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:02.606486    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-flc9p\""
Sep 10 14:26:02.615215 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:02.615185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfpgk"
Sep 10 14:26:02.884045 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:02.883946    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bfpgk"]
Sep 10 14:26:02.886703 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:26:02.886675    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0247963a_2fc0_49a4_8cb2_5f7834cfd990.slice/crio-bb70333c4273bfcb36773692e521a58e5ea3c2494f5aabd22907b00f979d0d3c WatchSource:0}: Error finding container bb70333c4273bfcb36773692e521a58e5ea3c2494f5aabd22907b00f979d0d3c: Status 404 returned error can't find the container with id bb70333c4273bfcb36773692e521a58e5ea3c2494f5aabd22907b00f979d0d3c
Sep 10 14:26:02.978572 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:02.978539    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfpgk" event={"ID":"0247963a-2fc0-49a4-8cb2-5f7834cfd990","Type":"ContainerStarted","Data":"bb70333c4273bfcb36773692e521a58e5ea3c2494f5aabd22907b00f979d0d3c"}
Sep 10 14:26:03.984792 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:03.984756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfpgk" event={"ID":"0247963a-2fc0-49a4-8cb2-5f7834cfd990","Type":"ContainerStarted","Data":"550667496ef038cc3c61f77c0cd2ebb440411c4394e4794f96ce489717e4eece"}
Sep 10 14:26:03.985165 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:03.984811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfpgk" event={"ID":"0247963a-2fc0-49a4-8cb2-5f7834cfd990","Type":"ContainerStarted","Data":"27a15002e79f5c970a33571602fd6b47c7a7573ddd206485a9efd217171a71c9"}
Sep 10 14:26:04.002360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:04.002308    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bfpgk" podStartSLOduration=373.116536351 podStartE2EDuration="6m14.002291515s" totalImagesPullingTime="885.755164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:04.000141145 +0000 UTC m=+374.977270534" watchObservedRunningTime="2026-09-10 14:26:04.002291515 +0000 UTC m=+374.979420869"
Sep 10 14:26:12.850864 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:12.850804    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:12.870303 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:12.870277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:13.037946 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:13.037921    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:31.018687 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:31.018602    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:26:31.019162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:31.018912    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="prometheus" containerID="cri-o://de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c" gracePeriod=600
Sep 10 14:26:31.019162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:31.018997    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="config-reloader" containerID="cri-o://224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb" gracePeriod=600
Sep 10 14:26:31.019162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:31.019008    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="thanos-sidecar" containerID="cri-o://8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b" gracePeriod=600
Sep 10 14:26:31.019162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:31.018999    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy" containerID="cri-o://8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58" gracePeriod=600
Sep 10 14:26:31.019162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:31.019090    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-web" containerID="cri-o://3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8" gracePeriod=600
Sep 10 14:26:31.019162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:31.019008    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-thanos" containerID="cri-o://32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b" gracePeriod=600
Sep 10 14:26:32.099439 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099385    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab8c32-7215-4161-bdc7-cb679d392540" containerID="32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b" exitCode=0
Sep 10 14:26:32.099439 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099432    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab8c32-7215-4161-bdc7-cb679d392540" containerID="8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58" exitCode=0
Sep 10 14:26:32.099439 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099440    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab8c32-7215-4161-bdc7-cb679d392540" containerID="8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b" exitCode=0
Sep 10 14:26:32.099439 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099449    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab8c32-7215-4161-bdc7-cb679d392540" containerID="224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb" exitCode=0
Sep 10 14:26:32.099947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099457    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab8c32-7215-4161-bdc7-cb679d392540" containerID="de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c" exitCode=0
Sep 10 14:26:32.099947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b"}
Sep 10 14:26:32.099947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099529    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58"}
Sep 10 14:26:32.099947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b"}
Sep 10 14:26:32.099947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb"}
Sep 10 14:26:32.099947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.099607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c"}
Sep 10 14:26:32.276974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.276949    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:32.378067 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378033    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-thanos-prometheus-http-client-file\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378256 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-grpc-tls\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378256 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378092    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-metrics-client-certs\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378256 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378109    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-2\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378256 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-web-config\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378256 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378144    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-config\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378307    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378369    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-1\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378402    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-tls\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378429    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-kubelet-serving-ca-bundle\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378448    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378457    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-0\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378482    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-trusted-ca-bundle\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378511    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-db\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378538    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-metrics-client-ca\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378605    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5frj\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-kube-api-access-f5frj\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-config-out\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378704    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-tls-assets\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378738    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378778    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-serving-certs-ca-bundle\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.378920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.378817    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-kube-rbac-proxy\") pod \"31ab8c32-7215-4161-bdc7-cb679d392540\" (UID: \"31ab8c32-7215-4161-bdc7-cb679d392540\") "
Sep 10 14:26:32.380671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.379644    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:26:32.380671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.380067    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:26:32.381356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.381190    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:26:32.381356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.381261    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.381631 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.381610    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:26:32.382027 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.382003    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:26:32.382341 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.382310    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.382420 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.382322    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:26:32.382420 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.382348    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-config" (OuterVolumeSpecName: "config") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.383004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.382944    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.383004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.382967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.383195 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.383081    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:26:32.383248 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.383232    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.383381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.383356    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.383591 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.383567    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:26:32.383855 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.383821    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.384338 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.384305    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-kube-api-access-f5frj" (OuterVolumeSpecName: "kube-api-access-f5frj") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "kube-api-access-f5frj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:26:32.384487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.384464    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-config-out" (OuterVolumeSpecName: "config-out") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:26:32.392346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.392325    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-web-config" (OuterVolumeSpecName: "web-config") pod "31ab8c32-7215-4161-bdc7-cb679d392540" (UID: "31ab8c32-7215-4161-bdc7-cb679d392540"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:26:32.480227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480188    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-web-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480217    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480227    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480238    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480249    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480258    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480267    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480276    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480284    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-db\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480292    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-metrics-client-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480300    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5frj\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-kube-api-access-f5frj\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480309    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31ab8c32-7215-4161-bdc7-cb679d392540-config-out\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480317    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31ab8c32-7215-4161-bdc7-cb679d392540-tls-assets\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480324    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480334    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480343    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-kube-rbac-proxy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480351    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480359    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-grpc-tls\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480367    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31ab8c32-7215-4161-bdc7-cb679d392540-secret-metrics-client-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:32.480488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:32.480375    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31ab8c32-7215-4161-bdc7-cb679d392540-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:26:33.106502 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.106469    2577 generic.go:356] "Generic (PLEG): container finished" podID="31ab8c32-7215-4161-bdc7-cb679d392540" containerID="3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8" exitCode=0
Sep 10 14:26:33.106916 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.106535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8"}
Sep 10 14:26:33.106916 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.106541    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.106916 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.106592    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31ab8c32-7215-4161-bdc7-cb679d392540","Type":"ContainerDied","Data":"7f640860144d0fe53d7d4c8b254c04ee1f98f66610c06d2a71e1b533983f5fd0"}
Sep 10 14:26:33.106916 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.106625    2577 scope.go:117] "RemoveContainer" containerID="32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b"
Sep 10 14:26:33.114447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.114429    2577 scope.go:117] "RemoveContainer" containerID="8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58"
Sep 10 14:26:33.121676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.121658    2577 scope.go:117] "RemoveContainer" containerID="3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8"
Sep 10 14:26:33.130966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.130877    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:26:33.131029 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.131017    2577 scope.go:117] "RemoveContainer" containerID="8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b"
Sep 10 14:26:33.137775 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.137752    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:26:33.138204 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.138096    2577 scope.go:117] "RemoveContainer" containerID="224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb"
Sep 10 14:26:33.144796 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.144779    2577 scope.go:117] "RemoveContainer" containerID="de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c"
Sep 10 14:26:33.151782 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.151764    2577 scope.go:117] "RemoveContainer" containerID="1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4"
Sep 10 14:26:33.158436 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.158419    2577 scope.go:117] "RemoveContainer" containerID="32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b"
Sep 10 14:26:33.158714 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.158694    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b\": container with ID starting with 32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b not found: ID does not exist" containerID="32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b"
Sep 10 14:26:33.158764 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.158724    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b"} err="failed to get container status \"32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b\": rpc error: code = NotFound desc = could not find container \"32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b\": container with ID starting with 32c658b99893c12bf29ba7061ad8a33a4125ee23c2ac17dd654c3485d2c3ea0b not found: ID does not exist"
Sep 10 14:26:33.158764 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.158743    2577 scope.go:117] "RemoveContainer" containerID="8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58"
Sep 10 14:26:33.159029 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.159011    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58\": container with ID starting with 8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58 not found: ID does not exist" containerID="8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58"
Sep 10 14:26:33.159083 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159033    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58"} err="failed to get container status \"8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58\": rpc error: code = NotFound desc = could not find container \"8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58\": container with ID starting with 8e83b56ea140e730aebd969e1e696519298ea0c69fd7a212f6df5a27650ece58 not found: ID does not exist"
Sep 10 14:26:33.159083 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159050    2577 scope.go:117] "RemoveContainer" containerID="3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8"
Sep 10 14:26:33.159286 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.159271    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8\": container with ID starting with 3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8 not found: ID does not exist" containerID="3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8"
Sep 10 14:26:33.159321 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159290    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8"} err="failed to get container status \"3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8\": rpc error: code = NotFound desc = could not find container \"3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8\": container with ID starting with 3631c9a88b43c3470b7eacd4ba79d119885eea0270098879ecdadff11b9122a8 not found: ID does not exist"
Sep 10 14:26:33.159321 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159304    2577 scope.go:117] "RemoveContainer" containerID="8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b"
Sep 10 14:26:33.159556 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.159540    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b\": container with ID starting with 8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b not found: ID does not exist" containerID="8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b"
Sep 10 14:26:33.159607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159559    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b"} err="failed to get container status \"8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b\": rpc error: code = NotFound desc = could not find container \"8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b\": container with ID starting with 8249bb32b721cdde3c982cf9977a0edf2f8dcca4509223f4a2b12146389cae7b not found: ID does not exist"
Sep 10 14:26:33.159607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159571    2577 scope.go:117] "RemoveContainer" containerID="224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb"
Sep 10 14:26:33.159786 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.159772    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb\": container with ID starting with 224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb not found: ID does not exist" containerID="224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb"
Sep 10 14:26:33.159825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159788    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb"} err="failed to get container status \"224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb\": rpc error: code = NotFound desc = could not find container \"224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb\": container with ID starting with 224c429e2c061ef6d5bca6399e9700bf4bc4a13e124e6d324d5d3575401cd4bb not found: ID does not exist"
Sep 10 14:26:33.159825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.159800    2577 scope.go:117] "RemoveContainer" containerID="de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c"
Sep 10 14:26:33.160050 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.160033    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c\": container with ID starting with de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c not found: ID does not exist" containerID="de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c"
Sep 10 14:26:33.160120 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.160054    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c"} err="failed to get container status \"de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c\": rpc error: code = NotFound desc = could not find container \"de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c\": container with ID starting with de4e872faabd33cfb0cad9a477389988c97752795a28dd955a146acd8735977c not found: ID does not exist"
Sep 10 14:26:33.160120 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.160069    2577 scope.go:117] "RemoveContainer" containerID="1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4"
Sep 10 14:26:33.160351 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.160331    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4\": container with ID starting with 1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4 not found: ID does not exist" containerID="1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4"
Sep 10 14:26:33.160399 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.160368    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4"} err="failed to get container status \"1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4\": rpc error: code = NotFound desc = could not find container \"1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4\": container with ID starting with 1d7c3de933005f94e60d5e532be00f30dcc04f44205ab75d4b759e624a07f6d4 not found: ID does not exist"
Sep 10 14:26:33.170861 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.170819    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:26:33.171112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171099    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="init-config-reloader"
Sep 10 14:26:33.171156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171113    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="init-config-reloader"
Sep 10 14:26:33.171156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171121    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy"
Sep 10 14:26:33.171156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171127    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy"
Sep 10 14:26:33.171156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171133    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="config-reloader"
Sep 10 14:26:33.171156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171139    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="config-reloader"
Sep 10 14:26:33.171156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171147    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="thanos-sidecar"
Sep 10 14:26:33.171156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171153    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="thanos-sidecar"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171160    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a62f36f-c899-4127-b967-fdf151f6dc95" containerName="console"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171166    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a62f36f-c899-4127-b967-fdf151f6dc95" containerName="console"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171175    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-web"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171180    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-web"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171186    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-thanos"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171191    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-thanos"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171199    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba667a0-dced-4ffe-a87b-b256a95d610a" containerName="console"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171203    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba667a0-dced-4ffe-a87b-b256a95d610a" containerName="console"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171209    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="prometheus"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171214    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="prometheus"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171257    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="prometheus"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171262    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="config-reloader"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171267    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171273    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eba667a0-dced-4ffe-a87b-b256a95d610a" containerName="console"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171278    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a62f36f-c899-4127-b967-fdf151f6dc95" containerName="console"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171283    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="thanos-sidecar"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171289    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-web"
Sep 10 14:26:33.171346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.171294    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" containerName="kube-rbac-proxy-thanos"
Sep 10 14:26:33.175267 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.175252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.177202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.177183    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 14:26:33.177686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.177669    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mkr5j\""
Sep 10 14:26:33.179057 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.179042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 14:26:33.179555 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.179534    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 14:26:33.179802 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.179736    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 14:26:33.180074 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 14:26:33.180074 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180065    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 14:26:33.180291 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180128    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 14:26:33.180291 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 14:26:33.180291 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180218    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 14:26:33.180462 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180365    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d4c3b4q4kkoo4\""
Sep 10 14:26:33.180595 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180559    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 14:26:33.180775 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180756    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 14:26:33.180895 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.180831    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 14:26:33.182572 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.182537    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 14:26:33.183490 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.183019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 14:26:33.190994 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.189561    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 14:26:33.193554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.193521    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:26:33.286368 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286325    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286368 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286550    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/798fbd64-fae8-4cd5-813a-cb93e5a68168-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286710    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/798fbd64-fae8-4cd5-813a-cb93e5a68168-config-out\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-web-config\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtkdb\" (UniqueName: \"kubernetes.io/projected/798fbd64-fae8-4cd5-813a-cb93e5a68168-kube-api-access-vtkdb\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.286807 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.287083 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-config\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.287083 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.287083 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.286872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/798fbd64-fae8-4cd5-813a-cb93e5a68168-config-out\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-web-config\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388419 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtkdb\" (UniqueName: \"kubernetes.io/projected/798fbd64-fae8-4cd5-813a-cb93e5a68168-kube-api-access-vtkdb\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388454 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388503 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-config\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388503 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388708    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.388746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.389034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.389034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.389034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.389034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.389034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/798fbd64-fae8-4cd5-813a-cb93e5a68168-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.389034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.388908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.389789 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.389759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.391214 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.391081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/798fbd64-fae8-4cd5-813a-cb93e5a68168-config-out\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.391560 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.391307    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-config\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.391560 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.391362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-web-config\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.391715 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.391590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.391715 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.391648    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.391962 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.391885    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.391962 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.391926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.392554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.392524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.392653 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.392560    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.393261 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.393200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.393552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.393523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.393942 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.393916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/798fbd64-fae8-4cd5-813a-cb93e5a68168-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.394043 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.393997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.394149 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.394041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/798fbd64-fae8-4cd5-813a-cb93e5a68168-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.394202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.394158    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.394261 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.394240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.394704 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.394685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/798fbd64-fae8-4cd5-813a-cb93e5a68168-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.396895 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.396876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtkdb\" (UniqueName: \"kubernetes.io/projected/798fbd64-fae8-4cd5-813a-cb93e5a68168-kube-api-access-vtkdb\") pod \"prometheus-k8s-0\" (UID: \"798fbd64-fae8-4cd5-813a-cb93e5a68168\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.487682 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.487640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:33.511027 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.511002    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ab8c32-7215-4161-bdc7-cb679d392540" path="/var/lib/kubelet/pods/31ab8c32-7215-4161-bdc7-cb679d392540/volumes"
Sep 10 14:26:33.565374 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.565336    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh" podUID="1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae"
Sep 10 14:26:33.565374 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:26:33.565351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zn59b" podUID="1c0136e8-a85c-4317-ae2a-f1c966c7f316"
Sep 10 14:26:33.773559 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:33.773469    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:26:33.776768 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:26:33.776745    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798fbd64_fae8_4cd5_813a_cb93e5a68168.slice/crio-eda4a875fde7765968abdea5953bb8635025232302ddf5b6d9247366190acd7d WatchSource:0}: Error finding container eda4a875fde7765968abdea5953bb8635025232302ddf5b6d9247366190acd7d: Status 404 returned error can't find the container with id eda4a875fde7765968abdea5953bb8635025232302ddf5b6d9247366190acd7d
Sep 10 14:26:34.112308 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:34.112217    2577 generic.go:356] "Generic (PLEG): container finished" podID="798fbd64-fae8-4cd5-813a-cb93e5a68168" containerID="e78c5fe4da6b871dc32e1d6e8bf8b336710da8fbeeaf74890109cb2104544820" exitCode=0
Sep 10 14:26:34.112777 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:34.112298    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerDied","Data":"e78c5fe4da6b871dc32e1d6e8bf8b336710da8fbeeaf74890109cb2104544820"}
Sep 10 14:26:34.112777 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:34.112386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerStarted","Data":"eda4a875fde7765968abdea5953bb8635025232302ddf5b6d9247366190acd7d"}
Sep 10 14:26:34.113310 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:34.113234    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:26:34.113370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:34.113240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn59b"
Sep 10 14:26:35.120858 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.120821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerStarted","Data":"8df923d23ba7b7becb2bf7fa10874a600e475733bc7f5a9fd1fbae4b5a95da9a"}
Sep 10 14:26:35.121297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.120900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerStarted","Data":"54b1cdb63ea082461f2898edb1e08eac1386023f512e998d25abf1c53910694d"}
Sep 10 14:26:35.121297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.120927    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerStarted","Data":"9968ce22bf94d314f7bec5594edf10d0a497a6423ee05585a161ba2daebd35b0"}
Sep 10 14:26:35.121297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.120952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerStarted","Data":"3dfa68289f93f83e1b496b923892ea5e435cf8b0429f56c66dad0f83dc93c636"}
Sep 10 14:26:35.121297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.120978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerStarted","Data":"2e3bb242a307f264366cca3e6dacfeb59adbf917ce6bdf9625b8c57db8e130f7"}
Sep 10 14:26:35.121297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.121000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"798fbd64-fae8-4cd5-813a-cb93e5a68168","Type":"ContainerStarted","Data":"d763bbee4fde72622c0ac6e39b6d10e50fe718ab7a47708b5323f84c25e72364"}
Sep 10 14:26:35.151812 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.151757    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.132752603 podStartE2EDuration="2.151740109s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.987506ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:35.151204127 +0000 UTC m=+406.128333491" watchObservedRunningTime="2026-09-10 14:26:35.151740109 +0000 UTC m=+406.128869476"
Sep 10 14:26:35.408589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.408478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:26:35.408589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.408552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:26:35.410962 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.410939    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0136e8-a85c-4317-ae2a-f1c966c7f316-metrics-tls\") pod \"dns-default-zn59b\" (UID: \"1c0136e8-a85c-4317-ae2a-f1c966c7f316\") " pod="openshift-dns/dns-default-zn59b"
Sep 10 14:26:35.411148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.411130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7gzhh\" (UID: \"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:26:35.616155 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.616120    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bb6j2\""
Sep 10 14:26:35.616342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.616200    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-587sj\""
Sep 10 14:26:35.624877 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.624834    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh"
Sep 10 14:26:35.624877 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.624869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zn59b"
Sep 10 14:26:35.899168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.899034    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-7gzhh"]
Sep 10 14:26:35.902254 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:26:35.902110    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd27d88_e9c6_4f01_8bb8_f6ab34a8aeae.slice/crio-3c139f586d558bb247a616e2b695c45a6acf56bb513e2d88deb4fc82e13e04d1 WatchSource:0}: Error finding container 3c139f586d558bb247a616e2b695c45a6acf56bb513e2d88deb4fc82e13e04d1: Status 404 returned error can't find the container with id 3c139f586d558bb247a616e2b695c45a6acf56bb513e2d88deb4fc82e13e04d1
Sep 10 14:26:35.902254 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:35.902190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zn59b"]
Sep 10 14:26:35.904599 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:26:35.904533    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0136e8_a85c_4317_ae2a_f1c966c7f316.slice/crio-4a4bafe5f350dfdf24230859721e86168f15b3dfbf82bfc1e9ce05ad932453f7 WatchSource:0}: Error finding container 4a4bafe5f350dfdf24230859721e86168f15b3dfbf82bfc1e9ce05ad932453f7: Status 404 returned error can't find the container with id 4a4bafe5f350dfdf24230859721e86168f15b3dfbf82bfc1e9ce05ad932453f7
Sep 10 14:26:36.126755 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:36.126708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zn59b" event={"ID":"1c0136e8-a85c-4317-ae2a-f1c966c7f316","Type":"ContainerStarted","Data":"4a4bafe5f350dfdf24230859721e86168f15b3dfbf82bfc1e9ce05ad932453f7"}
Sep 10 14:26:36.128008 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:36.127981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh" event={"ID":"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae","Type":"ContainerStarted","Data":"3c139f586d558bb247a616e2b695c45a6acf56bb513e2d88deb4fc82e13e04d1"}
Sep 10 14:26:38.139642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:38.139607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zn59b" event={"ID":"1c0136e8-a85c-4317-ae2a-f1c966c7f316","Type":"ContainerStarted","Data":"56581d7f9770079fc80cbedc45c995fca908ddcfa77d6a060b46fe1042716350"}
Sep 10 14:26:38.141158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:38.141136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh" event={"ID":"1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae","Type":"ContainerStarted","Data":"dd9cc54924e88132ac2e4e1bdbae56116b2c36f57ab4dd8e398dce233d970e20"}
Sep 10 14:26:38.156790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:38.156745    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-7gzhh" podStartSLOduration=378.770413971 podStartE2EDuration="6m20.15672949s" totalImagesPullingTime="1.386315519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:38.15478541 +0000 UTC m=+409.131914764" watchObservedRunningTime="2026-09-10 14:26:38.15672949 +0000 UTC m=+409.133858842"
Sep 10 14:26:38.488395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:38.488356    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:26:39.147350 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:39.147307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zn59b" event={"ID":"1c0136e8-a85c-4317-ae2a-f1c966c7f316","Type":"ContainerStarted","Data":"a95e78b4fc928e35f8fa2fb028d176748734b06a8977deeabf7a26d911dda142"}
Sep 10 14:26:39.147762 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:39.147475    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zn59b"
Sep 10 14:26:39.172495 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:39.172440    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zn59b" podStartSLOduration=374.08039977 podStartE2EDuration="6m16.172423357s" totalImagesPullingTime="2.092023587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:39.171440675 +0000 UTC m=+410.148570025" watchObservedRunningTime="2026-09-10 14:26:39.172423357 +0000 UTC m=+410.149552711"
Sep 10 14:26:49.153792 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:26:49.153759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zn59b"
Sep 10 14:27:33.488047 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:27:33.488012    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:27:33.509200 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:27:33.509174    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:27:34.379039 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:27:34.379005    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:29:49.404376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:29:49.404347    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:29:49.404955 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:29:49.404451    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:31:37.979974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:37.979934    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b2v2t"]
Sep 10 14:31:37.981963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:37.981943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:37.985682 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:37.985641    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 14:31:37.985923 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:37.985905    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v2cbj\""
Sep 10 14:31:37.985987 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:37.985970    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 14:31:38.002455 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.002420    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b2v2t"]
Sep 10 14:31:38.046958 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.046924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsgfq\" (UniqueName: \"kubernetes.io/projected/89e4c536-f124-4f10-9d17-a6684f13c9c8-kube-api-access-wsgfq\") pod \"cert-manager-55b4d954d5-b2v2t\" (UID: \"89e4c536-f124-4f10-9d17-a6684f13c9c8\") " pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:38.047139 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.046986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89e4c536-f124-4f10-9d17-a6684f13c9c8-bound-sa-token\") pod \"cert-manager-55b4d954d5-b2v2t\" (UID: \"89e4c536-f124-4f10-9d17-a6684f13c9c8\") " pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:38.147870 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.147803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89e4c536-f124-4f10-9d17-a6684f13c9c8-bound-sa-token\") pod \"cert-manager-55b4d954d5-b2v2t\" (UID: \"89e4c536-f124-4f10-9d17-a6684f13c9c8\") " pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:38.148048 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.147924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsgfq\" (UniqueName: \"kubernetes.io/projected/89e4c536-f124-4f10-9d17-a6684f13c9c8-kube-api-access-wsgfq\") pod \"cert-manager-55b4d954d5-b2v2t\" (UID: \"89e4c536-f124-4f10-9d17-a6684f13c9c8\") " pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:38.156904 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.156867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89e4c536-f124-4f10-9d17-a6684f13c9c8-bound-sa-token\") pod \"cert-manager-55b4d954d5-b2v2t\" (UID: \"89e4c536-f124-4f10-9d17-a6684f13c9c8\") " pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:38.157026 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.156990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsgfq\" (UniqueName: \"kubernetes.io/projected/89e4c536-f124-4f10-9d17-a6684f13c9c8-kube-api-access-wsgfq\") pod \"cert-manager-55b4d954d5-b2v2t\" (UID: \"89e4c536-f124-4f10-9d17-a6684f13c9c8\") " pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:38.290626 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.290538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b2v2t"
Sep 10 14:31:38.558000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.557900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b2v2t"]
Sep 10 14:31:38.562255 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:31:38.562226    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89e4c536_f124_4f10_9d17_a6684f13c9c8.slice/crio-143e8473c6d877ff89b29d3ce99f2e4a10c0351e142851121bd3d087fa49c4c8 WatchSource:0}: Error finding container 143e8473c6d877ff89b29d3ce99f2e4a10c0351e142851121bd3d087fa49c4c8: Status 404 returned error can't find the container with id 143e8473c6d877ff89b29d3ce99f2e4a10c0351e142851121bd3d087fa49c4c8
Sep 10 14:31:38.564584 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:38.564563    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:31:39.325127 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:39.325072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b2v2t" event={"ID":"89e4c536-f124-4f10-9d17-a6684f13c9c8","Type":"ContainerStarted","Data":"143e8473c6d877ff89b29d3ce99f2e4a10c0351e142851121bd3d087fa49c4c8"}
Sep 10 14:31:42.338530 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:42.338491    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b2v2t" event={"ID":"89e4c536-f124-4f10-9d17-a6684f13c9c8","Type":"ContainerStarted","Data":"b962deda2b7545c3fae393218d5f671725f2819979ecdc3f698168dd3697fd7d"}
Sep 10 14:31:42.354087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:42.354032    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-b2v2t" podStartSLOduration=2.47716986 podStartE2EDuration="5.354016885s" totalImagesPullingTime="2.876847025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:42.353355807 +0000 UTC m=+713.330485162" watchObservedRunningTime="2026-09-10 14:31:42.354016885 +0000 UTC m=+713.331146239"
Sep 10 14:31:55.354888 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.354838    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"]
Sep 10 14:31:55.357062 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.357047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.361390 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.361363    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 14:31:55.361727 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.361709    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 14:31:55.361791 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.361758    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 14:31:55.361830 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.361816    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6jvst\""
Sep 10 14:31:55.362126 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.362111    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 14:31:55.375210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.375185    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"]
Sep 10 14:31:55.396442 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.396414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bnls\" (UniqueName: \"kubernetes.io/projected/b782dd7e-dd2a-495e-bb98-9242c8120abe-kube-api-access-8bnls\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.396629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.396448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b782dd7e-dd2a-495e-bb98-9242c8120abe-manifests\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.396629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.396470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b782dd7e-dd2a-495e-bb98-9242c8120abe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.396629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.396602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b782dd7e-dd2a-495e-bb98-9242c8120abe-tmp\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.396777 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.396643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b782dd7e-dd2a-495e-bb98-9242c8120abe-webhook-cert\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.497337 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.497297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b782dd7e-dd2a-495e-bb98-9242c8120abe-tmp\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.497337 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.497337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b782dd7e-dd2a-495e-bb98-9242c8120abe-webhook-cert\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.497596 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.497504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bnls\" (UniqueName: \"kubernetes.io/projected/b782dd7e-dd2a-495e-bb98-9242c8120abe-kube-api-access-8bnls\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.497596 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.497554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b782dd7e-dd2a-495e-bb98-9242c8120abe-manifests\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.497596 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.497591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b782dd7e-dd2a-495e-bb98-9242c8120abe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.497981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.497954    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b782dd7e-dd2a-495e-bb98-9242c8120abe-manifests\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.499724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.499702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b782dd7e-dd2a-495e-bb98-9242c8120abe-tmp\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.499832 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.499757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b782dd7e-dd2a-495e-bb98-9242c8120abe-webhook-cert\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.499901 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.499881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b782dd7e-dd2a-495e-bb98-9242c8120abe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.505408 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.505381    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bnls\" (UniqueName: \"kubernetes.io/projected/b782dd7e-dd2a-495e-bb98-9242c8120abe-kube-api-access-8bnls\") pod \"opendatahub-operator-controller-manager-755bd7f47-wrw9n\" (UID: \"b782dd7e-dd2a-495e-bb98-9242c8120abe\") " pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.667979 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.667943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:31:55.951060 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:55.951033    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"]
Sep 10 14:31:55.953763 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:31:55.953734    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb782dd7e_dd2a_495e_bb98_9242c8120abe.slice/crio-5c5defb4fa7ba60587b5338f15f2a656c6d36e08b1d5fb320ef26a3be0f79b06 WatchSource:0}: Error finding container 5c5defb4fa7ba60587b5338f15f2a656c6d36e08b1d5fb320ef26a3be0f79b06: Status 404 returned error can't find the container with id 5c5defb4fa7ba60587b5338f15f2a656c6d36e08b1d5fb320ef26a3be0f79b06
Sep 10 14:31:56.398179 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:56.398142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n" event={"ID":"b782dd7e-dd2a-495e-bb98-9242c8120abe","Type":"ContainerStarted","Data":"5c5defb4fa7ba60587b5338f15f2a656c6d36e08b1d5fb320ef26a3be0f79b06"}
Sep 10 14:31:59.415369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:31:59.415314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n" event={"ID":"b782dd7e-dd2a-495e-bb98-9242c8120abe","Type":"ContainerStarted","Data":"17e2d175f338fca25de5ce3f5682e7382a0baff64e5ff5069542dfcf6780425f"}
Sep 10 14:32:00.421624 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:00.421582    2577 generic.go:356] "Generic (PLEG): container finished" podID="b782dd7e-dd2a-495e-bb98-9242c8120abe" containerID="17e2d175f338fca25de5ce3f5682e7382a0baff64e5ff5069542dfcf6780425f" exitCode=0
Sep 10 14:32:00.422020 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:00.421668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n" event={"ID":"b782dd7e-dd2a-495e-bb98-9242c8120abe","Type":"ContainerDied","Data":"17e2d175f338fca25de5ce3f5682e7382a0baff64e5ff5069542dfcf6780425f"}
Sep 10 14:32:01.428381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:01.428349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n" event={"ID":"b782dd7e-dd2a-495e-bb98-9242c8120abe","Type":"ContainerStarted","Data":"df24f05cab4be4f1c382bb78f92fe415d4016794000a20562ef45dad2553b0d8"}
Sep 10 14:32:01.428794 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:01.428430    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:32:01.454709 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:01.454655    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n" podStartSLOduration=2.403582768 podStartE2EDuration="6.454638366s" totalImagesPullingTime="3.00102791s" totalInitContainerRuntime="1.050027688s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:01.453641251 +0000 UTC m=+732.430770640" watchObservedRunningTime="2026-09-10 14:32:01.454638366 +0000 UTC m=+732.431767720"
Sep 10 14:32:12.435773 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:12.435742    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-755bd7f47-wrw9n"
Sep 10 14:32:23.156044 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.156003    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"]
Sep 10 14:32:23.160852 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.160818    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.163906 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.163687    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pjsx8\""
Sep 10 14:32:23.163906 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.163749    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 14:32:23.164107 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.164085    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 14:32:23.168410 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.164658    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 14:32:23.172159 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.172129    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"]
Sep 10 14:32:23.350205 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350205 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3213759d-6a62-4b86-986b-cfbd4c63b763-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gsjs\" (UniqueName: \"kubernetes.io/projected/3213759d-6a62-4b86-986b-cfbd4c63b763-kube-api-access-4gsjs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.350688 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.350483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451239 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451239 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451239 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451239 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3213759d-6a62-4b86-986b-cfbd4c63b763-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451573 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gsjs\" (UniqueName: \"kubernetes.io/projected/3213759d-6a62-4b86-986b-cfbd4c63b763-kube-api-access-4gsjs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451573 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451672 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451806 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.451963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.452071 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.451979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.452143 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.452119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3213759d-6a62-4b86-986b-cfbd4c63b763-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.452143 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.452132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.452250 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.452194    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.453816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.453796    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.453950 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.453913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.459132 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.459107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3213759d-6a62-4b86-986b-cfbd4c63b763-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.459246 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.459190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gsjs\" (UniqueName: \"kubernetes.io/projected/3213759d-6a62-4b86-986b-cfbd4c63b763-kube-api-access-4gsjs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr\" (UID: \"3213759d-6a62-4b86-986b-cfbd4c63b763\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.477082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.477052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:23.752626 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:23.752599    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"]
Sep 10 14:32:23.755403 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:32:23.755369    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3213759d_6a62_4b86_986b_cfbd4c63b763.slice/crio-e022aef28b8bba383ce46ec3246bf61ca19cba3455b31e28dd63699657435c8f WatchSource:0}: Error finding container e022aef28b8bba383ce46ec3246bf61ca19cba3455b31e28dd63699657435c8f: Status 404 returned error can't find the container with id e022aef28b8bba383ce46ec3246bf61ca19cba3455b31e28dd63699657435c8f
Sep 10 14:32:24.537253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:24.537216    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr" event={"ID":"3213759d-6a62-4b86-986b-cfbd4c63b763","Type":"ContainerStarted","Data":"e022aef28b8bba383ce46ec3246bf61ca19cba3455b31e28dd63699657435c8f"}
Sep 10 14:32:26.545633 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:26.545594    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:32:26.546047 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:26.545665    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:32:26.546047 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:26.545697    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:32:27.552968 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:27.552925    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr" event={"ID":"3213759d-6a62-4b86-986b-cfbd4c63b763","Type":"ContainerStarted","Data":"60dbe115b74a0b74fa1beb7ca57b7ca9304bd670b5c40602dcefdb019deb001c"}
Sep 10 14:32:27.572434 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:27.572367    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr" podStartSLOduration=1.784584696 podStartE2EDuration="4.572348986s" totalImagesPullingTime="2.78776429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:27.570307698 +0000 UTC m=+758.547437052" watchObservedRunningTime="2026-09-10 14:32:27.572348986 +0000 UTC m=+758.549478340"
Sep 10 14:32:28.477823 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:28.477783    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:28.483331 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:28.483295    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:28.557085 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:28.557053    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:28.558100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:28.558078    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr"
Sep 10 14:32:32.969540 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:32.969501    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"]
Sep 10 14:32:32.972459 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:32.972443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:32.974478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:32.974454    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 14:32:32.974611 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:32.974493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 14:32:32.974611 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:32.974455    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 14:32:32.974611 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:32.974560    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-879xk\""
Sep 10 14:32:32.990833 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:32.989990    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"]
Sep 10 14:32:33.016668 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.016636    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"]
Sep 10 14:32:33.019396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.019380    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.023261 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.023239    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 14:32:33.023404 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.023256    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 14:32:33.023477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.023318    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:32:33.023477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.023355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 14:32:33.023585 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.023542    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jr6k8\""
Sep 10 14:32:33.023659 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.023643    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 14:32:33.031383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.031357    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"]
Sep 10 14:32:33.039835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.039805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.040008 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.039897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.040008 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.039973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxc4t\" (UniqueName: \"kubernetes.io/projected/6b277dc7-76e2-4869-aad5-7b911f242050-kube-api-access-fxc4t\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.040107 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.040024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b277dc7-76e2-4869-aad5-7b911f242050-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.040147 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.040121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.040194 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.040165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b277dc7-76e2-4869-aad5-7b911f242050-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.040237 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.040195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b277dc7-76e2-4869-aad5-7b911f242050-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.140815 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.140781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b277dc7-76e2-4869-aad5-7b911f242050-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.141006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.140831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhr6w\" (UniqueName: \"kubernetes.io/projected/632ef37e-6534-4f94-b949-338c2d32629a-kube-api-access-nhr6w\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.141006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.140885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.141006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.140913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b277dc7-76e2-4869-aad5-7b911f242050-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.141006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.140941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b277dc7-76e2-4869-aad5-7b911f242050-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.141230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.140990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/632ef37e-6534-4f94-b949-338c2d32629a-metrics-cert\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.141230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.141081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/632ef37e-6534-4f94-b949-338c2d32629a-cert\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.141230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.141138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/632ef37e-6534-4f94-b949-338c2d32629a-manager-config\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.141230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.141186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.141230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.141220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.141486 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.141254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxc4t\" (UniqueName: \"kubernetes.io/projected/6b277dc7-76e2-4869-aad5-7b911f242050-kube-api-access-fxc4t\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.141739 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.141716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6b277dc7-76e2-4869-aad5-7b911f242050-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.143399 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.143373    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.143471 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.143456    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.143519 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.143496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b277dc7-76e2-4869-aad5-7b911f242050-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.143727 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.143711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6b277dc7-76e2-4869-aad5-7b911f242050-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.147816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.147796    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b277dc7-76e2-4869-aad5-7b911f242050-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.148356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.148330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxc4t\" (UniqueName: \"kubernetes.io/projected/6b277dc7-76e2-4869-aad5-7b911f242050-kube-api-access-fxc4t\") pod \"istiod-openshift-gateway-5677ccb49b-cthr2\" (UID: \"6b277dc7-76e2-4869-aad5-7b911f242050\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.242274 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.242191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/632ef37e-6534-4f94-b949-338c2d32629a-metrics-cert\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.242274 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.242240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/632ef37e-6534-4f94-b949-338c2d32629a-cert\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.242452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.242365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/632ef37e-6534-4f94-b949-338c2d32629a-manager-config\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.242452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.242445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhr6w\" (UniqueName: \"kubernetes.io/projected/632ef37e-6534-4f94-b949-338c2d32629a-kube-api-access-nhr6w\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.243018 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.242993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/632ef37e-6534-4f94-b949-338c2d32629a-manager-config\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.244611 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.244589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/632ef37e-6534-4f94-b949-338c2d32629a-cert\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.244704 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.244687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/632ef37e-6534-4f94-b949-338c2d32629a-metrics-cert\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.280399 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.280369    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhr6w\" (UniqueName: \"kubernetes.io/projected/632ef37e-6534-4f94-b949-338c2d32629a-kube-api-access-nhr6w\") pod \"lws-controller-manager-8f5db98bf-55jnd\" (UID: \"632ef37e-6534-4f94-b949-338c2d32629a\") " pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.282221 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.282200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:33.328533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.328350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:33.574405 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.574321    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"]
Sep 10 14:32:33.632128 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:33.632099    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"]
Sep 10 14:32:33.634347 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:32:33.634312    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632ef37e_6534_4f94_b949_338c2d32629a.slice/crio-e0ea555eb8710fde60da0581ceb6a4a666262202df8ee4a59d07776dd1c95c9e WatchSource:0}: Error finding container e0ea555eb8710fde60da0581ceb6a4a666262202df8ee4a59d07776dd1c95c9e: Status 404 returned error can't find the container with id e0ea555eb8710fde60da0581ceb6a4a666262202df8ee4a59d07776dd1c95c9e
Sep 10 14:32:34.589122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:34.589025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd" event={"ID":"632ef37e-6534-4f94-b949-338c2d32629a","Type":"ContainerStarted","Data":"e0ea555eb8710fde60da0581ceb6a4a666262202df8ee4a59d07776dd1c95c9e"}
Sep 10 14:32:34.591151 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:34.591087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2" event={"ID":"6b277dc7-76e2-4869-aad5-7b911f242050","Type":"ContainerStarted","Data":"5955674a8225503cc431cd689dbb66b99d2eebf94792bb909ccfb060f6cb2e7b"}
Sep 10 14:32:37.297934 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.297872    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:32:37.298253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.297964    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:32:37.608436 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.608330    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd" event={"ID":"632ef37e-6534-4f94-b949-338c2d32629a","Type":"ContainerStarted","Data":"714382c91553500945a3d624d88771fff52e4a2a65c7dc8b9bb7e7ffcf560916"}
Sep 10 14:32:37.608617 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.608458    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:32:37.610105 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.610080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2" event={"ID":"6b277dc7-76e2-4869-aad5-7b911f242050","Type":"ContainerStarted","Data":"5834346a1963bec7e2bf0a441f384037e095673066abafe16fa467afbf7643b5"}
Sep 10 14:32:37.610247 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.610130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:37.651569 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.651511    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd" podStartSLOduration=1.9905920350000001 podStartE2EDuration="5.651492921s" totalImagesPullingTime="3.660900886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:37.64993222 +0000 UTC m=+768.627061573" watchObservedRunningTime="2026-09-10 14:32:37.651492921 +0000 UTC m=+768.628622322"
Sep 10 14:32:37.691785 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:37.691720    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2" podStartSLOduration=1.9810469149999999 podStartE2EDuration="5.691697428s" totalImagesPullingTime="3.710650513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:37.68951761 +0000 UTC m=+768.666646965" watchObservedRunningTime="2026-09-10 14:32:37.691697428 +0000 UTC m=+768.668826783"
Sep 10 14:32:38.616362 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:38.616329    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2"
Sep 10 14:32:48.616642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:32:48.616609    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8f5db98bf-55jnd"
Sep 10 14:34:48.433812 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.433718    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"]
Sep 10 14:34:48.436247 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.436225    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.438689 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.438667    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7cbr8\""
Sep 10 14:34:48.454607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.454569    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"]
Sep 10 14:34:48.470419 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxfpm\" (UniqueName: \"kubernetes.io/projected/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-kube-api-access-nxfpm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470595 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470595 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470595 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470595 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.470827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.470657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.571619 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxfpm\" (UniqueName: \"kubernetes.io/projected/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-kube-api-access-nxfpm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.571800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.571800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.571942 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.571942 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.571942 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572098 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572098 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.571985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572098 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.572028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572255 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.572116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.572276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572443 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.572420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572534 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.572447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.572534 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.572522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.574136 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.574116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.574529 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.574507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.584593 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.584567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.584721 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.584696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxfpm\" (UniqueName: \"kubernetes.io/projected/f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4-kube-api-access-nxfpm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-gmnj8\" (UID: \"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:48.747434 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:48.747352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:49.023506 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.023479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"]
Sep 10 14:34:49.025743 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:34:49.025711    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b8dac2_dd9b_4cfe_ac44_cc6a0ad19eb4.slice/crio-815c4f93e11f53f153c9f1e87cb9827098b1bd701f0f4c7ef1742433c7b486d3 WatchSource:0}: Error finding container 815c4f93e11f53f153c9f1e87cb9827098b1bd701f0f4c7ef1742433c7b486d3: Status 404 returned error can't find the container with id 815c4f93e11f53f153c9f1e87cb9827098b1bd701f0f4c7ef1742433c7b486d3
Sep 10 14:34:49.027912 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.027839    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:34:49.028016 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.027964    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:34:49.028016 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.028009    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:34:49.206749 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.206710    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" event={"ID":"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4","Type":"ContainerStarted","Data":"258f2a630d75375ef0d1cb71bc75c776c89a23cab1b407b0a16de50696364d6d"}
Sep 10 14:34:49.206945 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.206765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" event={"ID":"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4","Type":"ContainerStarted","Data":"815c4f93e11f53f153c9f1e87cb9827098b1bd701f0f4c7ef1742433c7b486d3"}
Sep 10 14:34:49.225004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.224952    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podStartSLOduration=1.224934578 podStartE2EDuration="1.224934578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:34:49.223792964 +0000 UTC m=+900.200922442" watchObservedRunningTime="2026-09-10 14:34:49.224934578 +0000 UTC m=+900.202063932"
Sep 10 14:34:49.433745 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.433718    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:34:49.434703 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.434674    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:34:49.747825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:49.747733    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:50.753318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:50.753282    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:51.215703 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:51.215676    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:34:51.216827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:34:51.216811    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:36:14.866711 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:14.866632    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"]
Sep 10 14:36:14.870233 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:14.870214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:14.872197 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:14.872174    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5bz5k\""
Sep 10 14:36:14.872322 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:14.872218    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 14:36:14.886225 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:14.886200    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"]
Sep 10 14:36:14.969307 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:14.969272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbzd\" (UniqueName: \"kubernetes.io/projected/7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a-kube-api-access-vcbzd\") pod \"payload-pre-processing-59fbc47bf8-7pdc7\" (UID: \"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:14.969471 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:14.969319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7pdc7\" (UID: \"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:15.070103 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:15.070067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbzd\" (UniqueName: \"kubernetes.io/projected/7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a-kube-api-access-vcbzd\") pod \"payload-pre-processing-59fbc47bf8-7pdc7\" (UID: \"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:15.070278 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:15.070116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7pdc7\" (UID: \"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:15.070748 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:15.070729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-7pdc7\" (UID: \"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:15.082418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:15.082389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbzd\" (UniqueName: \"kubernetes.io/projected/7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a-kube-api-access-vcbzd\") pod \"payload-pre-processing-59fbc47bf8-7pdc7\" (UID: \"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:15.181006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:15.180915    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:15.449408 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:15.449322    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"]
Sep 10 14:36:15.451981 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:36:15.451949    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7249c3f4_befb_4f68_8fbd_d2fbd8ecd45a.slice/crio-240671eeabe8d2e4f5d70be1709c28ae301110aabf64fcbc3402418371dad3a2 WatchSource:0}: Error finding container 240671eeabe8d2e4f5d70be1709c28ae301110aabf64fcbc3402418371dad3a2: Status 404 returned error can't find the container with id 240671eeabe8d2e4f5d70be1709c28ae301110aabf64fcbc3402418371dad3a2
Sep 10 14:36:15.607563 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:15.607525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7" event={"ID":"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a","Type":"ContainerStarted","Data":"240671eeabe8d2e4f5d70be1709c28ae301110aabf64fcbc3402418371dad3a2"}
Sep 10 14:36:17.622374 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:17.622342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7" event={"ID":"7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a","Type":"ContainerStarted","Data":"e1e62c3a5bd2923a02fde1781134731976fd28f34e224a13ea91086b0a7a056e"}
Sep 10 14:36:17.622797 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:17.622452    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:17.636506 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:17.636448    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7" podStartSLOduration=1.690713926 podStartE2EDuration="3.636426004s" totalImagesPullingTime="1.945712078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:17.636111976 +0000 UTC m=+988.613241334" watchObservedRunningTime="2026-09-10 14:36:17.636426004 +0000 UTC m=+988.613555357"
Sep 10 14:36:22.257049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:22.257000    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:36:22.257460 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:22.257073    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podUID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:36:24.657981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:24.657950    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerID="258f2a630d75375ef0d1cb71bc75c776c89a23cab1b407b0a16de50696364d6d" exitCode=0
Sep 10 14:36:24.658395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:24.658027    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" event={"ID":"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4","Type":"ContainerDied","Data":"258f2a630d75375ef0d1cb71bc75c776c89a23cab1b407b0a16de50696364d6d"}
Sep 10 14:36:24.658444 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:24.658430    2577 scope.go:117] "RemoveContainer" containerID="258f2a630d75375ef0d1cb71bc75c776c89a23cab1b407b0a16de50696364d6d"
Sep 10 14:36:24.659563 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:24.659533    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:36:24.659625 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:24.659600    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:36:24.659659 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:24.659640    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:36:25.681086 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:25.681045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" event={"ID":"f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4","Type":"ContainerStarted","Data":"1d40acca2540fbb02950edf994805d0b02639add6a6d33bebaf9025ce54472b6"}
Sep 10 14:36:25.747644 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:25.747596    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:36:25.747930 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:25.747900    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 14:36:25.747990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:25.747962    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podUID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 14:36:26.748393 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:26.748353    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 14:36:26.748784 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:26.748416    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podUID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 14:36:27.748041 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:27.748008    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 14:36:27.748215 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:27.748079    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podUID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 14:36:28.629793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:28.629758    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7"
Sep 10 14:36:28.748694 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:28.748655    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 14:36:28.748892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:28.748718    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podUID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 14:36:29.747908 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:29.747868    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 14:36:29.748318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:29.747931    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podUID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 14:36:30.748382 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:30.748334    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 14:36:30.748793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:30.748420    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8" podUID="f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 14:36:31.453939 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.453898    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"]
Sep 10 14:36:31.458362 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.458325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.463099 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.463075    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 14:36:31.463518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.463497    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 14:36:31.463669 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.463540    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 14:36:31.463669 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.463505    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6q9c\""
Sep 10 14:36:31.467142 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.466931    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"]
Sep 10 14:36:31.537606 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.537567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.537784 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.537623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.537784 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.537724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.537899 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.537779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspd4\" (UniqueName: \"kubernetes.io/projected/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-kube-api-access-hspd4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.537899 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.537808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.537899 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.537836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.638993 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.638952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639209 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hspd4\" (UniqueName: \"kubernetes.io/projected/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-kube-api-access-hspd4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639209 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639209 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639384 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639384 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639515 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639421    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639515 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.639689 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.639663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.641431 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.641408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.641599 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.641583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.647199 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.647178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspd4\" (UniqueName: \"kubernetes.io/projected/bab2daf0-be49-43a0-ae03-c0d098bd0c9c-kube-api-access-hspd4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl\" (UID: \"bab2daf0-be49-43a0-ae03-c0d098bd0c9c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:31.751495 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.751409    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:36:31.751963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.751797    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:36:31.752656 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.752638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8"
Sep 10 14:36:31.771150 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:31.771122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:32.049092 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:32.049010    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"]
Sep 10 14:36:32.053057 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:36:32.053023    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab2daf0_be49_43a0_ae03_c0d098bd0c9c.slice/crio-a9d0b3c4fc2e0ff0a280e4e247bd0c17a6759781ecb6b7b0ed8458cc0076942d WatchSource:0}: Error finding container a9d0b3c4fc2e0ff0a280e4e247bd0c17a6759781ecb6b7b0ed8458cc0076942d: Status 404 returned error can't find the container with id a9d0b3c4fc2e0ff0a280e4e247bd0c17a6759781ecb6b7b0ed8458cc0076942d
Sep 10 14:36:32.721477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:32.721441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl" event={"ID":"bab2daf0-be49-43a0-ae03-c0d098bd0c9c","Type":"ContainerStarted","Data":"a9d0b3c4fc2e0ff0a280e4e247bd0c17a6759781ecb6b7b0ed8458cc0076942d"}
Sep 10 14:36:33.727300 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:33.727257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl" event={"ID":"bab2daf0-be49-43a0-ae03-c0d098bd0c9c","Type":"ContainerStarted","Data":"7e412359a94b6c31295ada120253aa32a270002d4e2752df6a23368f513ba9d9"}
Sep 10 14:36:33.757589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:33.757539    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl" podStartSLOduration=1.784221845 podStartE2EDuration="2.757520146s" totalImagesPullingTime="973.298301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:33.755903614 +0000 UTC m=+1004.733032968" watchObservedRunningTime="2026-09-10 14:36:33.757520146 +0000 UTC m=+1004.734649499"
Sep 10 14:36:41.771505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:41.771461    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:41.772169 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:41.771518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:41.784199 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:41.784172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:42.780978 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:42.780943    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl"
Sep 10 14:36:46.328496 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.328461    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"]
Sep 10 14:36:46.331247 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.331223    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.333563 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.333539    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 14:36:46.342756 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.342731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"]
Sep 10 14:36:46.378662 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.378620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.378662 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.378669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52f4eb40-fa22-4470-8b55-5fba33e1bc68-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.378961 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.378685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wmhb\" (UniqueName: \"kubernetes.io/projected/52f4eb40-fa22-4470-8b55-5fba33e1bc68-kube-api-access-5wmhb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.378961 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.378788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.378961 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.378826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.378961 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.378919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.479757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.479712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.479757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.479757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.480112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.479798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.480112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.479895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.480112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.479938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52f4eb40-fa22-4470-8b55-5fba33e1bc68-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.480112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.480054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmhb\" (UniqueName: \"kubernetes.io/projected/52f4eb40-fa22-4470-8b55-5fba33e1bc68-kube-api-access-5wmhb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.480338 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.480288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.480338 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.480331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.480427 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.480366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.482221 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.482197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52f4eb40-fa22-4470-8b55-5fba33e1bc68-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.482425 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.482407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52f4eb40-fa22-4470-8b55-5fba33e1bc68-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.487030 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.487008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wmhb\" (UniqueName: \"kubernetes.io/projected/52f4eb40-fa22-4470-8b55-5fba33e1bc68-kube-api-access-5wmhb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd\" (UID: \"52f4eb40-fa22-4470-8b55-5fba33e1bc68\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.642431 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.642387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:46.911149 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.911123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"]
Sep 10 14:36:46.913806 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:36:46.913779    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f4eb40_fa22_4470_8b55_5fba33e1bc68.slice/crio-c85b034d0e500d6b0df299b0349f0f9fc79bca60b936bf767d920a8c15dc191a WatchSource:0}: Error finding container c85b034d0e500d6b0df299b0349f0f9fc79bca60b936bf767d920a8c15dc191a: Status 404 returned error can't find the container with id c85b034d0e500d6b0df299b0349f0f9fc79bca60b936bf767d920a8c15dc191a
Sep 10 14:36:46.915502 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:46.915481    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:36:47.795860 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:47.795810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd" event={"ID":"52f4eb40-fa22-4470-8b55-5fba33e1bc68","Type":"ContainerStarted","Data":"de625b2c0adca376bd8fa44d7aa88fa16744ca746595282ccaf1b81b408ccf2b"}
Sep 10 14:36:47.796273 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:47.795891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd" event={"ID":"52f4eb40-fa22-4470-8b55-5fba33e1bc68","Type":"ContainerStarted","Data":"c85b034d0e500d6b0df299b0349f0f9fc79bca60b936bf767d920a8c15dc191a"}
Sep 10 14:36:56.643535 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:56.643492    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:56.643983 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:56.643574    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:56.656325 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:56.656288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:36:56.677441 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:56.677391    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd" podStartSLOduration=10.475133689 podStartE2EDuration="10.67737255s" totalImagesPullingTime="202.238861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:47.822165397 +0000 UTC m=+1018.799294753" watchObservedRunningTime="2026-09-10 14:36:56.67737255 +0000 UTC m=+1027.654501904"
Sep 10 14:36:56.849640 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:36:56.849610    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd"
Sep 10 14:37:26.430380 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.430347    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"]
Sep 10 14:37:26.440396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.440360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.443090 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.443062    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 14:37:26.444138 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.444116    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"]
Sep 10 14:37:26.547641 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.547600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.547826 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.547725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.547826 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.547771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d74b00-f7ab-48e8-89a6-4801b1ce4146-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.547826 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.547808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4vm5\" (UniqueName: \"kubernetes.io/projected/03d74b00-f7ab-48e8-89a6-4801b1ce4146-kube-api-access-t4vm5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.547960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.547886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.547960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.547908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649341 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649548 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649548 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d74b00-f7ab-48e8-89a6-4801b1ce4146-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649548 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4vm5\" (UniqueName: \"kubernetes.io/projected/03d74b00-f7ab-48e8-89a6-4801b1ce4146-kube-api-access-t4vm5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649548 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649548 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649877 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649964 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.649964 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.649947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.651974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.651946    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d74b00-f7ab-48e8-89a6-4801b1ce4146-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.652126 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.652109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d74b00-f7ab-48e8-89a6-4801b1ce4146-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.656899 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.656876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4vm5\" (UniqueName: \"kubernetes.io/projected/03d74b00-f7ab-48e8-89a6-4801b1ce4146-kube-api-access-t4vm5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb\" (UID: \"03d74b00-f7ab-48e8-89a6-4801b1ce4146\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:26.752235 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:26.752119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:27.026662 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:27.026453    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"]
Sep 10 14:37:27.029341 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:37:27.029314    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d74b00_f7ab_48e8_89a6_4801b1ce4146.slice/crio-dddd050a7ca3fb970cabea44695b7a662f8a0de374cfcbb7a34b20a75052245b WatchSource:0}: Error finding container dddd050a7ca3fb970cabea44695b7a662f8a0de374cfcbb7a34b20a75052245b: Status 404 returned error can't find the container with id dddd050a7ca3fb970cabea44695b7a662f8a0de374cfcbb7a34b20a75052245b
Sep 10 14:37:27.986922 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:27.986882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb" event={"ID":"03d74b00-f7ab-48e8-89a6-4801b1ce4146","Type":"ContainerStarted","Data":"c009695ddf798b64c88be2573cf0ad828fdc8ab3a4359627cea46574cbb7fd02"}
Sep 10 14:37:27.987322 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:27.986939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb" event={"ID":"03d74b00-f7ab-48e8-89a6-4801b1ce4146","Type":"ContainerStarted","Data":"dddd050a7ca3fb970cabea44695b7a662f8a0de374cfcbb7a34b20a75052245b"}
Sep 10 14:37:28.005838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:28.005788    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb" podStartSLOduration=1.777085818 podStartE2EDuration="2.005768886s" totalImagesPullingTime="228.683068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:28.003316387 +0000 UTC m=+1058.980445741" watchObservedRunningTime="2026-09-10 14:37:28.005768886 +0000 UTC m=+1058.982898239"
Sep 10 14:37:36.752977 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:36.752936    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:36.753407 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:36.753000    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:36.765641 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:36.765613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:37:37.041095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:37:37.041007    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb"
Sep 10 14:38:53.305320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.305284    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"]
Sep 10 14:38:53.308386 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.308367    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.310804 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.310776    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c892fe\""
Sep 10 14:38:53.310954 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.310892    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c892fe-dockercfg-8m5xs\""
Sep 10 14:38:53.319717 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.319693    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"]
Sep 10 14:38:53.359020 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.358988    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"]
Sep 10 14:38:53.362263 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.362246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.385029 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.384997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"]
Sep 10 14:38:53.410909 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.410870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8908a08a-7cfb-44fb-84ab-88e6005239ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.411095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.410995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/8908a08a-7cfb-44fb-84ab-88e6005239ad-kube-api-access-c2v7v\") pod \"payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.411095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.411034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp9pw\" (UniqueName: \"kubernetes.io/projected/62351422-d817-4a66-9983-79741d138c23-kube-api-access-xp9pw\") pod \"payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.411095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.411076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62351422-d817-4a66-9983-79741d138c23-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.511912 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.511878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/8908a08a-7cfb-44fb-84ab-88e6005239ad-kube-api-access-c2v7v\") pod \"payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.512101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.511925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp9pw\" (UniqueName: \"kubernetes.io/projected/62351422-d817-4a66-9983-79741d138c23-kube-api-access-xp9pw\") pod \"payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.512101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.511970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62351422-d817-4a66-9983-79741d138c23-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.512101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.512043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8908a08a-7cfb-44fb-84ab-88e6005239ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.512795 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.512765    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62351422-d817-4a66-9983-79741d138c23-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.512931 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.512802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8908a08a-7cfb-44fb-84ab-88e6005239ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.521726 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.521695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/8908a08a-7cfb-44fb-84ab-88e6005239ad-kube-api-access-c2v7v\") pod \"payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.522318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.522291    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp9pw\" (UniqueName: \"kubernetes.io/projected/62351422-d817-4a66-9983-79741d138c23-kube-api-access-xp9pw\") pod \"payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.619118 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.619085    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:53.673058 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.672643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:53.896754 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.896729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"]
Sep 10 14:38:53.898886 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:38:53.898837    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8908a08a_7cfb_44fb_84ab_88e6005239ad.slice/crio-39db22cdb80b4fe782f3b1fcb90e88de5e984046683f9bdaf9be25ee9737eb12 WatchSource:0}: Error finding container 39db22cdb80b4fe782f3b1fcb90e88de5e984046683f9bdaf9be25ee9737eb12: Status 404 returned error can't find the container with id 39db22cdb80b4fe782f3b1fcb90e88de5e984046683f9bdaf9be25ee9737eb12
Sep 10 14:38:53.952696 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:53.952672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"]
Sep 10 14:38:53.954499 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:38:53.954469    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62351422_d817_4a66_9983_79741d138c23.slice/crio-94c86a5b62e4369e3e41113506c8f4995c1aa29966c7707e35d9f48fe27b07a2 WatchSource:0}: Error finding container 94c86a5b62e4369e3e41113506c8f4995c1aa29966c7707e35d9f48fe27b07a2: Status 404 returned error can't find the container with id 94c86a5b62e4369e3e41113506c8f4995c1aa29966c7707e35d9f48fe27b07a2
Sep 10 14:38:54.398387 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.398325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd" event={"ID":"62351422-d817-4a66-9983-79741d138c23","Type":"ContainerStarted","Data":"7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d"}
Sep 10 14:38:54.398387 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.398382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd" event={"ID":"62351422-d817-4a66-9983-79741d138c23","Type":"ContainerStarted","Data":"94c86a5b62e4369e3e41113506c8f4995c1aa29966c7707e35d9f48fe27b07a2"}
Sep 10 14:38:54.398970 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.398464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:38:54.400197 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.400174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv" event={"ID":"8908a08a-7cfb-44fb-84ab-88e6005239ad","Type":"ContainerStarted","Data":"f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491"}
Sep 10 14:38:54.400301 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.400211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv" event={"ID":"8908a08a-7cfb-44fb-84ab-88e6005239ad","Type":"ContainerStarted","Data":"39db22cdb80b4fe782f3b1fcb90e88de5e984046683f9bdaf9be25ee9737eb12"}
Sep 10 14:38:54.400301 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.400231    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:38:54.413585 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.413534    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd" podStartSLOduration=1.413520312 podStartE2EDuration="1.413520312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:38:54.412069262 +0000 UTC m=+1145.389198617" watchObservedRunningTime="2026-09-10 14:38:54.413520312 +0000 UTC m=+1145.390649714"
Sep 10 14:38:54.433066 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:54.432990    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv" podStartSLOduration=1.432967116 podStartE2EDuration="1.432967116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:38:54.43057609 +0000 UTC m=+1145.407705456" watchObservedRunningTime="2026-09-10 14:38:54.432967116 +0000 UTC m=+1145.410096472"
Sep 10 14:38:56.041720 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.041683    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"]
Sep 10 14:38:56.045655 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.045634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.047704 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.047682    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e8a6c27c-openshift-default-dockercfg-2l6vx\""
Sep 10 14:38:56.060910 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.060810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"]
Sep 10 14:38:56.140778 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.140738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-envoy\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.140973 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.140791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-socket\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.140973 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.140808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-certs\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.141087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.140976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-token\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.141087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.141005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istiod-ca-cert\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.141087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.141039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2gf\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-kube-api-access-2f2gf\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.141238 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.141136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-credential-socket\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.141238 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.141185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-podinfo\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.141340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.141249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-data\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.241967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-data\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242178 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-envoy\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242178 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-socket\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242178 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-certs\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242178 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-token\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242423 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istiod-ca-cert\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242423 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2gf\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-kube-api-access-2f2gf\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242423 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-credential-socket\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242423 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-podinfo\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.242658 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.242436    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-data\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.243202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.243087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-certs\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.243379 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.243323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-socket\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.243486 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.243381    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istiod-ca-cert\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.243486 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.243400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-credential-socket\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.246822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.245616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-envoy\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.246822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.246508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-podinfo\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.250065 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.250041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-token\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.250430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.250408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2gf\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-kube-api-access-2f2gf\") pod \"e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") " pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.360969 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.360870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:56.638328 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.638300    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"]
Sep 10 14:38:56.640151 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:38:56.640118    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5f5bcd_7710_4a4b_9f46_f58c7361b097.slice/crio-d66b9a8f5ada80db8fcdb567acfd106086b5f3db96abb3492f5f4be4b1145662 WatchSource:0}: Error finding container d66b9a8f5ada80db8fcdb567acfd106086b5f3db96abb3492f5f4be4b1145662: Status 404 returned error can't find the container with id d66b9a8f5ada80db8fcdb567acfd106086b5f3db96abb3492f5f4be4b1145662
Sep 10 14:38:56.642965 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.642929    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:38:56.643051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.642995    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:38:56.643051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:56.643026    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:38:57.419236 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:57.419190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" event={"ID":"1c5f5bcd-7710-4a4b-9f46-f58c7361b097","Type":"ContainerStarted","Data":"c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c"}
Sep 10 14:38:57.419633 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:57.419263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" event={"ID":"1c5f5bcd-7710-4a4b-9f46-f58c7361b097","Type":"ContainerStarted","Data":"d66b9a8f5ada80db8fcdb567acfd106086b5f3db96abb3492f5f4be4b1145662"}
Sep 10 14:38:57.436637 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:57.436573    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podStartSLOduration=1.4365525479999999 podStartE2EDuration="1.436552548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:38:57.436066436 +0000 UTC m=+1148.413195791" watchObservedRunningTime="2026-09-10 14:38:57.436552548 +0000 UTC m=+1148.413681903"
Sep 10 14:38:58.361439 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:58.361400    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:58.366978 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:58.366945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:58.424318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:58.424278    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:38:58.425607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:38:58.425580    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:39:00.366460 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.366424    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"]
Sep 10 14:39:00.370127 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.370107    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.372773 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.372753    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-e7415a-dockercfg-tsg8v\""
Sep 10 14:39:00.373248 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.373231    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-e7415a\""
Sep 10 14:39:00.448559 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.448525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"]
Sep 10 14:39:00.485740 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.485698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-plugins-config-volume\") pod \"payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") " pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.485950 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.485859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfvkj\" (UniqueName: \"kubernetes.io/projected/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-kube-api-access-dfvkj\") pod \"payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") " pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.587545 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.587501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfvkj\" (UniqueName: \"kubernetes.io/projected/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-kube-api-access-dfvkj\") pod \"payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") " pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.587774 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.587627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-plugins-config-volume\") pod \"payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") " pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.588410 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.588387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-plugins-config-volume\") pod \"payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") " pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.595833 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.595805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfvkj\" (UniqueName: \"kubernetes.io/projected/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-kube-api-access-dfvkj\") pod \"payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") " pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.681483 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.681378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:00.973686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:00.973654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"]
Sep 10 14:39:00.978013 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:39:00.977970    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee6b423_92e0_46bf_ad60_aa4ff79d39fb.slice/crio-279779cbadf2533762ed6cc8842dae249b961aacf0795b03e6de8b92186d9dbb WatchSource:0}: Error finding container 279779cbadf2533762ed6cc8842dae249b961aacf0795b03e6de8b92186d9dbb: Status 404 returned error can't find the container with id 279779cbadf2533762ed6cc8842dae249b961aacf0795b03e6de8b92186d9dbb
Sep 10 14:39:01.443781 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.443736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv" event={"ID":"cee6b423-92e0-46bf-ad60-aa4ff79d39fb","Type":"ContainerStarted","Data":"fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6"}
Sep 10 14:39:01.444196 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.443805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv" event={"ID":"cee6b423-92e0-46bf-ad60-aa4ff79d39fb","Type":"ContainerStarted","Data":"279779cbadf2533762ed6cc8842dae249b961aacf0795b03e6de8b92186d9dbb"}
Sep 10 14:39:01.444196 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.443880    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:01.477624 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.477552    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv" podStartSLOduration=1.477529554 podStartE2EDuration="1.477529554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:01.474123517 +0000 UTC m=+1152.451252885" watchObservedRunningTime="2026-09-10 14:39:01.477529554 +0000 UTC m=+1152.454658909"
Sep 10 14:39:01.710624 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.710212    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"]
Sep 10 14:39:01.714396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.714363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:01.717281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.717046    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e8a6c27c\""
Sep 10 14:39:01.717281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.717140    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e8a6c27c-dockercfg-99tqp\""
Sep 10 14:39:01.717512 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.717489    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"]
Sep 10 14:39:01.742880 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.740420    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"]
Sep 10 14:39:01.742880 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.740463    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"]
Sep 10 14:39:01.742880 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.740578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:01.799968 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.799927    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63de4403-fdef-4497-9fb6-c4cb55e2b296-plugins-config-volume\") pod \"payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") " pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:01.800141 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.800081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlrrf\" (UniqueName: \"kubernetes.io/projected/63de4403-fdef-4497-9fb6-c4cb55e2b296-kube-api-access-nlrrf\") pod \"payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") " pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:01.901191 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.901147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqhp4\" (UniqueName: \"kubernetes.io/projected/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-kube-api-access-hqhp4\") pod \"payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:01.901191 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.901192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63de4403-fdef-4497-9fb6-c4cb55e2b296-plugins-config-volume\") pod \"payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") " pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:01.901451 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.901356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlrrf\" (UniqueName: \"kubernetes.io/projected/63de4403-fdef-4497-9fb6-c4cb55e2b296-kube-api-access-nlrrf\") pod \"payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") " pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:01.901509 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.901445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:01.901889 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.901870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63de4403-fdef-4497-9fb6-c4cb55e2b296-plugins-config-volume\") pod \"payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") " pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:01.910420 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:01.910394    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlrrf\" (UniqueName: \"kubernetes.io/projected/63de4403-fdef-4497-9fb6-c4cb55e2b296-kube-api-access-nlrrf\") pod \"payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") " pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:02.002355 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.002257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:02.002355 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.002318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqhp4\" (UniqueName: \"kubernetes.io/projected/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-kube-api-access-hqhp4\") pod \"payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:02.002970 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.002950    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:02.010246 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.010221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqhp4\" (UniqueName: \"kubernetes.io/projected/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-kube-api-access-hqhp4\") pod \"payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:02.046196 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.046155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:02.063430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.063402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:02.323730 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.323705    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"]
Sep 10 14:39:02.326256 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:39:02.326223    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63de4403_fdef_4497_9fb6_c4cb55e2b296.slice/crio-301b5d5202584fabccee3a2cbfc8ad8d25d1ad226fc39e6ee23b605caf0df3d3 WatchSource:0}: Error finding container 301b5d5202584fabccee3a2cbfc8ad8d25d1ad226fc39e6ee23b605caf0df3d3: Status 404 returned error can't find the container with id 301b5d5202584fabccee3a2cbfc8ad8d25d1ad226fc39e6ee23b605caf0df3d3
Sep 10 14:39:02.344698 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.344623    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"]
Sep 10 14:39:02.347401 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:39:02.347372    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec0e8c8_cb46_454f_8841_fc2f12b6beef.slice/crio-b67bde1822d4223de74f860c3c2e713db3339360bd59a486cca36b0632fc73a7 WatchSource:0}: Error finding container b67bde1822d4223de74f860c3c2e713db3339360bd59a486cca36b0632fc73a7: Status 404 returned error can't find the container with id b67bde1822d4223de74f860c3c2e713db3339360bd59a486cca36b0632fc73a7
Sep 10 14:39:02.454469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.454415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf" event={"ID":"63de4403-fdef-4497-9fb6-c4cb55e2b296","Type":"ContainerStarted","Data":"8974f4e04bb110a55083fc1ed4e61b58549acd5237fcd968a31401e8c1529dcf"}
Sep 10 14:39:02.454960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.454486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf" event={"ID":"63de4403-fdef-4497-9fb6-c4cb55e2b296","Type":"ContainerStarted","Data":"301b5d5202584fabccee3a2cbfc8ad8d25d1ad226fc39e6ee23b605caf0df3d3"}
Sep 10 14:39:02.454960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.454617    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:02.456079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.456050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2" event={"ID":"3ec0e8c8-cb46-454f-8841-fc2f12b6beef","Type":"ContainerStarted","Data":"224c05f8374b86b12c00c6e43deeab31603ee5afde0ae72b54265b13ff02d743"}
Sep 10 14:39:02.456201 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.456098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2" event={"ID":"3ec0e8c8-cb46-454f-8841-fc2f12b6beef","Type":"ContainerStarted","Data":"b67bde1822d4223de74f860c3c2e713db3339360bd59a486cca36b0632fc73a7"}
Sep 10 14:39:02.456281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.456262    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:02.474370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.474319    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf" podStartSLOduration=1.474301633 podStartE2EDuration="1.474301633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:02.473108752 +0000 UTC m=+1153.450238133" watchObservedRunningTime="2026-09-10 14:39:02.474301633 +0000 UTC m=+1153.451430987"
Sep 10 14:39:02.489304 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:02.489243    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2" podStartSLOduration=1.48922634 podStartE2EDuration="1.48922634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:02.487822656 +0000 UTC m=+1153.464952006" watchObservedRunningTime="2026-09-10 14:39:02.48922634 +0000 UTC m=+1153.466355693"
Sep 10 14:39:05.406868 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:05.406814    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:39:05.407259 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:05.406944    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:39:12.458645 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:12.458557    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:39:13.463160 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:13.463129    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:13.463569 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:13.463384    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:14.466092 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:14.466043    2577 patch_prober.go:28] interesting pod/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:39:14.466589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:14.466123    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:39:16.552122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:16.552017    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerID="c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c" exitCode=0
Sep 10 14:39:16.552122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:16.552093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" event={"ID":"1c5f5bcd-7710-4a4b-9f46-f58c7361b097","Type":"ContainerDied","Data":"c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c"}
Sep 10 14:39:16.552572 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:16.552491    2577 scope.go:117] "RemoveContainer" containerID="c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c"
Sep 10 14:39:16.553552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:16.553524    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:39:16.553607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:16.553590    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:39:16.553642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:16.553622    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:39:17.559333 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:17.559296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" event={"ID":"1c5f5bcd-7710-4a4b-9f46-f58c7361b097","Type":"ContainerStarted","Data":"a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a"}
Sep 10 14:39:18.361311 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:18.361271    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:39:18.361529 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:18.361483    2577 patch_prober.go:28] interesting pod/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:39:18.361594 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:18.361529    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 10 14:39:19.362252 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:19.362213    2577 patch_prober.go:28] interesting pod/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:39:19.362675 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:19.362282    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 10 14:39:20.362227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:20.362192    2577 patch_prober.go:28] interesting pod/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:39:20.362443 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:20.362266    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 10 14:39:21.361917 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:21.361872    2577 patch_prober.go:28] interesting pod/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:39:21.362101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:21.361951    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 10 14:39:22.361663 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.361623    2577 patch_prober.go:28] interesting pod/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 10 14:39:22.362101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.361683    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 10 14:39:22.833163 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.833127    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"]
Sep 10 14:39:22.836608 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.836583    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:22.838481 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.838454    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2365fe\""
Sep 10 14:39:22.838654 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.838635    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-2365fe-dockercfg-brl6s\""
Sep 10 14:39:22.848082 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.848050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"]
Sep 10 14:39:22.949756 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.949724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd5992b-c663-4724-8fcf-a1728d6c0090-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:22.949968 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:22.949940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7tfz\" (UniqueName: \"kubernetes.io/projected/7cd5992b-c663-4724-8fcf-a1728d6c0090-kube-api-access-w7tfz\") pod \"payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:23.051171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.051130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7tfz\" (UniqueName: \"kubernetes.io/projected/7cd5992b-c663-4724-8fcf-a1728d6c0090-kube-api-access-w7tfz\") pod \"payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:23.051396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.051216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd5992b-c663-4724-8fcf-a1728d6c0090-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:23.052049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.052024    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd5992b-c663-4724-8fcf-a1728d6c0090-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:23.058961 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.058934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7tfz\" (UniqueName: \"kubernetes.io/projected/7cd5992b-c663-4724-8fcf-a1728d6c0090-kube-api-access-w7tfz\") pod \"payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:23.150017 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.149967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:23.365155 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.365124    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:39:23.365686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.365543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:39:23.366210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.366191    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:39:23.426947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.426917    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"]
Sep 10 14:39:23.429446 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:39:23.429417    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd5992b_c663_4724_8fcf_a1728d6c0090.slice/crio-eb4ce4c88bf64f251346b2a4d1a2851bf4478dfff1dc3bfcbb1b3b4d00705646 WatchSource:0}: Error finding container eb4ce4c88bf64f251346b2a4d1a2851bf4478dfff1dc3bfcbb1b3b4d00705646: Status 404 returned error can't find the container with id eb4ce4c88bf64f251346b2a4d1a2851bf4478dfff1dc3bfcbb1b3b4d00705646
Sep 10 14:39:23.609627 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.609591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r" event={"ID":"7cd5992b-c663-4724-8fcf-a1728d6c0090","Type":"ContainerStarted","Data":"a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe"}
Sep 10 14:39:23.609822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.609653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r" event={"ID":"7cd5992b-c663-4724-8fcf-a1728d6c0090","Type":"ContainerStarted","Data":"eb4ce4c88bf64f251346b2a4d1a2851bf4478dfff1dc3bfcbb1b3b4d00705646"}
Sep 10 14:39:23.624918 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:23.624837    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r" podStartSLOduration=1.624821309 podStartE2EDuration="1.624821309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:23.623376915 +0000 UTC m=+1174.600506267" watchObservedRunningTime="2026-09-10 14:39:23.624821309 +0000 UTC m=+1174.601950688"
Sep 10 14:39:24.616207 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:24.616175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:35.624366 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:35.624335    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:39:40.447931 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.447893    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"]
Sep 10 14:39:40.448396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.448188    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf" podUID="63de4403-fdef-4497-9fb6-c4cb55e2b296" containerName="payload-processing" containerID="cri-o://8974f4e04bb110a55083fc1ed4e61b58549acd5237fcd968a31401e8c1529dcf" gracePeriod=30
Sep 10 14:39:40.460317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.460283    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"]
Sep 10 14:39:40.461158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.460543    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2" podUID="3ec0e8c8-cb46-454f-8841-fc2f12b6beef" containerName="payload-pre-processing" containerID="cri-o://224c05f8374b86b12c00c6e43deeab31603ee5afde0ae72b54265b13ff02d743" gracePeriod=30
Sep 10 14:39:40.717345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.717316    2577 generic.go:356] "Generic (PLEG): container finished" podID="63de4403-fdef-4497-9fb6-c4cb55e2b296" containerID="8974f4e04bb110a55083fc1ed4e61b58549acd5237fcd968a31401e8c1529dcf" exitCode=0
Sep 10 14:39:40.717498 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.717391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf" event={"ID":"63de4403-fdef-4497-9fb6-c4cb55e2b296","Type":"ContainerDied","Data":"8974f4e04bb110a55083fc1ed4e61b58549acd5237fcd968a31401e8c1529dcf"}
Sep 10 14:39:40.719306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.719274    2577 generic.go:356] "Generic (PLEG): container finished" podID="3ec0e8c8-cb46-454f-8841-fc2f12b6beef" containerID="224c05f8374b86b12c00c6e43deeab31603ee5afde0ae72b54265b13ff02d743" exitCode=0
Sep 10 14:39:40.719427 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.719310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2" event={"ID":"3ec0e8c8-cb46-454f-8841-fc2f12b6beef","Type":"ContainerDied","Data":"224c05f8374b86b12c00c6e43deeab31603ee5afde0ae72b54265b13ff02d743"}
Sep 10 14:39:40.744799 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.744763    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:40.748039 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.748016    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:40.755251 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.755224    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"]
Sep 10 14:39:40.755462 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.755442    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy" containerID="cri-o://a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a" gracePeriod=30
Sep 10 14:39:40.933200 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.933166    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqhp4\" (UniqueName: \"kubernetes.io/projected/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-kube-api-access-hqhp4\") pod \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") "
Sep 10 14:39:40.933404 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.933223    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-plugins-config-volume\") pod \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\" (UID: \"3ec0e8c8-cb46-454f-8841-fc2f12b6beef\") "
Sep 10 14:39:40.933404 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.933321    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63de4403-fdef-4497-9fb6-c4cb55e2b296-plugins-config-volume\") pod \"63de4403-fdef-4497-9fb6-c4cb55e2b296\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") "
Sep 10 14:39:40.933404 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.933349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlrrf\" (UniqueName: \"kubernetes.io/projected/63de4403-fdef-4497-9fb6-c4cb55e2b296-kube-api-access-nlrrf\") pod \"63de4403-fdef-4497-9fb6-c4cb55e2b296\" (UID: \"63de4403-fdef-4497-9fb6-c4cb55e2b296\") "
Sep 10 14:39:40.933629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.933589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ec0e8c8-cb46-454f-8841-fc2f12b6beef" (UID: "3ec0e8c8-cb46-454f-8841-fc2f12b6beef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:39:40.933727 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.933702    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63de4403-fdef-4497-9fb6-c4cb55e2b296-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63de4403-fdef-4497-9fb6-c4cb55e2b296" (UID: "63de4403-fdef-4497-9fb6-c4cb55e2b296"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:39:40.935516 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.935490    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63de4403-fdef-4497-9fb6-c4cb55e2b296-kube-api-access-nlrrf" (OuterVolumeSpecName: "kube-api-access-nlrrf") pod "63de4403-fdef-4497-9fb6-c4cb55e2b296" (UID: "63de4403-fdef-4497-9fb6-c4cb55e2b296"). InnerVolumeSpecName "kube-api-access-nlrrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:39:40.935587 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:40.935498    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-kube-api-access-hqhp4" (OuterVolumeSpecName: "kube-api-access-hqhp4") pod "3ec0e8c8-cb46-454f-8841-fc2f12b6beef" (UID: "3ec0e8c8-cb46-454f-8841-fc2f12b6beef"). InnerVolumeSpecName "kube-api-access-hqhp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:39:41.035244 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.035139    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63de4403-fdef-4497-9fb6-c4cb55e2b296-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:41.035244 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.035182    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlrrf\" (UniqueName: \"kubernetes.io/projected/63de4403-fdef-4497-9fb6-c4cb55e2b296-kube-api-access-nlrrf\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:41.035244 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.035192    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqhp4\" (UniqueName: \"kubernetes.io/projected/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-kube-api-access-hqhp4\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:41.035244 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.035201    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ec0e8c8-cb46-454f-8841-fc2f12b6beef-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:41.725872 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.725773    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"
Sep 10 14:39:41.725872 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.725782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf" event={"ID":"63de4403-fdef-4497-9fb6-c4cb55e2b296","Type":"ContainerDied","Data":"301b5d5202584fabccee3a2cbfc8ad8d25d1ad226fc39e6ee23b605caf0df3d3"}
Sep 10 14:39:41.726394 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.725877    2577 scope.go:117] "RemoveContainer" containerID="8974f4e04bb110a55083fc1ed4e61b58549acd5237fcd968a31401e8c1529dcf"
Sep 10 14:39:41.727432 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.727411    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"
Sep 10 14:39:41.727525 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.727470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2" event={"ID":"3ec0e8c8-cb46-454f-8841-fc2f12b6beef","Type":"ContainerDied","Data":"b67bde1822d4223de74f860c3c2e713db3339360bd59a486cca36b0632fc73a7"}
Sep 10 14:39:41.738480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.738461    2577 scope.go:117] "RemoveContainer" containerID="224c05f8374b86b12c00c6e43deeab31603ee5afde0ae72b54265b13ff02d743"
Sep 10 14:39:41.757874 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.757799    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"]
Sep 10 14:39:41.763660 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.763634    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2"]
Sep 10 14:39:41.777043 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.777007    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"]
Sep 10 14:39:41.782749 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:41.782714    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf"]
Sep 10 14:39:43.511503 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:43.511466    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ec0e8c8-cb46-454f-8841-fc2f12b6beef" path="/var/lib/kubelet/pods/3ec0e8c8-cb46-454f-8841-fc2f12b6beef/volumes"
Sep 10 14:39:43.512041 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:43.512023    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63de4403-fdef-4497-9fb6-c4cb55e2b296" path="/var/lib/kubelet/pods/63de4403-fdef-4497-9fb6-c4cb55e2b296/volumes"
Sep 10 14:39:45.287872 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.287826    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"]
Sep 10 14:39:45.288263 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.288221    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63de4403-fdef-4497-9fb6-c4cb55e2b296" containerName="payload-processing"
Sep 10 14:39:45.288263 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.288234    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="63de4403-fdef-4497-9fb6-c4cb55e2b296" containerName="payload-processing"
Sep 10 14:39:45.288263 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.288253    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec0e8c8-cb46-454f-8841-fc2f12b6beef" containerName="payload-pre-processing"
Sep 10 14:39:45.288263 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.288258    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec0e8c8-cb46-454f-8841-fc2f12b6beef" containerName="payload-pre-processing"
Sep 10 14:39:45.288397 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.288323    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec0e8c8-cb46-454f-8841-fc2f12b6beef" containerName="payload-pre-processing"
Sep 10 14:39:45.288397 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.288334    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="63de4403-fdef-4497-9fb6-c4cb55e2b296" containerName="payload-processing"
Sep 10 14:39:45.293034 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.293017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.294961 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.294934    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-7e4309cc-dockercfg-spzjh\""
Sep 10 14:39:45.295115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.294946    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-7e4309cc\""
Sep 10 14:39:45.302976 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.302947    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"]
Sep 10 14:39:45.322929 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.322899    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"]
Sep 10 14:39:45.326452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.326435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.340222 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.340189    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"]
Sep 10 14:39:45.383326 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.383281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.383326 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.383324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42fvd\" (UniqueName: \"kubernetes.io/projected/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-kube-api-access-42fvd\") pod \"payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.383554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.383389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.383554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.383495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbdbj\" (UniqueName: \"kubernetes.io/projected/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-kube-api-access-rbdbj\") pod \"payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.484036 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.483999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.484036 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.484039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42fvd\" (UniqueName: \"kubernetes.io/projected/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-kube-api-access-42fvd\") pod \"payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.484254 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.484078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.484254 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.484166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbdbj\" (UniqueName: \"kubernetes.io/projected/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-kube-api-access-rbdbj\") pod \"payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.484811 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.484789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.484867 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.484815    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.492123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.492092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbdbj\" (UniqueName: \"kubernetes.io/projected/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-kube-api-access-rbdbj\") pod \"payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") " pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.492314 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.492295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42fvd\" (UniqueName: \"kubernetes.io/projected/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-kube-api-access-42fvd\") pod \"payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.606372 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.606277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:45.638002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.637969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:45.889834 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.889810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"]
Sep 10 14:39:45.892537 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:39:45.892510    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0d5215_46ab_4ca0_a3b8_90d644eda18e.slice/crio-945d422ef92a6b9b77c8861ed3d254d0301a4cd5e15b388e17dffb53ef19061b WatchSource:0}: Error finding container 945d422ef92a6b9b77c8861ed3d254d0301a4cd5e15b388e17dffb53ef19061b: Status 404 returned error can't find the container with id 945d422ef92a6b9b77c8861ed3d254d0301a4cd5e15b388e17dffb53ef19061b
Sep 10 14:39:45.922037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:45.921948    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"]
Sep 10 14:39:45.924731 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:39:45.924706    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9295bf0_f4b1_4ec9_81a1_cce38738b5a2.slice/crio-b1bb68424d4e27083be7c9fcb63377ba815e7983f48511ca061795a48c3bc50e WatchSource:0}: Error finding container b1bb68424d4e27083be7c9fcb63377ba815e7983f48511ca061795a48c3bc50e: Status 404 returned error can't find the container with id b1bb68424d4e27083be7c9fcb63377ba815e7983f48511ca061795a48c3bc50e
Sep 10 14:39:46.009992 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.009964    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:39:46.090453 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090411    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-credential-socket\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.090664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090468    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-token\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.090664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090493    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-envoy\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.090664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090523    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-socket\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.090664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090552    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f2gf\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-kube-api-access-2f2gf\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.090664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090587    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-certs\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.090664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090615    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-podinfo\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.090664 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090639    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istiod-ca-cert\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.091049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090707    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-data\") pod \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\" (UID: \"1c5f5bcd-7710-4a4b-9f46-f58c7361b097\") "
Sep 10 14:39:46.091049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090730    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:39:46.091049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.090897    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:39:46.091049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.091002    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:39:46.091277 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.091185    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.091277 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.091203    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.091277 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.091220    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.091277 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.091201    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:39:46.091489 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.091348    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:39:46.093175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.093146    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:39:46.093283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.093195    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:39:46.093283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.093209    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:39:46.093400 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.093358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-kube-api-access-2f2gf" (OuterVolumeSpecName: "kube-api-access-2f2gf") pod "1c5f5bcd-7710-4a4b-9f46-f58c7361b097" (UID: "1c5f5bcd-7710-4a4b-9f46-f58c7361b097"). InnerVolumeSpecName "kube-api-access-2f2gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:39:46.192180 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.192078    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.192180 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.192119    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.192180 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.192130    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.192180 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.192142    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.192180 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.192154    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.192180 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.192166    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f2gf\" (UniqueName: \"kubernetes.io/projected/1c5f5bcd-7710-4a4b-9f46-f58c7361b097-kube-api-access-2f2gf\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:39:46.762403 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.762300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv" event={"ID":"cc0d5215-46ab-4ca0-a3b8-90d644eda18e","Type":"ContainerStarted","Data":"5336c571a6f208046c17875744ef2d4d0e6dc98b7b1b6a9cbcbe3dac2756e1fd"}
Sep 10 14:39:46.763222 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.762934    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:39:46.763222 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.762972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv" event={"ID":"cc0d5215-46ab-4ca0-a3b8-90d644eda18e","Type":"ContainerStarted","Data":"945d422ef92a6b9b77c8861ed3d254d0301a4cd5e15b388e17dffb53ef19061b"}
Sep 10 14:39:46.764691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.764664    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7" event={"ID":"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2","Type":"ContainerStarted","Data":"7753c0533911a8743d619e1b6754d4f1aaf4cfee84b1e600003db07c40c75201"}
Sep 10 14:39:46.764816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.764739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7" event={"ID":"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2","Type":"ContainerStarted","Data":"b1bb68424d4e27083be7c9fcb63377ba815e7983f48511ca061795a48c3bc50e"}
Sep 10 14:39:46.764816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.764781    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:46.766862 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.766820    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerID="a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a" exitCode=0
Sep 10 14:39:46.766979 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.766903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" event={"ID":"1c5f5bcd-7710-4a4b-9f46-f58c7361b097","Type":"ContainerDied","Data":"a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a"}
Sep 10 14:39:46.766979 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.766947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5" event={"ID":"1c5f5bcd-7710-4a4b-9f46-f58c7361b097","Type":"ContainerDied","Data":"d66b9a8f5ada80db8fcdb567acfd106086b5f3db96abb3492f5f4be4b1145662"}
Sep 10 14:39:46.766979 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.766976    2577 scope.go:117] "RemoveContainer" containerID="a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a"
Sep 10 14:39:46.767209 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.766906    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"
Sep 10 14:39:46.783546 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.779810    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv" podStartSLOduration=1.779789036 podStartE2EDuration="1.779789036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:46.77974704 +0000 UTC m=+1197.756876402" watchObservedRunningTime="2026-09-10 14:39:46.779789036 +0000 UTC m=+1197.756918391"
Sep 10 14:39:46.785078 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.784792    2577 scope.go:117] "RemoveContainer" containerID="c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c"
Sep 10 14:39:46.796667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.796642    2577 scope.go:117] "RemoveContainer" containerID="a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a"
Sep 10 14:39:46.797302 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:39:46.797130    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a\": container with ID starting with a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a not found: ID does not exist" containerID="a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a"
Sep 10 14:39:46.797302 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.797172    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a"} err="failed to get container status \"a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a\": rpc error: code = NotFound desc = could not find container \"a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a\": container with ID starting with a717d3b8d636cea7e118d63376fb265e1a593500bbbc6946016474830233ba6a not found: ID does not exist"
Sep 10 14:39:46.797302 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.797200    2577 scope.go:117] "RemoveContainer" containerID="c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c"
Sep 10 14:39:46.797559 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:39:46.797531    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c\": container with ID starting with c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c not found: ID does not exist" containerID="c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c"
Sep 10 14:39:46.797640 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.797567    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c"} err="failed to get container status \"c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c\": rpc error: code = NotFound desc = could not find container \"c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c\": container with ID starting with c6e1824caaf800d916658abdcbd711bb74c3082afea44896a03c76d30ef0ca6c not found: ID does not exist"
Sep 10 14:39:46.813187 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.813123    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7" podStartSLOduration=1.8131017040000001 podStartE2EDuration="1.813101704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:46.81191823 +0000 UTC m=+1197.789047580" watchObservedRunningTime="2026-09-10 14:39:46.813101704 +0000 UTC m=+1197.790231059"
Sep 10 14:39:46.834892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.834838    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"]
Sep 10 14:39:46.851780 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:46.851743    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5"]
Sep 10 14:39:47.515864 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:47.515470    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" path="/var/lib/kubelet/pods/1c5f5bcd-7710-4a4b-9f46-f58c7361b097/volumes"
Sep 10 14:39:49.464650 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:49.464618    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:39:49.466545 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:49.466525    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:39:57.776565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:57.776531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:39:57.777143 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:39:57.776617    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:40:09.208384 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.208342    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"]
Sep 10 14:40:09.209016 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.208995    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy"
Sep 10 14:40:09.209016 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.209017    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy"
Sep 10 14:40:09.209172 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.209033    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy"
Sep 10 14:40:09.209172 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.209040    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy"
Sep 10 14:40:09.209172 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.209139    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy"
Sep 10 14:40:09.209172 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.209151    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5f5bcd-7710-4a4b-9f46-f58c7361b097" containerName="istio-proxy"
Sep 10 14:40:09.213754 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.213731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"
Sep 10 14:40:09.217557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.217532    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:40:09.217706 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.217636    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:40:09.236326 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.236288    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"]
Sep 10 14:40:09.329577 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.329540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d7df2d-b500-4ac0-b0ce-ac747f65ea83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf\" (UID: \"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"
Sep 10 14:40:09.430711 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.430641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d7df2d-b500-4ac0-b0ce-ac747f65ea83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf\" (UID: \"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"
Sep 10 14:40:09.431388 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.431361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d7df2d-b500-4ac0-b0ce-ac747f65ea83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf\" (UID: \"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"
Sep 10 14:40:09.524955 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.524836    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"
Sep 10 14:40:09.796981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.796919    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"]
Sep 10 14:40:09.799441 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:40:09.799411    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d7df2d_b500_4ac0_b0ce_ac747f65ea83.slice/crio-cf3a97a07540a251787dcbaed85fb20d699c5af35a78d9bef8e403a603407ece WatchSource:0}: Error finding container cf3a97a07540a251787dcbaed85fb20d699c5af35a78d9bef8e403a603407ece: Status 404 returned error can't find the container with id cf3a97a07540a251787dcbaed85fb20d699c5af35a78d9bef8e403a603407ece
Sep 10 14:40:09.901256 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:09.901220    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf" event={"ID":"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83","Type":"ContainerStarted","Data":"cf3a97a07540a251787dcbaed85fb20d699c5af35a78d9bef8e403a603407ece"}
Sep 10 14:40:12.921049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:12.921012    2577 generic.go:356] "Generic (PLEG): container finished" podID="f9d7df2d-b500-4ac0-b0ce-ac747f65ea83" containerID="e4d89b512eafa80a2a27dcee3cf44210d1c2d74d4720060287ee3e2ed3d8893d" exitCode=0
Sep 10 14:40:12.921491 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:12.921084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf" event={"ID":"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83","Type":"ContainerDied","Data":"e4d89b512eafa80a2a27dcee3cf44210d1c2d74d4720060287ee3e2ed3d8893d"}
Sep 10 14:40:14.060599 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:14.060573    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"
Sep 10 14:40:14.082165 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:14.082133    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d7df2d-b500-4ac0-b0ce-ac747f65ea83-maas-api-service-ca\") pod \"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83\" (UID: \"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83\") "
Sep 10 14:40:14.082493 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:14.082469    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9d7df2d-b500-4ac0-b0ce-ac747f65ea83-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9d7df2d-b500-4ac0-b0ce-ac747f65ea83" (UID: "f9d7df2d-b500-4ac0-b0ce-ac747f65ea83"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:14.183616 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:14.183519    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d7df2d-b500-4ac0-b0ce-ac747f65ea83-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:14.932661 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:14.932628    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"
Sep 10 14:40:14.932867 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:14.932663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf" event={"ID":"f9d7df2d-b500-4ac0-b0ce-ac747f65ea83","Type":"ContainerDied","Data":"cf3a97a07540a251787dcbaed85fb20d699c5af35a78d9bef8e403a603407ece"}
Sep 10 14:40:14.932867 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:14.932711    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf3a97a07540a251787dcbaed85fb20d699c5af35a78d9bef8e403a603407ece"
Sep 10 14:40:15.797810 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.797780    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"]
Sep 10 14:40:15.798258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.798022    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7" podUID="c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" containerName="payload-processing" containerID="cri-o://7753c0533911a8743d619e1b6754d4f1aaf4cfee84b1e600003db07c40c75201" gracePeriod=30
Sep 10 14:40:15.807426 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.807377    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"]
Sep 10 14:40:15.807652 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.807615    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv" podUID="cc0d5215-46ab-4ca0-a3b8-90d644eda18e" containerName="payload-pre-processing" containerID="cri-o://5336c571a6f208046c17875744ef2d4d0e6dc98b7b1b6a9cbcbe3dac2756e1fd" gracePeriod=30
Sep 10 14:40:15.940485 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.940125    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc0d5215-46ab-4ca0-a3b8-90d644eda18e" containerID="5336c571a6f208046c17875744ef2d4d0e6dc98b7b1b6a9cbcbe3dac2756e1fd" exitCode=0
Sep 10 14:40:15.940485 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.940345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv" event={"ID":"cc0d5215-46ab-4ca0-a3b8-90d644eda18e","Type":"ContainerDied","Data":"5336c571a6f208046c17875744ef2d4d0e6dc98b7b1b6a9cbcbe3dac2756e1fd"}
Sep 10 14:40:15.942727 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.942696    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" containerID="7753c0533911a8743d619e1b6754d4f1aaf4cfee84b1e600003db07c40c75201" exitCode=0
Sep 10 14:40:15.942885 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.942769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7" event={"ID":"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2","Type":"ContainerDied","Data":"7753c0533911a8743d619e1b6754d4f1aaf4cfee84b1e600003db07c40c75201"}
Sep 10 14:40:15.973397 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.973321    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"]
Sep 10 14:40:15.976667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:15.976624    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7e4309cc-f9hjf"]
Sep 10 14:40:16.094627 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.094595    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:40:16.098282 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.098257    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:40:16.099818 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.099797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbdbj\" (UniqueName: \"kubernetes.io/projected/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-kube-api-access-rbdbj\") pod \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") "
Sep 10 14:40:16.100049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.099977    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-plugins-config-volume\") pod \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\" (UID: \"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2\") "
Sep 10 14:40:16.100609 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.100543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" (UID: "c9295bf0-f4b1-4ec9-81a1-cce38738b5a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:16.102584 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.102562    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-kube-api-access-rbdbj" (OuterVolumeSpecName: "kube-api-access-rbdbj") pod "c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" (UID: "c9295bf0-f4b1-4ec9-81a1-cce38738b5a2"). InnerVolumeSpecName "kube-api-access-rbdbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:16.201870 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.201799    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-plugins-config-volume\") pod \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") "
Sep 10 14:40:16.202068 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.201945    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42fvd\" (UniqueName: \"kubernetes.io/projected/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-kube-api-access-42fvd\") pod \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\" (UID: \"cc0d5215-46ab-4ca0-a3b8-90d644eda18e\") "
Sep 10 14:40:16.202248 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.202223    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc0d5215-46ab-4ca0-a3b8-90d644eda18e" (UID: "cc0d5215-46ab-4ca0-a3b8-90d644eda18e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:16.202309 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.202244    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:16.202309 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.202265    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbdbj\" (UniqueName: \"kubernetes.io/projected/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2-kube-api-access-rbdbj\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:16.204203 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.204178    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-kube-api-access-42fvd" (OuterVolumeSpecName: "kube-api-access-42fvd") pod "cc0d5215-46ab-4ca0-a3b8-90d644eda18e" (UID: "cc0d5215-46ab-4ca0-a3b8-90d644eda18e"). InnerVolumeSpecName "kube-api-access-42fvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:16.303603 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.303567    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:16.303603 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.303596    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42fvd\" (UniqueName: \"kubernetes.io/projected/cc0d5215-46ab-4ca0-a3b8-90d644eda18e-kube-api-access-42fvd\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:16.828150 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828114    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"]
Sep 10 14:40:16.828690 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828669    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" containerName="payload-processing"
Sep 10 14:40:16.828753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828692    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" containerName="payload-processing"
Sep 10 14:40:16.828753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828723    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0d5215-46ab-4ca0-a3b8-90d644eda18e" containerName="payload-pre-processing"
Sep 10 14:40:16.828753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828731    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0d5215-46ab-4ca0-a3b8-90d644eda18e" containerName="payload-pre-processing"
Sep 10 14:40:16.828753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828739    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d7df2d-b500-4ac0-b0ce-ac747f65ea83" containerName="revoke-keys"
Sep 10 14:40:16.828753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828745    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d7df2d-b500-4ac0-b0ce-ac747f65ea83" containerName="revoke-keys"
Sep 10 14:40:16.829028 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828835    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" containerName="payload-processing"
Sep 10 14:40:16.829028 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828875    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d7df2d-b500-4ac0-b0ce-ac747f65ea83" containerName="revoke-keys"
Sep 10 14:40:16.829028 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.828888    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0d5215-46ab-4ca0-a3b8-90d644eda18e" containerName="payload-pre-processing"
Sep 10 14:40:16.832327 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.832301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.834503 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.834482    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-04dfc68a-openshift-default-dockercfg-dq8wj\""
Sep 10 14:40:16.844780 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.844739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"]
Sep 10 14:40:16.909999 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.909967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-credential-socket\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-data\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-socket\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-envoy\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-istio-token\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-certs\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27hzd\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-kube-api-access-27hzd\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910419 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc001feb-6991-4d19-9701-1d9d328801a8-istiod-ca-cert\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.910419 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.910202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc001feb-6991-4d19-9701-1d9d328801a8-istio-podinfo\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:16.952887 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.952534    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"
Sep 10 14:40:16.952887 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.952610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv" event={"ID":"cc0d5215-46ab-4ca0-a3b8-90d644eda18e","Type":"ContainerDied","Data":"945d422ef92a6b9b77c8861ed3d254d0301a4cd5e15b388e17dffb53ef19061b"}
Sep 10 14:40:16.952887 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.952678    2577 scope.go:117] "RemoveContainer" containerID="5336c571a6f208046c17875744ef2d4d0e6dc98b7b1b6a9cbcbe3dac2756e1fd"
Sep 10 14:40:16.955554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.955460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7" event={"ID":"c9295bf0-f4b1-4ec9-81a1-cce38738b5a2","Type":"ContainerDied","Data":"b1bb68424d4e27083be7c9fcb63377ba815e7983f48511ca061795a48c3bc50e"}
Sep 10 14:40:16.955710 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.955620    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"
Sep 10 14:40:16.963585 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.963553    2577 scope.go:117] "RemoveContainer" containerID="7753c0533911a8743d619e1b6754d4f1aaf4cfee84b1e600003db07c40c75201"
Sep 10 14:40:16.976769 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.976740    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"]
Sep 10 14:40:16.980490 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.980463    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv"]
Sep 10 14:40:16.992069 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.992037    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"]
Sep 10 14:40:16.995148 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:16.995122    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7"]
Sep 10 14:40:17.011523 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-socket\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.011523 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-envoy\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.011760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-istio-token\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.011760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-certs\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.011760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27hzd\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-kube-api-access-27hzd\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.011760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc001feb-6991-4d19-9701-1d9d328801a8-istiod-ca-cert\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc001feb-6991-4d19-9701-1d9d328801a8-istio-podinfo\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011946    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-socket\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.011963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-credential-socket\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.012003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-certs\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.012022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-data\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012273 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.012251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-credential-socket\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.012324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-data\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.012661 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.012641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc001feb-6991-4d19-9701-1d9d328801a8-istiod-ca-cert\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.014028 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.014000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-envoy\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.014245 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.014224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc001feb-6991-4d19-9701-1d9d328801a8-istio-podinfo\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.024931 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.024899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-istio-token\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.025440 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.025420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27hzd\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-kube-api-access-27hzd\") pod \"e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") " pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.146315 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.146276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:17.429960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.429928    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"]
Sep 10 14:40:17.432109 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:40:17.432076    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc001feb_6991_4d19_9701_1d9d328801a8.slice/crio-8bde99beb99fe8a96bb8fcb913f3d4efbf893c389953b470c494ccc960db0864 WatchSource:0}: Error finding container 8bde99beb99fe8a96bb8fcb913f3d4efbf893c389953b470c494ccc960db0864: Status 404 returned error can't find the container with id 8bde99beb99fe8a96bb8fcb913f3d4efbf893c389953b470c494ccc960db0864
Sep 10 14:40:17.434589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.434550    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:17.434661 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.434634    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:17.434703 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.434674    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:17.513022 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.512989    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9295bf0-f4b1-4ec9-81a1-cce38738b5a2" path="/var/lib/kubelet/pods/c9295bf0-f4b1-4ec9-81a1-cce38738b5a2/volumes"
Sep 10 14:40:17.513413 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.513397    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0d5215-46ab-4ca0-a3b8-90d644eda18e" path="/var/lib/kubelet/pods/cc0d5215-46ab-4ca0-a3b8-90d644eda18e/volumes"
Sep 10 14:40:17.513705 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.513691    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d7df2d-b500-4ac0-b0ce-ac747f65ea83" path="/var/lib/kubelet/pods/f9d7df2d-b500-4ac0-b0ce-ac747f65ea83/volumes"
Sep 10 14:40:17.961631 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.961597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" event={"ID":"fc001feb-6991-4d19-9701-1d9d328801a8","Type":"ContainerStarted","Data":"f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6"}
Sep 10 14:40:17.962127 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.961659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" event={"ID":"fc001feb-6991-4d19-9701-1d9d328801a8","Type":"ContainerStarted","Data":"8bde99beb99fe8a96bb8fcb913f3d4efbf893c389953b470c494ccc960db0864"}
Sep 10 14:40:17.980623 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:17.980544    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podStartSLOduration=1.980519956 podStartE2EDuration="1.980519956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:17.97988026 +0000 UTC m=+1228.957009615" watchObservedRunningTime="2026-09-10 14:40:17.980519956 +0000 UTC m=+1228.957649311"
Sep 10 14:40:18.147048 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:18.147002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:18.148628 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:18.148600    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:40:18.148681 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:18.148661    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:40:19.151562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:19.151526    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:19.974226 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:19.974202    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:19.975306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:19.975285    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:21.279578 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.279541    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"]
Sep 10 14:40:21.283188 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.283163    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.285459 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.285434    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-04dfc68a-dockercfg-lk7lz\""
Sep 10 14:40:21.285459 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.285452    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-04dfc68a\""
Sep 10 14:40:21.292482 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.292457    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"]
Sep 10 14:40:21.311283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.311251    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"]
Sep 10 14:40:21.314824 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.314807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.329616 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.329589    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"]
Sep 10 14:40:21.358769 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.358727    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-plugins-config-volume\") pod \"payload-processing-e2e-ait-04dfc68a-6dd969499-m87st\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") " pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.358769 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.358773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzjkz\" (UniqueName: \"kubernetes.io/projected/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-kube-api-access-wzjkz\") pod \"payload-processing-e2e-ait-04dfc68a-6dd969499-m87st\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") " pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.364454 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.359284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a4abe3-b739-46bb-bac1-43b92d946da8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.364454 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.359415    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48m8v\" (UniqueName: \"kubernetes.io/projected/94a4abe3-b739-46bb-bac1-43b92d946da8-kube-api-access-48m8v\") pod \"payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.460573 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.460533    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-plugins-config-volume\") pod \"payload-processing-e2e-ait-04dfc68a-6dd969499-m87st\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") " pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.460573 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.460578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzjkz\" (UniqueName: \"kubernetes.io/projected/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-kube-api-access-wzjkz\") pod \"payload-processing-e2e-ait-04dfc68a-6dd969499-m87st\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") " pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.460806 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.460656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a4abe3-b739-46bb-bac1-43b92d946da8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.460806 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.460693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48m8v\" (UniqueName: \"kubernetes.io/projected/94a4abe3-b739-46bb-bac1-43b92d946da8-kube-api-access-48m8v\") pod \"payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.461391 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.461365    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-plugins-config-volume\") pod \"payload-processing-e2e-ait-04dfc68a-6dd969499-m87st\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") " pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.461482 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.461410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a4abe3-b739-46bb-bac1-43b92d946da8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.469035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.469009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48m8v\" (UniqueName: \"kubernetes.io/projected/94a4abe3-b739-46bb-bac1-43b92d946da8-kube-api-access-48m8v\") pod \"payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.469149 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.469044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzjkz\" (UniqueName: \"kubernetes.io/projected/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-kube-api-access-wzjkz\") pod \"payload-processing-e2e-ait-04dfc68a-6dd969499-m87st\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") " pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.596778 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.596668    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:21.628981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.628948    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.872483 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.872456    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"]
Sep 10 14:40:21.874427 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:40:21.874395    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a4abe3_b739_46bb_bac1_43b92d946da8.slice/crio-664318e414321e730c1036f37c45700275ff61d0dc0d69c7a89a61d3f2af5b3e WatchSource:0}: Error finding container 664318e414321e730c1036f37c45700275ff61d0dc0d69c7a89a61d3f2af5b3e: Status 404 returned error can't find the container with id 664318e414321e730c1036f37c45700275ff61d0dc0d69c7a89a61d3f2af5b3e
Sep 10 14:40:21.910999 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.910910    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"]
Sep 10 14:40:21.913450 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:40:21.913424    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2c4c77_4e74_4d10_863b_5df69ad9fbc8.slice/crio-ea49bf118940073d528a0de5d79106dc1ac6df1292db4d701fe7ec1cb5c4c846 WatchSource:0}: Error finding container ea49bf118940073d528a0de5d79106dc1ac6df1292db4d701fe7ec1cb5c4c846: Status 404 returned error can't find the container with id ea49bf118940073d528a0de5d79106dc1ac6df1292db4d701fe7ec1cb5c4c846
Sep 10 14:40:21.988062 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.988025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st" event={"ID":"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8","Type":"ContainerStarted","Data":"7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667"}
Sep 10 14:40:21.988213 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.988092    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:21.988213 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.988117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st" event={"ID":"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8","Type":"ContainerStarted","Data":"ea49bf118940073d528a0de5d79106dc1ac6df1292db4d701fe7ec1cb5c4c846"}
Sep 10 14:40:21.989825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.989798    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv" event={"ID":"94a4abe3-b739-46bb-bac1-43b92d946da8","Type":"ContainerStarted","Data":"97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4"}
Sep 10 14:40:21.989967 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.989862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv" event={"ID":"94a4abe3-b739-46bb-bac1-43b92d946da8","Type":"ContainerStarted","Data":"664318e414321e730c1036f37c45700275ff61d0dc0d69c7a89a61d3f2af5b3e"}
Sep 10 14:40:21.989967 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:21.989894    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:22.005036 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:22.004972    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st" podStartSLOduration=1.004955782 podStartE2EDuration="1.004955782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:22.00210021 +0000 UTC m=+1232.979229577" watchObservedRunningTime="2026-09-10 14:40:22.004955782 +0000 UTC m=+1232.982085135"
Sep 10 14:40:22.017429 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:22.017373    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv" podStartSLOduration=1.017355243 podStartE2EDuration="1.017355243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:22.01608938 +0000 UTC m=+1232.993218735" watchObservedRunningTime="2026-09-10 14:40:22.017355243 +0000 UTC m=+1232.994484638"
Sep 10 14:40:32.997960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:32.997924    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:32.998367 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:32.998002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:35.428313 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:35.428156    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:37306->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Sep 10 14:40:35.428313 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:35.428248    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:37306->10.133.0.46:15021: read: connection reset by peer"
Sep 10 14:40:36.066751 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:36.066718    2577 generic.go:356] "Generic (PLEG): container finished" podID="fc001feb-6991-4d19-9701-1d9d328801a8" containerID="f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6" exitCode=0
Sep 10 14:40:36.066987 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:36.066797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" event={"ID":"fc001feb-6991-4d19-9701-1d9d328801a8","Type":"ContainerDied","Data":"f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6"}
Sep 10 14:40:36.067306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:36.067275    2577 scope.go:117] "RemoveContainer" containerID="f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6"
Sep 10 14:40:36.068573 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:36.068542    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:36.068638 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:36.068613    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:36.068677 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:36.068642    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:37.076940 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:37.076904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" event={"ID":"fc001feb-6991-4d19-9701-1d9d328801a8","Type":"ContainerStarted","Data":"0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45"}
Sep 10 14:40:37.147322 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:37.147288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:37.147707 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:37.147684    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:40:37.147762 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:37.147745    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:40:38.147243 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:38.147207    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:40:38.147653 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:38.147264    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:40:39.147621 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:39.147582    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:40:39.148041 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:39.147642    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:40:40.146701 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:40.146667    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:40:40.146901 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:40.146724    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:40:41.147280 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:41.147238    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:40:41.147674 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:41.147298    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:40:42.147794 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:42.147702    2577 patch_prober.go:28] interesting pod/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:40:42.147794 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:42.147763    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:40:43.151170 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:43.151139    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:43.151630 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:43.151423    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:43.152184 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:43.152162    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:51.213421 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.213385    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"]
Sep 10 14:40:51.213956 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.213635    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv" podUID="cee6b423-92e0-46bf-ad60-aa4ff79d39fb" containerName="payload-processing" containerID="cri-o://fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6" gracePeriod=30
Sep 10 14:40:51.434659 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.434626    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"]
Sep 10 14:40:51.435699 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.435647    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st" podUID="0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" containerName="payload-processing" containerID="cri-o://7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667" gracePeriod=30
Sep 10 14:40:51.450160 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.450121    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"]
Sep 10 14:40:51.450649 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.450596    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv" podUID="94a4abe3-b739-46bb-bac1-43b92d946da8" containerName="payload-pre-processing" containerID="cri-o://97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4" gracePeriod=30
Sep 10 14:40:51.574700 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.574668    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:40:51.586172 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.586078    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfvkj\" (UniqueName: \"kubernetes.io/projected/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-kube-api-access-dfvkj\") pod \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") "
Sep 10 14:40:51.586172 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.586173    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-plugins-config-volume\") pod \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\" (UID: \"cee6b423-92e0-46bf-ad60-aa4ff79d39fb\") "
Sep 10 14:40:51.586680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.586655    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cee6b423-92e0-46bf-ad60-aa4ff79d39fb" (UID: "cee6b423-92e0-46bf-ad60-aa4ff79d39fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:51.589140 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.589096    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-kube-api-access-dfvkj" (OuterVolumeSpecName: "kube-api-access-dfvkj") pod "cee6b423-92e0-46bf-ad60-aa4ff79d39fb" (UID: "cee6b423-92e0-46bf-ad60-aa4ff79d39fb"). InnerVolumeSpecName "kube-api-access-dfvkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:51.687688 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.687654    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfvkj\" (UniqueName: \"kubernetes.io/projected/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-kube-api-access-dfvkj\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:51.687859 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.687690    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cee6b423-92e0-46bf-ad60-aa4ff79d39fb-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:51.715276 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.715246    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:51.723067 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.723005    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:51.788416 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.788129    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a4abe3-b739-46bb-bac1-43b92d946da8-plugins-config-volume\") pod \"94a4abe3-b739-46bb-bac1-43b92d946da8\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") "
Sep 10 14:40:51.788416 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.788245    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48m8v\" (UniqueName: \"kubernetes.io/projected/94a4abe3-b739-46bb-bac1-43b92d946da8-kube-api-access-48m8v\") pod \"94a4abe3-b739-46bb-bac1-43b92d946da8\" (UID: \"94a4abe3-b739-46bb-bac1-43b92d946da8\") "
Sep 10 14:40:51.788416 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.788304    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzjkz\" (UniqueName: \"kubernetes.io/projected/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-kube-api-access-wzjkz\") pod \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") "
Sep 10 14:40:51.788416 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.788388    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-plugins-config-volume\") pod \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\" (UID: \"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8\") "
Sep 10 14:40:51.789463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.789213    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" (UID: "0d2c4c77-4e74-4d10-863b-5df69ad9fbc8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:51.789649 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.789527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a4abe3-b739-46bb-bac1-43b92d946da8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94a4abe3-b739-46bb-bac1-43b92d946da8" (UID: "94a4abe3-b739-46bb-bac1-43b92d946da8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:51.792002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.791978    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a4abe3-b739-46bb-bac1-43b92d946da8-kube-api-access-48m8v" (OuterVolumeSpecName: "kube-api-access-48m8v") pod "94a4abe3-b739-46bb-bac1-43b92d946da8" (UID: "94a4abe3-b739-46bb-bac1-43b92d946da8"). InnerVolumeSpecName "kube-api-access-48m8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:51.792002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.791999    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-kube-api-access-wzjkz" (OuterVolumeSpecName: "kube-api-access-wzjkz") pod "0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" (UID: "0d2c4c77-4e74-4d10-863b-5df69ad9fbc8"). InnerVolumeSpecName "kube-api-access-wzjkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:51.889602 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.889552    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a4abe3-b739-46bb-bac1-43b92d946da8-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:51.889602 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.889591    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48m8v\" (UniqueName: \"kubernetes.io/projected/94a4abe3-b739-46bb-bac1-43b92d946da8-kube-api-access-48m8v\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:51.889602 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.889605    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzjkz\" (UniqueName: \"kubernetes.io/projected/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-kube-api-access-wzjkz\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:51.889896 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:51.889618    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:52.178264 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.178232    2577 generic.go:356] "Generic (PLEG): container finished" podID="0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" containerID="7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667" exitCode=0
Sep 10 14:40:52.178477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.178275    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"
Sep 10 14:40:52.178477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.178315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st" event={"ID":"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8","Type":"ContainerDied","Data":"7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667"}
Sep 10 14:40:52.178477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.178387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st" event={"ID":"0d2c4c77-4e74-4d10-863b-5df69ad9fbc8","Type":"ContainerDied","Data":"ea49bf118940073d528a0de5d79106dc1ac6df1292db4d701fe7ec1cb5c4c846"}
Sep 10 14:40:52.178477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.178418    2577 scope.go:117] "RemoveContainer" containerID="7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667"
Sep 10 14:40:52.179652 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.179553    2577 generic.go:356] "Generic (PLEG): container finished" podID="94a4abe3-b739-46bb-bac1-43b92d946da8" containerID="97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4" exitCode=0
Sep 10 14:40:52.179652 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.179592    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"
Sep 10 14:40:52.179652 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.179641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv" event={"ID":"94a4abe3-b739-46bb-bac1-43b92d946da8","Type":"ContainerDied","Data":"97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4"}
Sep 10 14:40:52.179821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.179693    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv" event={"ID":"94a4abe3-b739-46bb-bac1-43b92d946da8","Type":"ContainerDied","Data":"664318e414321e730c1036f37c45700275ff61d0dc0d69c7a89a61d3f2af5b3e"}
Sep 10 14:40:52.181268 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.181242    2577 generic.go:356] "Generic (PLEG): container finished" podID="cee6b423-92e0-46bf-ad60-aa4ff79d39fb" containerID="fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6" exitCode=0
Sep 10 14:40:52.181392 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.181289    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"
Sep 10 14:40:52.181392 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.181294    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv" event={"ID":"cee6b423-92e0-46bf-ad60-aa4ff79d39fb","Type":"ContainerDied","Data":"fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6"}
Sep 10 14:40:52.181510 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.181400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv" event={"ID":"cee6b423-92e0-46bf-ad60-aa4ff79d39fb","Type":"ContainerDied","Data":"279779cbadf2533762ed6cc8842dae249b961aacf0795b03e6de8b92186d9dbb"}
Sep 10 14:40:52.189466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.189317    2577 scope.go:117] "RemoveContainer" containerID="7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667"
Sep 10 14:40:52.189746 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:40:52.189720    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667\": container with ID starting with 7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667 not found: ID does not exist" containerID="7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667"
Sep 10 14:40:52.189828 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.189756    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667"} err="failed to get container status \"7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667\": rpc error: code = NotFound desc = could not find container \"7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667\": container with ID starting with 7cc82a015e29e26c5f2d7b44008d1ad5e0f8d5ca57a5660e9c61413dd0701667 not found: ID does not exist"
Sep 10 14:40:52.189828 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.189773    2577 scope.go:117] "RemoveContainer" containerID="97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4"
Sep 10 14:40:52.198554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.198539    2577 scope.go:117] "RemoveContainer" containerID="97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4"
Sep 10 14:40:52.198828 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:40:52.198810    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4\": container with ID starting with 97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4 not found: ID does not exist" containerID="97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4"
Sep 10 14:40:52.198904 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.198833    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4"} err="failed to get container status \"97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4\": rpc error: code = NotFound desc = could not find container \"97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4\": container with ID starting with 97b793ee38a013ba92f28f5148077072e294a7d10d5d6656e593e8568018f2d4 not found: ID does not exist"
Sep 10 14:40:52.198904 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.198863    2577 scope.go:117] "RemoveContainer" containerID="fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6"
Sep 10 14:40:52.206062 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.206039    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"]
Sep 10 14:40:52.206717 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.206705    2577 scope.go:117] "RemoveContainer" containerID="fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6"
Sep 10 14:40:52.207049 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:40:52.207028    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6\": container with ID starting with fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6 not found: ID does not exist" containerID="fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6"
Sep 10 14:40:52.207115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.207054    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6"} err="failed to get container status \"fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6\": rpc error: code = NotFound desc = could not find container \"fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6\": container with ID starting with fc24dd4eb9bb320ccce9fc4d553baec8c34849709eb43dff13d2071a10f823b6 not found: ID does not exist"
Sep 10 14:40:52.209656 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.209635    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st"]
Sep 10 14:40:52.223215 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.223185    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"]
Sep 10 14:40:52.228074 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.228047    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv"]
Sep 10 14:40:52.236238 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.236213    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"]
Sep 10 14:40:52.238211 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.238190    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv"]
Sep 10 14:40:52.792155 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.789534    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"]
Sep 10 14:40:52.793158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:52.793059    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy" containerID="cri-o://0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45" gracePeriod=30
Sep 10 14:40:53.451648 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.451607    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"]
Sep 10 14:40:53.452111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452093    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" containerName="payload-processing"
Sep 10 14:40:53.452158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452113    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" containerName="payload-processing"
Sep 10 14:40:53.452158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452129    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a4abe3-b739-46bb-bac1-43b92d946da8" containerName="payload-pre-processing"
Sep 10 14:40:53.452158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452135    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a4abe3-b739-46bb-bac1-43b92d946da8" containerName="payload-pre-processing"
Sep 10 14:40:53.452158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452149    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cee6b423-92e0-46bf-ad60-aa4ff79d39fb" containerName="payload-processing"
Sep 10 14:40:53.452158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452154    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cee6b423-92e0-46bf-ad60-aa4ff79d39fb" containerName="payload-processing"
Sep 10 14:40:53.452318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452227    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cee6b423-92e0-46bf-ad60-aa4ff79d39fb" containerName="payload-processing"
Sep 10 14:40:53.452318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452237    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" containerName="payload-processing"
Sep 10 14:40:53.452318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.452245    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a4abe3-b739-46bb-bac1-43b92d946da8" containerName="payload-pre-processing"
Sep 10 14:40:53.455356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.455336    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.457533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.457511    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b46e5fd4-openshift-default-dockercfg-lrchh\""
Sep 10 14:40:53.469896 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.469869    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"]
Sep 10 14:40:53.505486 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-podinfo\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-envoy\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-socket\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krz9z\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-kube-api-access-krz9z\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istiod-ca-cert\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-data\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-certs\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-credential-socket\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.505974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.505798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-token\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.511015 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.510983    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d2c4c77-4e74-4d10-863b-5df69ad9fbc8" path="/var/lib/kubelet/pods/0d2c4c77-4e74-4d10-863b-5df69ad9fbc8/volumes"
Sep 10 14:40:53.511358 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.511346    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a4abe3-b739-46bb-bac1-43b92d946da8" path="/var/lib/kubelet/pods/94a4abe3-b739-46bb-bac1-43b92d946da8/volumes"
Sep 10 14:40:53.511700 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.511687    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cee6b423-92e0-46bf-ad60-aa4ff79d39fb" path="/var/lib/kubelet/pods/cee6b423-92e0-46bf-ad60-aa4ff79d39fb/volumes"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.606762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istiod-ca-cert\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.606822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-data\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.606936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-certs\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.606964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-credential-socket\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.606995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-token\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-podinfo\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-envoy\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-socket\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krz9z\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-kube-api-access-krz9z\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.607318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-data\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.608079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607456    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-credential-socket\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.608079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-socket\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.608079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.607833    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istiod-ca-cert\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.608581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.608536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-certs\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.609881 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.609856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-envoy\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.610341 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.610322    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-podinfo\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.614834 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.614802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-token\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.615096 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.615073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krz9z\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-kube-api-access-krz9z\") pod \"e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") " pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:53.768980 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:53.768889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:54.045285 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.045254    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"]
Sep 10 14:40:54.046917 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:40:54.046888    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bf3ec3_5188_462b_97c5_3a2a94df980d.slice/crio-4a88eebfd286693ef696ac6c9d61dd6182bcd2355b1d26d5833570602a1dd2f9 WatchSource:0}: Error finding container 4a88eebfd286693ef696ac6c9d61dd6182bcd2355b1d26d5833570602a1dd2f9: Status 404 returned error can't find the container with id 4a88eebfd286693ef696ac6c9d61dd6182bcd2355b1d26d5833570602a1dd2f9
Sep 10 14:40:54.049391 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.049346    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:54.049469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.049442    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:54.049512 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.049498    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:40:54.203616 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.203578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" event={"ID":"c3bf3ec3-5188-462b-97c5-3a2a94df980d","Type":"ContainerStarted","Data":"66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73"}
Sep 10 14:40:54.203810 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.203634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" event={"ID":"c3bf3ec3-5188-462b-97c5-3a2a94df980d","Type":"ContainerStarted","Data":"4a88eebfd286693ef696ac6c9d61dd6182bcd2355b1d26d5833570602a1dd2f9"}
Sep 10 14:40:54.221734 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.221684    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podStartSLOduration=1.221656731 podStartE2EDuration="1.221656731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:54.220508391 +0000 UTC m=+1265.197637746" watchObservedRunningTime="2026-09-10 14:40:54.221656731 +0000 UTC m=+1265.198786146"
Sep 10 14:40:54.769545 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:54.769491    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:55.775360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:55.775324    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:56.213650 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:56.213610    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:56.214641 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:56.214624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:40:57.330934 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.330899    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"]
Sep 10 14:40:57.333723 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.333693    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.336346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.336322    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b46e5fd4\""
Sep 10 14:40:57.336480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.336383    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b46e5fd4-dockercfg-plc97\""
Sep 10 14:40:57.346588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.346555    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"]
Sep 10 14:40:57.358790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.358758    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"]
Sep 10 14:40:57.361500 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.361483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.373966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.373939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"]
Sep 10 14:40:57.447589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.447541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d97f9173-e041-4b6b-b91b-a542383aaf05-plugins-config-volume\") pod \"payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") " pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.447812 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.447638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbscw\" (UniqueName: \"kubernetes.io/projected/d97f9173-e041-4b6b-b91b-a542383aaf05-kube-api-access-rbscw\") pod \"payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") " pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.447812 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.447695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0672d24-e535-4767-ad58-eab522440f11-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.447812 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.447731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gbw\" (UniqueName: \"kubernetes.io/projected/e0672d24-e535-4767-ad58-eab522440f11-kube-api-access-v9gbw\") pod \"payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.548940 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.548898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d97f9173-e041-4b6b-b91b-a542383aaf05-plugins-config-volume\") pod \"payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") " pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.549157 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.549043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbscw\" (UniqueName: \"kubernetes.io/projected/d97f9173-e041-4b6b-b91b-a542383aaf05-kube-api-access-rbscw\") pod \"payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") " pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.549157 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.549085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0672d24-e535-4767-ad58-eab522440f11-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.549157 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.549107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gbw\" (UniqueName: \"kubernetes.io/projected/e0672d24-e535-4767-ad58-eab522440f11-kube-api-access-v9gbw\") pod \"payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.549751 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.549725    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d97f9173-e041-4b6b-b91b-a542383aaf05-plugins-config-volume\") pod \"payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") " pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.549871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.549753    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0672d24-e535-4767-ad58-eab522440f11-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.556809 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.556777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gbw\" (UniqueName: \"kubernetes.io/projected/e0672d24-e535-4767-ad58-eab522440f11-kube-api-access-v9gbw\") pod \"payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.556945 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.556819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbscw\" (UniqueName: \"kubernetes.io/projected/d97f9173-e041-4b6b-b91b-a542383aaf05-kube-api-access-rbscw\") pod \"payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") " pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.646944 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.646899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:57.673133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.673095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:57.922825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.922786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"]
Sep 10 14:40:57.925719 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:40:57.925685    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0672d24_e535_4767_ad58_eab522440f11.slice/crio-ed1e1da7c10e2d6b34a7ab908625d6ac25b6d50326a52f18c9812a0b53b842db WatchSource:0}: Error finding container ed1e1da7c10e2d6b34a7ab908625d6ac25b6d50326a52f18c9812a0b53b842db: Status 404 returned error can't find the container with id ed1e1da7c10e2d6b34a7ab908625d6ac25b6d50326a52f18c9812a0b53b842db
Sep 10 14:40:57.960229 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:57.960107    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"]
Sep 10 14:40:57.963559 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:40:57.963533    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97f9173_e041_4b6b_b91b_a542383aaf05.slice/crio-4b31822ba23fffd167173e4dcb29c54f6f64d2158a6c1e92faeeaefcb77d0ee3 WatchSource:0}: Error finding container 4b31822ba23fffd167173e4dcb29c54f6f64d2158a6c1e92faeeaefcb77d0ee3: Status 404 returned error can't find the container with id 4b31822ba23fffd167173e4dcb29c54f6f64d2158a6c1e92faeeaefcb77d0ee3
Sep 10 14:40:58.045067 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.045033    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:58.155030 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.154995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-envoy\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155041    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-data\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155072    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc001feb-6991-4d19-9701-1d9d328801a8-istiod-ca-cert\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155101    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-socket\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155143    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-credential-socket\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155176    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27hzd\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-kube-api-access-27hzd\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155196    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc001feb-6991-4d19-9701-1d9d328801a8-istio-podinfo\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155322    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-istio-token\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155326    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:58.155565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-certs\") pod \"fc001feb-6991-4d19-9701-1d9d328801a8\" (UID: \"fc001feb-6991-4d19-9701-1d9d328801a8\") "
Sep 10 14:40:58.155565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155421    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:58.155565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155429    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:58.155565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155557    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc001feb-6991-4d19-9701-1d9d328801a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:58.155963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155746    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:58.155963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155857    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.155963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155877    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc001feb-6991-4d19-9701-1d9d328801a8-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.155963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155891    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.155963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155902    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.155963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.155915    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.157606 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.157583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:58.157795 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.157768    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:58.157795 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.157768    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc001feb-6991-4d19-9701-1d9d328801a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:40:58.157963 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.157771    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-kube-api-access-27hzd" (OuterVolumeSpecName: "kube-api-access-27hzd") pod "fc001feb-6991-4d19-9701-1d9d328801a8" (UID: "fc001feb-6991-4d19-9701-1d9d328801a8"). InnerVolumeSpecName "kube-api-access-27hzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:58.228871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.228762    2577 generic.go:356] "Generic (PLEG): container finished" podID="fc001feb-6991-4d19-9701-1d9d328801a8" containerID="0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45" exitCode=0
Sep 10 14:40:58.228871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.228821    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"
Sep 10 14:40:58.228871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.228857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" event={"ID":"fc001feb-6991-4d19-9701-1d9d328801a8","Type":"ContainerDied","Data":"0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45"}
Sep 10 14:40:58.229183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.228923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc" event={"ID":"fc001feb-6991-4d19-9701-1d9d328801a8","Type":"ContainerDied","Data":"8bde99beb99fe8a96bb8fcb913f3d4efbf893c389953b470c494ccc960db0864"}
Sep 10 14:40:58.229183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.228954    2577 scope.go:117] "RemoveContainer" containerID="0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45"
Sep 10 14:40:58.231005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.230977    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6" event={"ID":"d97f9173-e041-4b6b-b91b-a542383aaf05","Type":"ContainerStarted","Data":"d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1"}
Sep 10 14:40:58.231159 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.231039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6" event={"ID":"d97f9173-e041-4b6b-b91b-a542383aaf05","Type":"ContainerStarted","Data":"4b31822ba23fffd167173e4dcb29c54f6f64d2158a6c1e92faeeaefcb77d0ee3"}
Sep 10 14:40:58.231159 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.231085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:40:58.233261 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.232878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6" event={"ID":"e0672d24-e535-4767-ad58-eab522440f11","Type":"ContainerStarted","Data":"e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641"}
Sep 10 14:40:58.233261 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.232923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6" event={"ID":"e0672d24-e535-4767-ad58-eab522440f11","Type":"ContainerStarted","Data":"ed1e1da7c10e2d6b34a7ab908625d6ac25b6d50326a52f18c9812a0b53b842db"}
Sep 10 14:40:58.233261 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.233145    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:40:58.239317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.239296    2577 scope.go:117] "RemoveContainer" containerID="f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6"
Sep 10 14:40:58.247833 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.247774    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6" podStartSLOduration=1.247751479 podStartE2EDuration="1.247751479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:58.246302966 +0000 UTC m=+1269.223432321" watchObservedRunningTime="2026-09-10 14:40:58.247751479 +0000 UTC m=+1269.224880834"
Sep 10 14:40:58.248735 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.248703    2577 scope.go:117] "RemoveContainer" containerID="0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45"
Sep 10 14:40:58.249087 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:40:58.249064    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45\": container with ID starting with 0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45 not found: ID does not exist" containerID="0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45"
Sep 10 14:40:58.249168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.249097    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45"} err="failed to get container status \"0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45\": rpc error: code = NotFound desc = could not find container \"0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45\": container with ID starting with 0a6dec107b63959c8ae07518806c4e105b58e5e31abbf36cf66ca2cccd167b45 not found: ID does not exist"
Sep 10 14:40:58.249168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.249119    2577 scope.go:117] "RemoveContainer" containerID="f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6"
Sep 10 14:40:58.249421 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:40:58.249404    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6\": container with ID starting with f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6 not found: ID does not exist" containerID="f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6"
Sep 10 14:40:58.249471 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.249428    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6"} err="failed to get container status \"f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6\": rpc error: code = NotFound desc = could not find container \"f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6\": container with ID starting with f7e28ceb4ae352f0c0ffffb8cfeb805756d6c78f3adaac406f347b8d0ca75fe6 not found: ID does not exist"
Sep 10 14:40:58.257186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.257160    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.257186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.257186    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc001feb-6991-4d19-9701-1d9d328801a8-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.257186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.257200    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27hzd\" (UniqueName: \"kubernetes.io/projected/fc001feb-6991-4d19-9701-1d9d328801a8-kube-api-access-27hzd\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.257446 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.257215    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc001feb-6991-4d19-9701-1d9d328801a8-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:40:58.262019 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.261972    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6" podStartSLOduration=1.261952639 podStartE2EDuration="1.261952639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:58.259057042 +0000 UTC m=+1269.236186396" watchObservedRunningTime="2026-09-10 14:40:58.261952639 +0000 UTC m=+1269.239081995"
Sep 10 14:40:58.273177 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.273148    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"]
Sep 10 14:40:58.275608 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:58.275584    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc"]
Sep 10 14:40:59.510917 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:40:59.510882    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" path="/var/lib/kubelet/pods/fc001feb-6991-4d19-9701-1d9d328801a8/volumes"
Sep 10 14:41:09.051137 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.051087    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"]
Sep 10 14:41:09.051726 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.051705    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy"
Sep 10 14:41:09.051811 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.051729    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy"
Sep 10 14:41:09.051910 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.051892    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy"
Sep 10 14:41:09.051910 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.051904    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy"
Sep 10 14:41:09.056622 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.056598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.058961 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.058936    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-b2dfe7-dockercfg-qbkwh\""
Sep 10 14:41:09.059701 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.059680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-b2dfe7\""
Sep 10 14:41:09.087215 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.087176    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"]
Sep 10 14:41:09.100776 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.100739    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"]
Sep 10 14:41:09.101342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.101307    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy"
Sep 10 14:41:09.101342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.101333    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc001feb-6991-4d19-9701-1d9d328801a8" containerName="istio-proxy"
Sep 10 14:41:09.104477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.104456    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.120810 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.120776    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"]
Sep 10 14:41:09.175698 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.175649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97hx\" (UniqueName: \"kubernetes.io/projected/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-kube-api-access-l97hx\") pod \"payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.176094 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.176067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwgcq\" (UniqueName: \"kubernetes.io/projected/c29ce006-f6d5-4382-bab6-219fc651f503-kube-api-access-dwgcq\") pod \"payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.176243 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.176227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29ce006-f6d5-4382-bab6-219fc651f503-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.176382 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.176364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.242680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.242650    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:41:09.242874 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.242806    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:41:09.278428 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.278389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97hx\" (UniqueName: \"kubernetes.io/projected/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-kube-api-access-l97hx\") pod \"payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.282045 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.282012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwgcq\" (UniqueName: \"kubernetes.io/projected/c29ce006-f6d5-4382-bab6-219fc651f503-kube-api-access-dwgcq\") pod \"payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.282626 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.282603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29ce006-f6d5-4382-bab6-219fc651f503-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.282813 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.282796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.286996 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.286962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29ce006-f6d5-4382-bab6-219fc651f503-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.288257 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.288234    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.298586 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.298553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwgcq\" (UniqueName: \"kubernetes.io/projected/c29ce006-f6d5-4382-bab6-219fc651f503-kube-api-access-dwgcq\") pod \"payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.299871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.299474    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97hx\" (UniqueName: \"kubernetes.io/projected/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-kube-api-access-l97hx\") pod \"payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") " pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.367547 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.367512    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:09.415838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.415802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:09.678210 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.669494    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"]
Sep 10 14:41:09.678210 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:41:09.678158    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29ce006_f6d5_4382_bab6_219fc651f503.slice/crio-7760b2570ab6489b2b0931ccef880d8b4bc2152da13837146f2f74ae3f3c4ad3 WatchSource:0}: Error finding container 7760b2570ab6489b2b0931ccef880d8b4bc2152da13837146f2f74ae3f3c4ad3: Status 404 returned error can't find the container with id 7760b2570ab6489b2b0931ccef880d8b4bc2152da13837146f2f74ae3f3c4ad3
Sep 10 14:41:09.722035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:09.722006    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"]
Sep 10 14:41:09.725644 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:41:09.725607    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ead4f0c_1935_4582_8ebf_ea26e204e5cd.slice/crio-4ac92be71f8fbedbd5ec2bacc2a759d3c5ed29ae7db81a1aa86fc9572cc4ed6a WatchSource:0}: Error finding container 4ac92be71f8fbedbd5ec2bacc2a759d3c5ed29ae7db81a1aa86fc9572cc4ed6a: Status 404 returned error can't find the container with id 4ac92be71f8fbedbd5ec2bacc2a759d3c5ed29ae7db81a1aa86fc9572cc4ed6a
Sep 10 14:41:10.320954 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.320832    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96" event={"ID":"2ead4f0c-1935-4582-8ebf-ea26e204e5cd","Type":"ContainerStarted","Data":"69fea4b6409bb7dfdad0b0409c7dd167b1324f7e45e0bf65cbe7b502405a5296"}
Sep 10 14:41:10.320954 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.320915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96" event={"ID":"2ead4f0c-1935-4582-8ebf-ea26e204e5cd","Type":"ContainerStarted","Data":"4ac92be71f8fbedbd5ec2bacc2a759d3c5ed29ae7db81a1aa86fc9572cc4ed6a"}
Sep 10 14:41:10.321470 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.320964    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:10.323052 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.323018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg" event={"ID":"c29ce006-f6d5-4382-bab6-219fc651f503","Type":"ContainerStarted","Data":"c94c1e0e4e851bbd0f4109a5c6ad7eeff1cb41b397573306ef9cd623c971048d"}
Sep 10 14:41:10.323185 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.323076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg" event={"ID":"c29ce006-f6d5-4382-bab6-219fc651f503","Type":"ContainerStarted","Data":"7760b2570ab6489b2b0931ccef880d8b4bc2152da13837146f2f74ae3f3c4ad3"}
Sep 10 14:41:10.323185 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.323107    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:10.342048 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.341986    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96" podStartSLOduration=1.341966791 podStartE2EDuration="1.341966791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:10.340102238 +0000 UTC m=+1281.317231592" watchObservedRunningTime="2026-09-10 14:41:10.341966791 +0000 UTC m=+1281.319096145"
Sep 10 14:41:10.357750 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:10.357119    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg" podStartSLOduration=1.357095668 podStartE2EDuration="1.357095668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:10.356580168 +0000 UTC m=+1281.333709522" watchObservedRunningTime="2026-09-10 14:41:10.357095668 +0000 UTC m=+1281.334225022"
Sep 10 14:41:12.255120 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:12.255059    2577 patch_prober.go:28] interesting pod/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:41:12.255582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:12.255154    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:41:14.353680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:14.353646    2577 generic.go:356] "Generic (PLEG): container finished" podID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerID="66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73" exitCode=0
Sep 10 14:41:14.354163 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:14.353706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" event={"ID":"c3bf3ec3-5188-462b-97c5-3a2a94df980d","Type":"ContainerDied","Data":"66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73"}
Sep 10 14:41:14.354163 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:14.354141    2577 scope.go:117] "RemoveContainer" containerID="66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73"
Sep 10 14:41:14.355242 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:14.355214    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:41:14.355301 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:14.355284    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:41:14.355341 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:14.355330    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:41:15.361827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:15.361794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" event={"ID":"c3bf3ec3-5188-462b-97c5-3a2a94df980d","Type":"ContainerStarted","Data":"5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10"}
Sep 10 14:41:15.769878 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:15.769804    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:41:15.770268 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:15.770244    2577 patch_prober.go:28] interesting pod/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:15.770460 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:15.770437    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 14:41:16.769302 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:16.769263    2577 patch_prober.go:28] interesting pod/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:16.769825 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:16.769348    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 14:41:17.769615 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:17.769570    2577 patch_prober.go:28] interesting pod/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:17.770140 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:17.769658    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 14:41:18.769520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:18.769471    2577 patch_prober.go:28] interesting pod/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:18.769737 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:18.769544    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 14:41:19.773288 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:19.773240    2577 patch_prober.go:28] interesting pod/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 10 14:41:19.773799 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:19.773326    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 10 14:41:20.774478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:20.774443    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:41:20.774975 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:20.774888    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:41:20.775707 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:20.775674    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:41:21.332993 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:21.332964    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:41:21.333181 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:21.333129    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:41:27.596335 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.596297    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"]
Sep 10 14:41:27.597264 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.596695    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6" podUID="d97f9173-e041-4b6b-b91b-a542383aaf05" containerName="payload-processing" containerID="cri-o://d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1" gracePeriod=30
Sep 10 14:41:27.604691 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.604516    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"]
Sep 10 14:41:27.605091 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.604767    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6" podUID="e0672d24-e535-4767-ad58-eab522440f11" containerName="payload-pre-processing" containerID="cri-o://e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641" gracePeriod=30
Sep 10 14:41:27.851147 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.851073    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:41:27.884424 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.884399    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:41:27.894712 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.894686    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d97f9173-e041-4b6b-b91b-a542383aaf05-plugins-config-volume\") pod \"d97f9173-e041-4b6b-b91b-a542383aaf05\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") "
Sep 10 14:41:27.894884 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.894781    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbscw\" (UniqueName: \"kubernetes.io/projected/d97f9173-e041-4b6b-b91b-a542383aaf05-kube-api-access-rbscw\") pod \"d97f9173-e041-4b6b-b91b-a542383aaf05\" (UID: \"d97f9173-e041-4b6b-b91b-a542383aaf05\") "
Sep 10 14:41:27.895149 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.895125    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d97f9173-e041-4b6b-b91b-a542383aaf05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d97f9173-e041-4b6b-b91b-a542383aaf05" (UID: "d97f9173-e041-4b6b-b91b-a542383aaf05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:27.895267 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.895253    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d97f9173-e041-4b6b-b91b-a542383aaf05-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:27.897212 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.897188    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d97f9173-e041-4b6b-b91b-a542383aaf05-kube-api-access-rbscw" (OuterVolumeSpecName: "kube-api-access-rbscw") pod "d97f9173-e041-4b6b-b91b-a542383aaf05" (UID: "d97f9173-e041-4b6b-b91b-a542383aaf05"). InnerVolumeSpecName "kube-api-access-rbscw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:27.996105 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.996066    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9gbw\" (UniqueName: \"kubernetes.io/projected/e0672d24-e535-4767-ad58-eab522440f11-kube-api-access-v9gbw\") pod \"e0672d24-e535-4767-ad58-eab522440f11\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") "
Sep 10 14:41:27.996430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.996405    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0672d24-e535-4767-ad58-eab522440f11-plugins-config-volume\") pod \"e0672d24-e535-4767-ad58-eab522440f11\" (UID: \"e0672d24-e535-4767-ad58-eab522440f11\") "
Sep 10 14:41:27.996871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.996820    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbscw\" (UniqueName: \"kubernetes.io/projected/d97f9173-e041-4b6b-b91b-a542383aaf05-kube-api-access-rbscw\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:27.997165 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.997143    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0672d24-e535-4767-ad58-eab522440f11-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0672d24-e535-4767-ad58-eab522440f11" (UID: "e0672d24-e535-4767-ad58-eab522440f11"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:27.998478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:27.998458    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0672d24-e535-4767-ad58-eab522440f11-kube-api-access-v9gbw" (OuterVolumeSpecName: "kube-api-access-v9gbw") pod "e0672d24-e535-4767-ad58-eab522440f11" (UID: "e0672d24-e535-4767-ad58-eab522440f11"). InnerVolumeSpecName "kube-api-access-v9gbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:28.038291 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.038259    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"]
Sep 10 14:41:28.038534 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.038511    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy" containerID="cri-o://5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10" gracePeriod=30
Sep 10 14:41:28.098317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.098274    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0672d24-e535-4767-ad58-eab522440f11-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:28.098317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.098314    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9gbw\" (UniqueName: \"kubernetes.io/projected/e0672d24-e535-4767-ad58-eab522440f11-kube-api-access-v9gbw\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:28.443938 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.443902    2577 generic.go:356] "Generic (PLEG): container finished" podID="e0672d24-e535-4767-ad58-eab522440f11" containerID="e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641" exitCode=0
Sep 10 14:41:28.444145 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.443961    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"
Sep 10 14:41:28.444145 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.443990    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6" event={"ID":"e0672d24-e535-4767-ad58-eab522440f11","Type":"ContainerDied","Data":"e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641"}
Sep 10 14:41:28.444145 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.444056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6" event={"ID":"e0672d24-e535-4767-ad58-eab522440f11","Type":"ContainerDied","Data":"ed1e1da7c10e2d6b34a7ab908625d6ac25b6d50326a52f18c9812a0b53b842db"}
Sep 10 14:41:28.444145 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.444088    2577 scope.go:117] "RemoveContainer" containerID="e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641"
Sep 10 14:41:28.445404 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.445382    2577 generic.go:356] "Generic (PLEG): container finished" podID="d97f9173-e041-4b6b-b91b-a542383aaf05" containerID="d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1" exitCode=0
Sep 10 14:41:28.445511 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.445414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6" event={"ID":"d97f9173-e041-4b6b-b91b-a542383aaf05","Type":"ContainerDied","Data":"d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1"}
Sep 10 14:41:28.445511 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.445433    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"
Sep 10 14:41:28.445511 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.445465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6" event={"ID":"d97f9173-e041-4b6b-b91b-a542383aaf05","Type":"ContainerDied","Data":"4b31822ba23fffd167173e4dcb29c54f6f64d2158a6c1e92faeeaefcb77d0ee3"}
Sep 10 14:41:28.454811 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.454794    2577 scope.go:117] "RemoveContainer" containerID="e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641"
Sep 10 14:41:28.455257 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:41:28.455232    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641\": container with ID starting with e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641 not found: ID does not exist" containerID="e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641"
Sep 10 14:41:28.455340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.455264    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641"} err="failed to get container status \"e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641\": rpc error: code = NotFound desc = could not find container \"e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641\": container with ID starting with e3c30bf4c1b86aa33178356fff34c884ca3ac13469bfb38e44d90901fbf7b641 not found: ID does not exist"
Sep 10 14:41:28.455340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.455280    2577 scope.go:117] "RemoveContainer" containerID="d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1"
Sep 10 14:41:28.465737 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.465715    2577 scope.go:117] "RemoveContainer" containerID="d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1"
Sep 10 14:41:28.466072 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:41:28.466054    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1\": container with ID starting with d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1 not found: ID does not exist" containerID="d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1"
Sep 10 14:41:28.466179 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.466080    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1"} err="failed to get container status \"d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1\": rpc error: code = NotFound desc = could not find container \"d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1\": container with ID starting with d96021fbbaf4321166f0f37e9136fd165e70d138dd81a2dd2f766bbf36d4c3d1 not found: ID does not exist"
Sep 10 14:41:28.469128 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.469103    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"]
Sep 10 14:41:28.475636 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.475609    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6"]
Sep 10 14:41:28.484282 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.484258    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"]
Sep 10 14:41:28.487649 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:28.487624    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6"]
Sep 10 14:41:29.514614 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:29.514574    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d97f9173-e041-4b6b-b91b-a542383aaf05" path="/var/lib/kubelet/pods/d97f9173-e041-4b6b-b91b-a542383aaf05/volumes"
Sep 10 14:41:29.515186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:29.515165    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0672d24-e535-4767-ad58-eab522440f11" path="/var/lib/kubelet/pods/e0672d24-e535-4767-ad58-eab522440f11/volumes"
Sep 10 14:41:33.293202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.293177    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:41:33.349581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349489    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-envoy\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.349581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349529    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-credential-socket\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.349581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349562    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krz9z\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-kube-api-access-krz9z\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.349878 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-podinfo\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.349878 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349661    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-socket\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.349878 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-certs\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.349878 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349785    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istiod-ca-cert\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.349878 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349802    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:33.349878 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349815    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-data\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.350183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.349910    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-token\") pod \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\" (UID: \"c3bf3ec3-5188-462b-97c5-3a2a94df980d\") "
Sep 10 14:41:33.350183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.350059    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:33.350286 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.350196    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:33.350328 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.350302    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:33.350409 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.350384    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.350462 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.350416    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.350519 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.350504    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.350589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.350573    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:33.351976 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.351949    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:41:33.352079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.352057    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:41:33.352079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.352070    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-kube-api-access-krz9z" (OuterVolumeSpecName: "kube-api-access-krz9z") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "kube-api-access-krz9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:33.352237 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.352179    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3bf3ec3-5188-462b-97c5-3a2a94df980d" (UID: "c3bf3ec3-5188-462b-97c5-3a2a94df980d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:33.451418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.451382    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.451418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.451415    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.451418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.451423    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.451418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.451431    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.451702 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.451439    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krz9z\" (UniqueName: \"kubernetes.io/projected/c3bf3ec3-5188-462b-97c5-3a2a94df980d-kube-api-access-krz9z\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.451702 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.451448    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3bf3ec3-5188-462b-97c5-3a2a94df980d-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:41:33.478170 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.478127    2577 generic.go:356] "Generic (PLEG): container finished" podID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerID="5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10" exitCode=0
Sep 10 14:41:33.478337 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.478176    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"
Sep 10 14:41:33.478337 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.478206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" event={"ID":"c3bf3ec3-5188-462b-97c5-3a2a94df980d","Type":"ContainerDied","Data":"5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10"}
Sep 10 14:41:33.478337 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.478282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj" event={"ID":"c3bf3ec3-5188-462b-97c5-3a2a94df980d","Type":"ContainerDied","Data":"4a88eebfd286693ef696ac6c9d61dd6182bcd2355b1d26d5833570602a1dd2f9"}
Sep 10 14:41:33.478337 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.478307    2577 scope.go:117] "RemoveContainer" containerID="5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10"
Sep 10 14:41:33.487941 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.487918    2577 scope.go:117] "RemoveContainer" containerID="66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73"
Sep 10 14:41:33.497638 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.497571    2577 scope.go:117] "RemoveContainer" containerID="5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10"
Sep 10 14:41:33.498040 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:41:33.498010    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10\": container with ID starting with 5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10 not found: ID does not exist" containerID="5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10"
Sep 10 14:41:33.498156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.498048    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10"} err="failed to get container status \"5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10\": rpc error: code = NotFound desc = could not find container \"5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10\": container with ID starting with 5278d356a129108313b3bfbc54cc27c082e496e79c5293ef624fccf0b23abd10 not found: ID does not exist"
Sep 10 14:41:33.498156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.498077    2577 scope.go:117] "RemoveContainer" containerID="66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73"
Sep 10 14:41:33.498391 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:41:33.498368    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73\": container with ID starting with 66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73 not found: ID does not exist" containerID="66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73"
Sep 10 14:41:33.498460 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.498397    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73"} err="failed to get container status \"66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73\": rpc error: code = NotFound desc = could not find container \"66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73\": container with ID starting with 66b2f34a7e6523632105546dc62412d2dbaa44e91830ee32f08bc677420abc73 not found: ID does not exist"
Sep 10 14:41:33.499954 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.499931    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"]
Sep 10 14:41:33.502892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.502838    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj"]
Sep 10 14:41:33.510687 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:41:33.510662    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" path="/var/lib/kubelet/pods/c3bf3ec3-5188-462b-97c5-3a2a94df980d/volumes"
Sep 10 14:42:00.922607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.922574    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"]
Sep 10 14:42:00.923051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923005    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy"
Sep 10 14:42:00.923051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923019    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy"
Sep 10 14:42:00.923051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923046    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0672d24-e535-4767-ad58-eab522440f11" containerName="payload-pre-processing"
Sep 10 14:42:00.923051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923053    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0672d24-e535-4767-ad58-eab522440f11" containerName="payload-pre-processing"
Sep 10 14:42:00.923190 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923066    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97f9173-e041-4b6b-b91b-a542383aaf05" containerName="payload-processing"
Sep 10 14:42:00.923190 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923072    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97f9173-e041-4b6b-b91b-a542383aaf05" containerName="payload-processing"
Sep 10 14:42:00.923190 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923137    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy"
Sep 10 14:42:00.923190 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923148    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy"
Sep 10 14:42:00.923190 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923154    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0672d24-e535-4767-ad58-eab522440f11" containerName="payload-pre-processing"
Sep 10 14:42:00.923190 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.923164    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d97f9173-e041-4b6b-b91b-a542383aaf05" containerName="payload-processing"
Sep 10 14:42:00.926228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.926211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"
Sep 10 14:42:00.928330 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.928308    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:42:00.928449 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.928308    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:42:00.932471 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:00.932445    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"]
Sep 10 14:42:01.001472 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:01.001434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2006e236-c022-474c-9e3c-512917a7dd78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s\" (UID: \"2006e236-c022-474c-9e3c-512917a7dd78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"
Sep 10 14:42:01.102386 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:01.102351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2006e236-c022-474c-9e3c-512917a7dd78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s\" (UID: \"2006e236-c022-474c-9e3c-512917a7dd78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"
Sep 10 14:42:01.103002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:01.102981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2006e236-c022-474c-9e3c-512917a7dd78-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s\" (UID: \"2006e236-c022-474c-9e3c-512917a7dd78\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"
Sep 10 14:42:01.238794 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:01.238703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"
Sep 10 14:42:01.512356 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:42:01.512324    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2006e236_c022_474c_9e3c_512917a7dd78.slice/crio-68f3d9a0f526d0ddb93cde666fee6624b1a0b4016df43c6fb2d179ea8c803ff8 WatchSource:0}: Error finding container 68f3d9a0f526d0ddb93cde666fee6624b1a0b4016df43c6fb2d179ea8c803ff8: Status 404 returned error can't find the container with id 68f3d9a0f526d0ddb93cde666fee6624b1a0b4016df43c6fb2d179ea8c803ff8
Sep 10 14:42:01.512641 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:01.512620    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"]
Sep 10 14:42:01.629627 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:01.629591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s" event={"ID":"2006e236-c022-474c-9e3c-512917a7dd78","Type":"ContainerStarted","Data":"68f3d9a0f526d0ddb93cde666fee6624b1a0b4016df43c6fb2d179ea8c803ff8"}
Sep 10 14:42:02.636860 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:02.636818    2577 generic.go:356] "Generic (PLEG): container finished" podID="2006e236-c022-474c-9e3c-512917a7dd78" containerID="9b37901d2d72b08fe4862c4f0a3b29e36d585cc2d9d1c243d6fec34efa7d6092" exitCode=0
Sep 10 14:42:02.637224 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:02.636878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s" event={"ID":"2006e236-c022-474c-9e3c-512917a7dd78","Type":"ContainerDied","Data":"9b37901d2d72b08fe4862c4f0a3b29e36d585cc2d9d1c243d6fec34efa7d6092"}
Sep 10 14:42:03.780620 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:03.780592    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"
Sep 10 14:42:03.823734 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:03.823700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2006e236-c022-474c-9e3c-512917a7dd78-maas-api-service-ca\") pod \"2006e236-c022-474c-9e3c-512917a7dd78\" (UID: \"2006e236-c022-474c-9e3c-512917a7dd78\") "
Sep 10 14:42:03.824100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:03.824078    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2006e236-c022-474c-9e3c-512917a7dd78-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2006e236-c022-474c-9e3c-512917a7dd78" (UID: "2006e236-c022-474c-9e3c-512917a7dd78"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:03.924735 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:03.924635    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2006e236-c022-474c-9e3c-512917a7dd78-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:04.650443 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:04.650408    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"
Sep 10 14:42:04.650622 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:04.650410    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s" event={"ID":"2006e236-c022-474c-9e3c-512917a7dd78","Type":"ContainerDied","Data":"68f3d9a0f526d0ddb93cde666fee6624b1a0b4016df43c6fb2d179ea8c803ff8"}
Sep 10 14:42:04.650622 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:04.650514    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68f3d9a0f526d0ddb93cde666fee6624b1a0b4016df43c6fb2d179ea8c803ff8"
Sep 10 14:42:11.557444 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.557404    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"]
Sep 10 14:42:11.557886 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.557706    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96" podUID="2ead4f0c-1935-4582-8ebf-ea26e204e5cd" containerName="payload-processing" containerID="cri-o://69fea4b6409bb7dfdad0b0409c7dd167b1324f7e45e0bf65cbe7b502405a5296" gracePeriod=30
Sep 10 14:42:11.567104 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.565768    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"]
Sep 10 14:42:11.567104 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.566080    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg" podUID="c29ce006-f6d5-4382-bab6-219fc651f503" containerName="payload-pre-processing" containerID="cri-o://c94c1e0e4e851bbd0f4109a5c6ad7eeff1cb41b397573306ef9cd623c971048d" gracePeriod=30
Sep 10 14:42:11.686612 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.686582    2577 generic.go:356] "Generic (PLEG): container finished" podID="2ead4f0c-1935-4582-8ebf-ea26e204e5cd" containerID="69fea4b6409bb7dfdad0b0409c7dd167b1324f7e45e0bf65cbe7b502405a5296" exitCode=0
Sep 10 14:42:11.686782 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.686652    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96" event={"ID":"2ead4f0c-1935-4582-8ebf-ea26e204e5cd","Type":"ContainerDied","Data":"69fea4b6409bb7dfdad0b0409c7dd167b1324f7e45e0bf65cbe7b502405a5296"}
Sep 10 14:42:11.688592 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.688570    2577 generic.go:356] "Generic (PLEG): container finished" podID="c29ce006-f6d5-4382-bab6-219fc651f503" containerID="c94c1e0e4e851bbd0f4109a5c6ad7eeff1cb41b397573306ef9cd623c971048d" exitCode=0
Sep 10 14:42:11.688702 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.688610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg" event={"ID":"c29ce006-f6d5-4382-bab6-219fc651f503","Type":"ContainerDied","Data":"c94c1e0e4e851bbd0f4109a5c6ad7eeff1cb41b397573306ef9cd623c971048d"}
Sep 10 14:42:11.730147 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.729633    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"]
Sep 10 14:42:11.732965 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.732891    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-b2dfe7-r9v2s"]
Sep 10 14:42:11.857804 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.857769    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:42:11.861052 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.861030    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:42:11.904603 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.904558    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29ce006-f6d5-4382-bab6-219fc651f503-plugins-config-volume\") pod \"c29ce006-f6d5-4382-bab6-219fc651f503\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") "
Sep 10 14:42:11.904603 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.904610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-plugins-config-volume\") pod \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") "
Sep 10 14:42:11.904894 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.904733    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwgcq\" (UniqueName: \"kubernetes.io/projected/c29ce006-f6d5-4382-bab6-219fc651f503-kube-api-access-dwgcq\") pod \"c29ce006-f6d5-4382-bab6-219fc651f503\" (UID: \"c29ce006-f6d5-4382-bab6-219fc651f503\") "
Sep 10 14:42:11.904894 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.904773    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l97hx\" (UniqueName: \"kubernetes.io/projected/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-kube-api-access-l97hx\") pod \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\" (UID: \"2ead4f0c-1935-4582-8ebf-ea26e204e5cd\") "
Sep 10 14:42:11.905097 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.905062    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c29ce006-f6d5-4382-bab6-219fc651f503-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c29ce006-f6d5-4382-bab6-219fc651f503" (UID: "c29ce006-f6d5-4382-bab6-219fc651f503"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:11.905159 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.905110    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ead4f0c-1935-4582-8ebf-ea26e204e5cd" (UID: "2ead4f0c-1935-4582-8ebf-ea26e204e5cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:11.907019 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.906996    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-kube-api-access-l97hx" (OuterVolumeSpecName: "kube-api-access-l97hx") pod "2ead4f0c-1935-4582-8ebf-ea26e204e5cd" (UID: "2ead4f0c-1935-4582-8ebf-ea26e204e5cd"). InnerVolumeSpecName "kube-api-access-l97hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:11.907111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:11.907024    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29ce006-f6d5-4382-bab6-219fc651f503-kube-api-access-dwgcq" (OuterVolumeSpecName: "kube-api-access-dwgcq") pod "c29ce006-f6d5-4382-bab6-219fc651f503" (UID: "c29ce006-f6d5-4382-bab6-219fc651f503"). InnerVolumeSpecName "kube-api-access-dwgcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:12.005956 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.005921    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwgcq\" (UniqueName: \"kubernetes.io/projected/c29ce006-f6d5-4382-bab6-219fc651f503-kube-api-access-dwgcq\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:12.005956 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.005951    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l97hx\" (UniqueName: \"kubernetes.io/projected/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-kube-api-access-l97hx\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:12.005956 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.005960    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c29ce006-f6d5-4382-bab6-219fc651f503-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:12.006203 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.005971    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ead4f0c-1935-4582-8ebf-ea26e204e5cd-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:12.695347 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.695314    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"
Sep 10 14:42:12.695802 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.695314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96" event={"ID":"2ead4f0c-1935-4582-8ebf-ea26e204e5cd","Type":"ContainerDied","Data":"4ac92be71f8fbedbd5ec2bacc2a759d3c5ed29ae7db81a1aa86fc9572cc4ed6a"}
Sep 10 14:42:12.695802 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.695466    2577 scope.go:117] "RemoveContainer" containerID="69fea4b6409bb7dfdad0b0409c7dd167b1324f7e45e0bf65cbe7b502405a5296"
Sep 10 14:42:12.696890 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.696866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg" event={"ID":"c29ce006-f6d5-4382-bab6-219fc651f503","Type":"ContainerDied","Data":"7760b2570ab6489b2b0931ccef880d8b4bc2152da13837146f2f74ae3f3c4ad3"}
Sep 10 14:42:12.696954 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.696875    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"
Sep 10 14:42:12.704673 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.704631    2577 scope.go:117] "RemoveContainer" containerID="c94c1e0e4e851bbd0f4109a5c6ad7eeff1cb41b397573306ef9cd623c971048d"
Sep 10 14:42:12.720060 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.720025    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"]
Sep 10 14:42:12.722056 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.722031    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg"]
Sep 10 14:42:12.730659 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.730635    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"]
Sep 10 14:42:12.736670 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:12.736646    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96"]
Sep 10 14:42:13.510671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:13.510641    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2006e236-c022-474c-9e3c-512917a7dd78" path="/var/lib/kubelet/pods/2006e236-c022-474c-9e3c-512917a7dd78/volumes"
Sep 10 14:42:13.511100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:13.511085    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ead4f0c-1935-4582-8ebf-ea26e204e5cd" path="/var/lib/kubelet/pods/2ead4f0c-1935-4582-8ebf-ea26e204e5cd/volumes"
Sep 10 14:42:13.511448 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:13.511429    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c29ce006-f6d5-4382-bab6-219fc651f503" path="/var/lib/kubelet/pods/c29ce006-f6d5-4382-bab6-219fc651f503/volumes"
Sep 10 14:42:19.057440 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057409    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"]
Sep 10 14:42:19.057867 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057837    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ead4f0c-1935-4582-8ebf-ea26e204e5cd" containerName="payload-processing"
Sep 10 14:42:19.057915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057869    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ead4f0c-1935-4582-8ebf-ea26e204e5cd" containerName="payload-processing"
Sep 10 14:42:19.057915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057879    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c29ce006-f6d5-4382-bab6-219fc651f503" containerName="payload-pre-processing"
Sep 10 14:42:19.057915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057889    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c29ce006-f6d5-4382-bab6-219fc651f503" containerName="payload-pre-processing"
Sep 10 14:42:19.057915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057898    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2006e236-c022-474c-9e3c-512917a7dd78" containerName="revoke-keys"
Sep 10 14:42:19.057915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057906    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2006e236-c022-474c-9e3c-512917a7dd78" containerName="revoke-keys"
Sep 10 14:42:19.058092 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057924    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy"
Sep 10 14:42:19.058092 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.057931    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3bf3ec3-5188-462b-97c5-3a2a94df980d" containerName="istio-proxy"
Sep 10 14:42:19.058092 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.058002    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2006e236-c022-474c-9e3c-512917a7dd78" containerName="revoke-keys"
Sep 10 14:42:19.058092 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.058011    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c29ce006-f6d5-4382-bab6-219fc651f503" containerName="payload-pre-processing"
Sep 10 14:42:19.058092 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.058018    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ead4f0c-1935-4582-8ebf-ea26e204e5cd" containerName="payload-processing"
Sep 10 14:42:19.063005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.062980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.064781 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.064762    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-1ad4f6-openshift-default-dockercfg-mhnm5\""
Sep 10 14:42:19.073595 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.073560    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"]
Sep 10 14:42:19.173002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.172771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-credential-socket\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.172838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-certs\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.172900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-token\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.172945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-data\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.172981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-socket\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.173085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdbded2-4326-41f8-95b3-e97fef251a1c-istiod-ca-cert\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.173138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92rq\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-kube-api-access-n92rq\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.173222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-podinfo\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.173838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.173251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-envoy\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.274497 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-data\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.274497 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-socket\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.274738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdbded2-4326-41f8-95b3-e97fef251a1c-istiod-ca-cert\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.274738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92rq\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-kube-api-access-n92rq\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.274738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-podinfo\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.274738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-envoy\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.274738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-credential-socket\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.275053 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-certs\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.275053 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-token\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.275053 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-data\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.275053 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.274981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-socket\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.275269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.275206    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-certs\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.275579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.275555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdbded2-4326-41f8-95b3-e97fef251a1c-istiod-ca-cert\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.275705 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.275685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-credential-socket\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.277202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.277179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-envoy\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.277422 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.277401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-podinfo\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.283390 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.283357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-token\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.283497 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.283433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92rq\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-kube-api-access-n92rq\") pod \"e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") " pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.375806 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.375772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:19.654481 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.654451    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"]
Sep 10 14:42:19.656715 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:42:19.656687    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdbded2_4326_41f8_95b3_e97fef251a1c.slice/crio-895f35ee86f44ee71828a96e04af9950615c3684541e36512f3255031acecff2 WatchSource:0}: Error finding container 895f35ee86f44ee71828a96e04af9950615c3684541e36512f3255031acecff2: Status 404 returned error can't find the container with id 895f35ee86f44ee71828a96e04af9950615c3684541e36512f3255031acecff2
Sep 10 14:42:19.659129 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.659091    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:42:19.659197 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.659178    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:42:19.659241 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.659223    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:42:19.743389 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.743342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq" event={"ID":"bfdbded2-4326-41f8-95b3-e97fef251a1c","Type":"ContainerStarted","Data":"b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d"}
Sep 10 14:42:19.743590 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.743416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq" event={"ID":"bfdbded2-4326-41f8-95b3-e97fef251a1c","Type":"ContainerStarted","Data":"895f35ee86f44ee71828a96e04af9950615c3684541e36512f3255031acecff2"}
Sep 10 14:42:19.761260 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:19.761202    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq" podStartSLOduration=0.761179524 podStartE2EDuration="761.179524ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:42:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:42:19.759991941 +0000 UTC m=+1350.737121302" watchObservedRunningTime="2026-09-10 14:42:19.761179524 +0000 UTC m=+1350.738308878"
Sep 10 14:42:20.376391 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:20.376343    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:20.381223 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:20.381198    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:20.748580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:20.748501    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:20.749456 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:20.749438    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:38.285622 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:38.285585    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"]
Sep 10 14:42:38.286116 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:38.285800    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq" podUID="bfdbded2-4326-41f8-95b3-e97fef251a1c" containerName="istio-proxy" containerID="cri-o://b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d" gracePeriod=30
Sep 10 14:42:43.540328 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.540296    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:43.612981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.612895    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-podinfo\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.612981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.612942    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-envoy\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613217 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.612985    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n92rq\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-kube-api-access-n92rq\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613217 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613016    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-token\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613217 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613047    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-certs\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613217 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613082    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-credential-socket\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613217 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613155    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-data\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613222    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdbded2-4326-41f8-95b3-e97fef251a1c-istiod-ca-cert\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:43.613478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613437    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:43.613618 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613470    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:43.613618 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613538    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-socket\") pod \"bfdbded2-4326-41f8-95b3-e97fef251a1c\" (UID: \"bfdbded2-4326-41f8-95b3-e97fef251a1c\") "
Sep 10 14:42:43.613835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613813    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:43.613952 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.613863    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfdbded2-4326-41f8-95b3-e97fef251a1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:43.614054 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.614037    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.614095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.614061    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfdbded2-4326-41f8-95b3-e97fef251a1c-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.614095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.614077    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.614095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.614091    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.614198 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.614105    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.615370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.615330    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:42:43.615370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.615347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:43.615649 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.615620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-kube-api-access-n92rq" (OuterVolumeSpecName: "kube-api-access-n92rq") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "kube-api-access-n92rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:43.615649 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.615629    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfdbded2-4326-41f8-95b3-e97fef251a1c" (UID: "bfdbded2-4326-41f8-95b3-e97fef251a1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:43.715312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.715274    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.715312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.715304    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.715312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.715314    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfdbded2-4326-41f8-95b3-e97fef251a1c-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.715312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.715323    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n92rq\" (UniqueName: \"kubernetes.io/projected/bfdbded2-4326-41f8-95b3-e97fef251a1c-kube-api-access-n92rq\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:43.866413 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.866382    2577 generic.go:356] "Generic (PLEG): container finished" podID="bfdbded2-4326-41f8-95b3-e97fef251a1c" containerID="b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d" exitCode=0
Sep 10 14:42:43.866582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.866427    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq" event={"ID":"bfdbded2-4326-41f8-95b3-e97fef251a1c","Type":"ContainerDied","Data":"b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d"}
Sep 10 14:42:43.866582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.866427    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"
Sep 10 14:42:43.866582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.866474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq" event={"ID":"bfdbded2-4326-41f8-95b3-e97fef251a1c","Type":"ContainerDied","Data":"895f35ee86f44ee71828a96e04af9950615c3684541e36512f3255031acecff2"}
Sep 10 14:42:43.866582 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.866495    2577 scope.go:117] "RemoveContainer" containerID="b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d"
Sep 10 14:42:43.875770 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.875748    2577 scope.go:117] "RemoveContainer" containerID="b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d"
Sep 10 14:42:43.876099 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:42:43.876080    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d\": container with ID starting with b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d not found: ID does not exist" containerID="b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d"
Sep 10 14:42:43.876161 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.876107    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d"} err="failed to get container status \"b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d\": rpc error: code = NotFound desc = could not find container \"b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d\": container with ID starting with b8ee7f980f1af49c3afba6aa49ca4a44758511bc0c38dc135f1ee4378f936f5d not found: ID does not exist"
Sep 10 14:42:43.887580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.887549    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"]
Sep 10 14:42:43.891267 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:43.891243    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq"]
Sep 10 14:42:45.518958 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:45.518918    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfdbded2-4326-41f8-95b3-e97fef251a1c" path="/var/lib/kubelet/pods/bfdbded2-4326-41f8-95b3-e97fef251a1c/volumes"
Sep 10 14:42:52.962789 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:52.962573    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"]
Sep 10 14:42:52.963579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:52.962936    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv" podUID="8908a08a-7cfb-44fb-84ab-88e6005239ad" containerName="payload-processing" containerID="cri-o://f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491" gracePeriod=30
Sep 10 14:42:52.971493 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:52.971027    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"]
Sep 10 14:42:52.971493 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:52.971287    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd" podUID="62351422-d817-4a66-9983-79741d138c23" containerName="payload-pre-processing" containerID="cri-o://7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d" gracePeriod=30
Sep 10 14:42:53.246084 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.246060    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:42:53.249032 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.249012    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:42:53.307981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.307950    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/8908a08a-7cfb-44fb-84ab-88e6005239ad-kube-api-access-c2v7v\") pod \"8908a08a-7cfb-44fb-84ab-88e6005239ad\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") "
Sep 10 14:42:53.307981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.307995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62351422-d817-4a66-9983-79741d138c23-plugins-config-volume\") pod \"62351422-d817-4a66-9983-79741d138c23\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") "
Sep 10 14:42:53.308251 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.308048    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8908a08a-7cfb-44fb-84ab-88e6005239ad-plugins-config-volume\") pod \"8908a08a-7cfb-44fb-84ab-88e6005239ad\" (UID: \"8908a08a-7cfb-44fb-84ab-88e6005239ad\") "
Sep 10 14:42:53.308251 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.308080    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp9pw\" (UniqueName: \"kubernetes.io/projected/62351422-d817-4a66-9983-79741d138c23-kube-api-access-xp9pw\") pod \"62351422-d817-4a66-9983-79741d138c23\" (UID: \"62351422-d817-4a66-9983-79741d138c23\") "
Sep 10 14:42:53.308490 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.308457    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62351422-d817-4a66-9983-79741d138c23-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62351422-d817-4a66-9983-79741d138c23" (UID: "62351422-d817-4a66-9983-79741d138c23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:53.308772 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.308743    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8908a08a-7cfb-44fb-84ab-88e6005239ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8908a08a-7cfb-44fb-84ab-88e6005239ad" (UID: "8908a08a-7cfb-44fb-84ab-88e6005239ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:53.310577 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.310551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8908a08a-7cfb-44fb-84ab-88e6005239ad-kube-api-access-c2v7v" (OuterVolumeSpecName: "kube-api-access-c2v7v") pod "8908a08a-7cfb-44fb-84ab-88e6005239ad" (UID: "8908a08a-7cfb-44fb-84ab-88e6005239ad"). InnerVolumeSpecName "kube-api-access-c2v7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:53.310692 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.310671    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62351422-d817-4a66-9983-79741d138c23-kube-api-access-xp9pw" (OuterVolumeSpecName: "kube-api-access-xp9pw") pod "62351422-d817-4a66-9983-79741d138c23" (UID: "62351422-d817-4a66-9983-79741d138c23"). InnerVolumeSpecName "kube-api-access-xp9pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:53.409469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.409421    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2v7v\" (UniqueName: \"kubernetes.io/projected/8908a08a-7cfb-44fb-84ab-88e6005239ad-kube-api-access-c2v7v\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:53.409469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.409460    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62351422-d817-4a66-9983-79741d138c23-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:53.409469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.409473    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8908a08a-7cfb-44fb-84ab-88e6005239ad-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:53.409718 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.409484    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp9pw\" (UniqueName: \"kubernetes.io/projected/62351422-d817-4a66-9983-79741d138c23-kube-api-access-xp9pw\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:42:53.923854 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.923805    2577 generic.go:356] "Generic (PLEG): container finished" podID="62351422-d817-4a66-9983-79741d138c23" containerID="7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d" exitCode=0
Sep 10 14:42:53.924094 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.923882    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"
Sep 10 14:42:53.924094 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.923939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd" event={"ID":"62351422-d817-4a66-9983-79741d138c23","Type":"ContainerDied","Data":"7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d"}
Sep 10 14:42:53.924094 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.924011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd" event={"ID":"62351422-d817-4a66-9983-79741d138c23","Type":"ContainerDied","Data":"94c86a5b62e4369e3e41113506c8f4995c1aa29966c7707e35d9f48fe27b07a2"}
Sep 10 14:42:53.924094 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.924045    2577 scope.go:117] "RemoveContainer" containerID="7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d"
Sep 10 14:42:53.926098 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.926063    2577 generic.go:356] "Generic (PLEG): container finished" podID="8908a08a-7cfb-44fb-84ab-88e6005239ad" containerID="f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491" exitCode=0
Sep 10 14:42:53.926231 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.926144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv" event={"ID":"8908a08a-7cfb-44fb-84ab-88e6005239ad","Type":"ContainerDied","Data":"f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491"}
Sep 10 14:42:53.926231 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.926187    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv" event={"ID":"8908a08a-7cfb-44fb-84ab-88e6005239ad","Type":"ContainerDied","Data":"39db22cdb80b4fe782f3b1fcb90e88de5e984046683f9bdaf9be25ee9737eb12"}
Sep 10 14:42:53.926361 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.926252    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"
Sep 10 14:42:53.935580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.935553    2577 scope.go:117] "RemoveContainer" containerID="7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d"
Sep 10 14:42:53.935954 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:42:53.935925    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d\": container with ID starting with 7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d not found: ID does not exist" containerID="7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d"
Sep 10 14:42:53.936065 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.935959    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d"} err="failed to get container status \"7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d\": rpc error: code = NotFound desc = could not find container \"7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d\": container with ID starting with 7c469e2f857020b795caf7504362937425ed3774196c5bdea6cb7da84015e35d not found: ID does not exist"
Sep 10 14:42:53.936065 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.935977    2577 scope.go:117] "RemoveContainer" containerID="f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491"
Sep 10 14:42:53.945162 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.945131    2577 scope.go:117] "RemoveContainer" containerID="f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491"
Sep 10 14:42:53.945480 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:42:53.945462    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491\": container with ID starting with f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491 not found: ID does not exist" containerID="f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491"
Sep 10 14:42:53.945552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.945495    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491"} err="failed to get container status \"f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491\": rpc error: code = NotFound desc = could not find container \"f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491\": container with ID starting with f411f169fe7d29a10c61f563128167d82979351bd99c6c8b1755904b1186b491 not found: ID does not exist"
Sep 10 14:42:53.946552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.946534    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"]
Sep 10 14:42:53.950035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.950012    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv"]
Sep 10 14:42:53.962496 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.962470    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"]
Sep 10 14:42:53.966503 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:53.966481    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd"]
Sep 10 14:42:55.511679 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:55.511645    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62351422-d817-4a66-9983-79741d138c23" path="/var/lib/kubelet/pods/62351422-d817-4a66-9983-79741d138c23/volumes"
Sep 10 14:42:55.512111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:42:55.512094    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8908a08a-7cfb-44fb-84ab-88e6005239ad" path="/var/lib/kubelet/pods/8908a08a-7cfb-44fb-84ab-88e6005239ad/volumes"
Sep 10 14:43:00.104926 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.104893    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"]
Sep 10 14:43:00.105317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105256    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfdbded2-4326-41f8-95b3-e97fef251a1c" containerName="istio-proxy"
Sep 10 14:43:00.105317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105266    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfdbded2-4326-41f8-95b3-e97fef251a1c" containerName="istio-proxy"
Sep 10 14:43:00.105317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105293    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62351422-d817-4a66-9983-79741d138c23" containerName="payload-pre-processing"
Sep 10 14:43:00.105317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105298    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="62351422-d817-4a66-9983-79741d138c23" containerName="payload-pre-processing"
Sep 10 14:43:00.105317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105306    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8908a08a-7cfb-44fb-84ab-88e6005239ad" containerName="payload-processing"
Sep 10 14:43:00.105317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105312    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8908a08a-7cfb-44fb-84ab-88e6005239ad" containerName="payload-processing"
Sep 10 14:43:00.105508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105367    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8908a08a-7cfb-44fb-84ab-88e6005239ad" containerName="payload-processing"
Sep 10 14:43:00.105508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105374    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfdbded2-4326-41f8-95b3-e97fef251a1c" containerName="istio-proxy"
Sep 10 14:43:00.105508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.105382    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="62351422-d817-4a66-9983-79741d138c23" containerName="payload-pre-processing"
Sep 10 14:43:00.109925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.109900    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"
Sep 10 14:43:00.111737 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.111716    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:43:00.111812 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.111771    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:43:00.115073 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.115043    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"]
Sep 10 14:43:00.178833 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.178795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbaad78-3b8b-48a1-a567-82e31bf2c26e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq\" (UID: \"1dbaad78-3b8b-48a1-a567-82e31bf2c26e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"
Sep 10 14:43:00.280405 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.280363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbaad78-3b8b-48a1-a567-82e31bf2c26e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq\" (UID: \"1dbaad78-3b8b-48a1-a567-82e31bf2c26e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"
Sep 10 14:43:00.281015 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.280995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbaad78-3b8b-48a1-a567-82e31bf2c26e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq\" (UID: \"1dbaad78-3b8b-48a1-a567-82e31bf2c26e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"
Sep 10 14:43:00.422930 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.422875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"
Sep 10 14:43:00.694738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.694706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"]
Sep 10 14:43:00.697499 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:43:00.697457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbaad78_3b8b_48a1_a567_82e31bf2c26e.slice/crio-1f8cf8e7ccbdaa297024e3d6d6af104a66a33ee6216b3bdf464e57263f4e0f11 WatchSource:0}: Error finding container 1f8cf8e7ccbdaa297024e3d6d6af104a66a33ee6216b3bdf464e57263f4e0f11: Status 404 returned error can't find the container with id 1f8cf8e7ccbdaa297024e3d6d6af104a66a33ee6216b3bdf464e57263f4e0f11
Sep 10 14:43:00.969469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:00.969377    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq" event={"ID":"1dbaad78-3b8b-48a1-a567-82e31bf2c26e","Type":"ContainerStarted","Data":"1f8cf8e7ccbdaa297024e3d6d6af104a66a33ee6216b3bdf464e57263f4e0f11"}
Sep 10 14:43:01.976019 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:01.975980    2577 generic.go:356] "Generic (PLEG): container finished" podID="1dbaad78-3b8b-48a1-a567-82e31bf2c26e" containerID="8870254608c6c87667a3eb5a2bf90280be4b4e70a2b78898b654731aad57a1fc" exitCode=0
Sep 10 14:43:01.976577 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:01.976061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq" event={"ID":"1dbaad78-3b8b-48a1-a567-82e31bf2c26e","Type":"ContainerDied","Data":"8870254608c6c87667a3eb5a2bf90280be4b4e70a2b78898b654731aad57a1fc"}
Sep 10 14:43:03.117647 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.117619    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"
Sep 10 14:43:03.210278 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.210230    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbaad78-3b8b-48a1-a567-82e31bf2c26e-maas-api-service-ca\") pod \"1dbaad78-3b8b-48a1-a567-82e31bf2c26e\" (UID: \"1dbaad78-3b8b-48a1-a567-82e31bf2c26e\") "
Sep 10 14:43:03.210609 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.210584    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbaad78-3b8b-48a1-a567-82e31bf2c26e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1dbaad78-3b8b-48a1-a567-82e31bf2c26e" (UID: "1dbaad78-3b8b-48a1-a567-82e31bf2c26e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:03.305637 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.305532    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"]
Sep 10 14:43:03.306191 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.306172    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbaad78-3b8b-48a1-a567-82e31bf2c26e" containerName="revoke-keys"
Sep 10 14:43:03.306191 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.306192    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbaad78-3b8b-48a1-a567-82e31bf2c26e" containerName="revoke-keys"
Sep 10 14:43:03.306362 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.306289    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dbaad78-3b8b-48a1-a567-82e31bf2c26e" containerName="revoke-keys"
Sep 10 14:43:03.310001 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.309982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.311593 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.311568    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dbaad78-3b8b-48a1-a567-82e31bf2c26e-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.312396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.312372    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-db3978e3-openshift-default-dockercfg-dztch\""
Sep 10 14:43:03.320464 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.320441    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"]
Sep 10 14:43:03.412810 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.412772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-certs\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.412820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-envoy\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.412959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-data\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413091 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.413003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-socket\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413091 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.413056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-podinfo\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413091 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.413085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-token\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413187 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.413144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-credential-socket\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413187 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.413163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istiod-ca-cert\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.413187 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.413180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drfjm\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-kube-api-access-drfjm\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.513748 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.513716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-socket\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.513928 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.513761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-podinfo\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.513928 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.513798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-token\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.513928 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.513878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-credential-socket\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.513928 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.513915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istiod-ca-cert\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.513939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drfjm\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-kube-api-access-drfjm\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.513977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-certs\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514274 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.514195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-envoy\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514274 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.514203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-socket\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514274 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.514256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-credential-socket\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514431 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.514307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-data\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514489 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.514454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-certs\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.514594 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.514561    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-data\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.515135 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.515109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istiod-ca-cert\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.516494 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.516463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-envoy\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.516635 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.516617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-podinfo\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.521632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.521608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-token\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.521724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.521687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drfjm\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-kube-api-access-drfjm\") pod \"e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") " pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.623704 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.623670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:03.899458 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.899431    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"]
Sep 10 14:43:03.901509 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:43:03.901483    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79daee80_cfc6_4dcb_bbe0_c999edc10a17.slice/crio-ce891dfc0c0344d93866fcbef2f6c6cf70c8255782c7bfdad475d763d746cf90 WatchSource:0}: Error finding container ce891dfc0c0344d93866fcbef2f6c6cf70c8255782c7bfdad475d763d746cf90: Status 404 returned error can't find the container with id ce891dfc0c0344d93866fcbef2f6c6cf70c8255782c7bfdad475d763d746cf90
Sep 10 14:43:03.903764 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.903731    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:43:03.903857 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.903802    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:43:03.903906 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.903873    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:43:03.987741 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.987706    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"
Sep 10 14:43:03.987741 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.987717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq" event={"ID":"1dbaad78-3b8b-48a1-a567-82e31bf2c26e","Type":"ContainerDied","Data":"1f8cf8e7ccbdaa297024e3d6d6af104a66a33ee6216b3bdf464e57263f4e0f11"}
Sep 10 14:43:03.988025 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.987782    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f8cf8e7ccbdaa297024e3d6d6af104a66a33ee6216b3bdf464e57263f4e0f11"
Sep 10 14:43:03.989630 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.989600    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" event={"ID":"79daee80-cfc6-4dcb-bbe0-c999edc10a17","Type":"ContainerStarted","Data":"c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1"}
Sep 10 14:43:03.989748 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:03.989657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" event={"ID":"79daee80-cfc6-4dcb-bbe0-c999edc10a17","Type":"ContainerStarted","Data":"ce891dfc0c0344d93866fcbef2f6c6cf70c8255782c7bfdad475d763d746cf90"}
Sep 10 14:43:04.009051 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:04.009002    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podStartSLOduration=1.008983915 podStartE2EDuration="1.008983915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:04.007519033 +0000 UTC m=+1394.984648388" watchObservedRunningTime="2026-09-10 14:43:04.008983915 +0000 UTC m=+1394.986113268"
Sep 10 14:43:04.624775 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:04.624736    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:04.630075 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:04.630047    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:04.994826 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:04.994786    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:04.995921 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:04.995894    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:07.887931 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.887881    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"]
Sep 10 14:43:07.891449 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.891431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:07.893838 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.893814    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-db3978e3\""
Sep 10 14:43:07.902797 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.902771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"]
Sep 10 14:43:07.960169 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.960128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5dabff-ab48-47cb-a55d-ed7270348213-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:07.960348 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.960246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl8hf\" (UniqueName: \"kubernetes.io/projected/8c5dabff-ab48-47cb-a55d-ed7270348213-kube-api-access-fl8hf\") pod \"payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:07.979966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.979935    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"]
Sep 10 14:43:07.983199 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.983182    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:07.985248 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.985224    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-db3978e3-dockercfg-4grpn\""
Sep 10 14:43:07.991407 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:07.991383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"]
Sep 10 14:43:08.061368 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.061331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5dabff-ab48-47cb-a55d-ed7270348213-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:08.061525 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.061381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-plugins-config-volume\") pod \"payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") " pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:08.061525 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.061419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54cxs\" (UniqueName: \"kubernetes.io/projected/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-kube-api-access-54cxs\") pod \"payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") " pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:08.061525 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.061459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8hf\" (UniqueName: \"kubernetes.io/projected/8c5dabff-ab48-47cb-a55d-ed7270348213-kube-api-access-fl8hf\") pod \"payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:08.062115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.062095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5dabff-ab48-47cb-a55d-ed7270348213-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:08.069477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.069448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl8hf\" (UniqueName: \"kubernetes.io/projected/8c5dabff-ab48-47cb-a55d-ed7270348213-kube-api-access-fl8hf\") pod \"payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:08.163227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.163129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-plugins-config-volume\") pod \"payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") " pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:08.163227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.163182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54cxs\" (UniqueName: \"kubernetes.io/projected/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-kube-api-access-54cxs\") pod \"payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") " pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:08.163940 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.163920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-plugins-config-volume\") pod \"payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") " pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:08.171941 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.171911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54cxs\" (UniqueName: \"kubernetes.io/projected/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-kube-api-access-54cxs\") pod \"payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") " pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:08.203817 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.203775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:08.295317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.295283    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:08.474357 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.474326    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"]
Sep 10 14:43:08.476393 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:43:08.476365    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5dabff_ab48_47cb_a55d_ed7270348213.slice/crio-8153d6e280d904abc6f66c3fbe7b5d9d3cd707b7cfe7c2cb47b0ec7547c87bf2 WatchSource:0}: Error finding container 8153d6e280d904abc6f66c3fbe7b5d9d3cd707b7cfe7c2cb47b0ec7547c87bf2: Status 404 returned error can't find the container with id 8153d6e280d904abc6f66c3fbe7b5d9d3cd707b7cfe7c2cb47b0ec7547c87bf2
Sep 10 14:43:08.571757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:08.571575    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"]
Sep 10 14:43:08.574577 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:43:08.574549    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdea8f6_3eec_4ee2_b5a8_a34575e6ef10.slice/crio-29e693f17e4984568a3d0f30a676c084dda8ba5df9c53e51b37b049fb654a190 WatchSource:0}: Error finding container 29e693f17e4984568a3d0f30a676c084dda8ba5df9c53e51b37b049fb654a190: Status 404 returned error can't find the container with id 29e693f17e4984568a3d0f30a676c084dda8ba5df9c53e51b37b049fb654a190
Sep 10 14:43:09.020583 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.020546    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8" event={"ID":"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10","Type":"ContainerStarted","Data":"465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0"}
Sep 10 14:43:09.021112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.020601    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8" event={"ID":"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10","Type":"ContainerStarted","Data":"29e693f17e4984568a3d0f30a676c084dda8ba5df9c53e51b37b049fb654a190"}
Sep 10 14:43:09.021112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.020665    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:09.022405 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.022378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh" event={"ID":"8c5dabff-ab48-47cb-a55d-ed7270348213","Type":"ContainerStarted","Data":"da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305"}
Sep 10 14:43:09.022515 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.022423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh" event={"ID":"8c5dabff-ab48-47cb-a55d-ed7270348213","Type":"ContainerStarted","Data":"8153d6e280d904abc6f66c3fbe7b5d9d3cd707b7cfe7c2cb47b0ec7547c87bf2"}
Sep 10 14:43:09.022515 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.022457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:09.036260 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.036132    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8" podStartSLOduration=2.036112124 podStartE2EDuration="2.036112124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:09.035280067 +0000 UTC m=+1400.012409422" watchObservedRunningTime="2026-09-10 14:43:09.036112124 +0000 UTC m=+1400.013241480"
Sep 10 14:43:09.053062 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:09.053006    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh" podStartSLOduration=2.052986814 podStartE2EDuration="2.052986814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:09.049603707 +0000 UTC m=+1400.026733062" watchObservedRunningTime="2026-09-10 14:43:09.052986814 +0000 UTC m=+1400.030116170"
Sep 10 14:43:11.119312 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.119277    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"]
Sep 10 14:43:11.120130 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.120095    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r" podUID="7cd5992b-c663-4724-8fcf-a1728d6c0090" containerName="payload-pre-processing" containerID="cri-o://a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe" gracePeriod=30
Sep 10 14:43:11.375246 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.375178    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:43:11.393870 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.393620    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"]
Sep 10 14:43:11.410865 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.409048    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2365fe-5rzrq"]
Sep 10 14:43:11.497191 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.497156    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7tfz\" (UniqueName: \"kubernetes.io/projected/7cd5992b-c663-4724-8fcf-a1728d6c0090-kube-api-access-w7tfz\") pod \"7cd5992b-c663-4724-8fcf-a1728d6c0090\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") "
Sep 10 14:43:11.497340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.497236    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd5992b-c663-4724-8fcf-a1728d6c0090-plugins-config-volume\") pod \"7cd5992b-c663-4724-8fcf-a1728d6c0090\" (UID: \"7cd5992b-c663-4724-8fcf-a1728d6c0090\") "
Sep 10 14:43:11.497662 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.497628    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cd5992b-c663-4724-8fcf-a1728d6c0090-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7cd5992b-c663-4724-8fcf-a1728d6c0090" (UID: "7cd5992b-c663-4724-8fcf-a1728d6c0090"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:11.499377 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.499346    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd5992b-c663-4724-8fcf-a1728d6c0090-kube-api-access-w7tfz" (OuterVolumeSpecName: "kube-api-access-w7tfz") pod "7cd5992b-c663-4724-8fcf-a1728d6c0090" (UID: "7cd5992b-c663-4724-8fcf-a1728d6c0090"). InnerVolumeSpecName "kube-api-access-w7tfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:11.510648 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.510621    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbaad78-3b8b-48a1-a567-82e31bf2c26e" path="/var/lib/kubelet/pods/1dbaad78-3b8b-48a1-a567-82e31bf2c26e/volumes"
Sep 10 14:43:11.599101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.599059    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7tfz\" (UniqueName: \"kubernetes.io/projected/7cd5992b-c663-4724-8fcf-a1728d6c0090-kube-api-access-w7tfz\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:11.599101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:11.599093    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd5992b-c663-4724-8fcf-a1728d6c0090-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:12.041520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.041482    2577 generic.go:356] "Generic (PLEG): container finished" podID="7cd5992b-c663-4724-8fcf-a1728d6c0090" containerID="a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe" exitCode=0
Sep 10 14:43:12.041733 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.041531    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"
Sep 10 14:43:12.041733 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.041560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r" event={"ID":"7cd5992b-c663-4724-8fcf-a1728d6c0090","Type":"ContainerDied","Data":"a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe"}
Sep 10 14:43:12.041733 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.041612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r" event={"ID":"7cd5992b-c663-4724-8fcf-a1728d6c0090","Type":"ContainerDied","Data":"eb4ce4c88bf64f251346b2a4d1a2851bf4478dfff1dc3bfcbb1b3b4d00705646"}
Sep 10 14:43:12.041733 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.041635    2577 scope.go:117] "RemoveContainer" containerID="a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe"
Sep 10 14:43:12.050481 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.050459    2577 scope.go:117] "RemoveContainer" containerID="a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe"
Sep 10 14:43:12.050793 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:43:12.050773    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe\": container with ID starting with a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe not found: ID does not exist" containerID="a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe"
Sep 10 14:43:12.050873 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.050801    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe"} err="failed to get container status \"a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe\": rpc error: code = NotFound desc = could not find container \"a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe\": container with ID starting with a35ff2e99eff6f38d7bf677293e97f5b1f226fc6f157c469dafa843147ef5dfe not found: ID does not exist"
Sep 10 14:43:12.056552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.056521    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"]
Sep 10 14:43:12.059709 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:12.059687    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r"]
Sep 10 14:43:13.510400 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:13.510372    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd5992b-c663-4724-8fcf-a1728d6c0090" path="/var/lib/kubelet/pods/7cd5992b-c663-4724-8fcf-a1728d6c0090/volumes"
Sep 10 14:43:20.031237 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:20.031204    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:20.031789 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:20.031284    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:21.038310 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:21.037010    2577 patch_prober.go:28] interesting pod/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:43:21.038310 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:21.037089    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:43:22.122869 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:22.122814    2577 generic.go:356] "Generic (PLEG): container finished" podID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerID="c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1" exitCode=0
Sep 10 14:43:22.123284 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:22.122882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" event={"ID":"79daee80-cfc6-4dcb-bbe0-c999edc10a17","Type":"ContainerDied","Data":"c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1"}
Sep 10 14:43:22.123379 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:22.123284    2577 scope.go:117] "RemoveContainer" containerID="c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1"
Sep 10 14:43:22.124326 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:22.124294    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:43:22.124417 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:22.124362    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:43:22.124417 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:22.124393    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:43:23.131197 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:23.131161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" event={"ID":"79daee80-cfc6-4dcb-bbe0-c999edc10a17","Type":"ContainerStarted","Data":"333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813"}
Sep 10 14:43:23.624280 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:23.624248    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:23.624452 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:23.624436    2577 patch_prober.go:28] interesting pod/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:43:23.624504 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:23.624489    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 14:43:24.625013 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:24.624978    2577 patch_prober.go:28] interesting pod/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:43:24.625409 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:24.625037    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 14:43:25.624714 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:25.624675    2577 patch_prober.go:28] interesting pod/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:43:25.624916 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:25.624732    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 14:43:26.624265 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:26.624224    2577 patch_prober.go:28] interesting pod/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:43:26.624671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:26.624281    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 14:43:27.624759 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:27.624717    2577 patch_prober.go:28] interesting pod/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 10 14:43:27.625194 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:27.624777    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 10 14:43:28.627455 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:28.627426    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:28.627893 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:28.627733    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:28.628300 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:28.628283    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:43:38.432565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.432530    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"]
Sep 10 14:43:38.432994 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.432967    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd5992b-c663-4724-8fcf-a1728d6c0090" containerName="payload-pre-processing"
Sep 10 14:43:38.432994 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.432981    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd5992b-c663-4724-8fcf-a1728d6c0090" containerName="payload-pre-processing"
Sep 10 14:43:38.433074 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.433048    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd5992b-c663-4724-8fcf-a1728d6c0090" containerName="payload-pre-processing"
Sep 10 14:43:38.435542 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.435526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"
Sep 10 14:43:38.437534 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.437510    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:43:38.437677 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.437566    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:43:38.442669 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.442632    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"]
Sep 10 14:43:38.573822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.573789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5da5806-1ee5-4a1d-af7d-05626591696f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db3978e3-jccqs\" (UID: \"d5da5806-1ee5-4a1d-af7d-05626591696f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"
Sep 10 14:43:38.674538 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.674491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5da5806-1ee5-4a1d-af7d-05626591696f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db3978e3-jccqs\" (UID: \"d5da5806-1ee5-4a1d-af7d-05626591696f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"
Sep 10 14:43:38.675194 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.675167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5da5806-1ee5-4a1d-af7d-05626591696f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db3978e3-jccqs\" (UID: \"d5da5806-1ee5-4a1d-af7d-05626591696f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"
Sep 10 14:43:38.747275 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:38.747190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"
Sep 10 14:43:39.034133 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:39.034104    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"]
Sep 10 14:43:39.036347 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:43:39.036321    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5da5806_1ee5_4a1d_af7d_05626591696f.slice/crio-cb079d80bad6d125b455b121ff49722b8eedc2a144b96045f4937bedb927f213 WatchSource:0}: Error finding container cb079d80bad6d125b455b121ff49722b8eedc2a144b96045f4937bedb927f213: Status 404 returned error can't find the container with id cb079d80bad6d125b455b121ff49722b8eedc2a144b96045f4937bedb927f213
Sep 10 14:43:39.214230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:39.214195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs" event={"ID":"d5da5806-1ee5-4a1d-af7d-05626591696f","Type":"ContainerStarted","Data":"cb079d80bad6d125b455b121ff49722b8eedc2a144b96045f4937bedb927f213"}
Sep 10 14:43:40.221880 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:40.221825    2577 generic.go:356] "Generic (PLEG): container finished" podID="d5da5806-1ee5-4a1d-af7d-05626591696f" containerID="44c8cf1d024136be937625a9e02bf31841d9cf36b88c2ed657eaad273ec25cf9" exitCode=0
Sep 10 14:43:40.222340 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:40.221895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs" event={"ID":"d5da5806-1ee5-4a1d-af7d-05626591696f","Type":"ContainerDied","Data":"44c8cf1d024136be937625a9e02bf31841d9cf36b88c2ed657eaad273ec25cf9"}
Sep 10 14:43:41.358313 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:41.358285    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"
Sep 10 14:43:41.503548 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:41.503460    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5da5806-1ee5-4a1d-af7d-05626591696f-maas-api-service-ca\") pod \"d5da5806-1ee5-4a1d-af7d-05626591696f\" (UID: \"d5da5806-1ee5-4a1d-af7d-05626591696f\") "
Sep 10 14:43:41.503822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:41.503797    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5da5806-1ee5-4a1d-af7d-05626591696f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5da5806-1ee5-4a1d-af7d-05626591696f" (UID: "d5da5806-1ee5-4a1d-af7d-05626591696f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:41.604716 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:41.604682    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5da5806-1ee5-4a1d-af7d-05626591696f-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:42.233748 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:42.233710    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs" event={"ID":"d5da5806-1ee5-4a1d-af7d-05626591696f","Type":"ContainerDied","Data":"cb079d80bad6d125b455b121ff49722b8eedc2a144b96045f4937bedb927f213"}
Sep 10 14:43:42.233951 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:42.233768    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb079d80bad6d125b455b121ff49722b8eedc2a144b96045f4937bedb927f213"
Sep 10 14:43:42.233951 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:42.233721    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"
Sep 10 14:43:49.363998 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.363836    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"]
Sep 10 14:43:49.364497 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.364078    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8" podUID="9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" containerName="payload-processing" containerID="cri-o://465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0" gracePeriod=30
Sep 10 14:43:49.368864 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.368820    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"]
Sep 10 14:43:49.369269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.369239    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh" podUID="8c5dabff-ab48-47cb-a55d-ed7270348213" containerName="payload-pre-processing" containerID="cri-o://da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305" gracePeriod=30
Sep 10 14:43:49.529127 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.529096    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"]
Sep 10 14:43:49.533750 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.533725    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db3978e3-jccqs"]
Sep 10 14:43:49.642430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.642405    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:49.644796 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.644777    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:49.795940 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.795908    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5dabff-ab48-47cb-a55d-ed7270348213-plugins-config-volume\") pod \"8c5dabff-ab48-47cb-a55d-ed7270348213\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") "
Sep 10 14:43:49.796136 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.796008    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl8hf\" (UniqueName: \"kubernetes.io/projected/8c5dabff-ab48-47cb-a55d-ed7270348213-kube-api-access-fl8hf\") pod \"8c5dabff-ab48-47cb-a55d-ed7270348213\" (UID: \"8c5dabff-ab48-47cb-a55d-ed7270348213\") "
Sep 10 14:43:49.796136 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.796053    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-plugins-config-volume\") pod \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") "
Sep 10 14:43:49.796136 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.796097    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54cxs\" (UniqueName: \"kubernetes.io/projected/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-kube-api-access-54cxs\") pod \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\" (UID: \"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10\") "
Sep 10 14:43:49.796406 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.796380    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c5dabff-ab48-47cb-a55d-ed7270348213-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8c5dabff-ab48-47cb-a55d-ed7270348213" (UID: "8c5dabff-ab48-47cb-a55d-ed7270348213"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:49.796406 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.796399    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" (UID: "9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:49.798234 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.798206    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-kube-api-access-54cxs" (OuterVolumeSpecName: "kube-api-access-54cxs") pod "9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" (UID: "9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10"). InnerVolumeSpecName "kube-api-access-54cxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:49.798309 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.798249    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5dabff-ab48-47cb-a55d-ed7270348213-kube-api-access-fl8hf" (OuterVolumeSpecName: "kube-api-access-fl8hf") pod "8c5dabff-ab48-47cb-a55d-ed7270348213" (UID: "8c5dabff-ab48-47cb-a55d-ed7270348213"). InnerVolumeSpecName "kube-api-access-fl8hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:49.897463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.897371    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54cxs\" (UniqueName: \"kubernetes.io/projected/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-kube-api-access-54cxs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:49.897463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.897405    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c5dabff-ab48-47cb-a55d-ed7270348213-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:49.897463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.897414    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl8hf\" (UniqueName: \"kubernetes.io/projected/8c5dabff-ab48-47cb-a55d-ed7270348213-kube-api-access-fl8hf\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:49.897463 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:49.897425    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:43:50.279587 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.279505    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" containerID="465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0" exitCode=0
Sep 10 14:43:50.279587 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.279549    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"
Sep 10 14:43:50.279784 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.279591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8" event={"ID":"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10","Type":"ContainerDied","Data":"465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0"}
Sep 10 14:43:50.279784 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.279649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8" event={"ID":"9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10","Type":"ContainerDied","Data":"29e693f17e4984568a3d0f30a676c084dda8ba5df9c53e51b37b049fb654a190"}
Sep 10 14:43:50.279784 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.279675    2577 scope.go:117] "RemoveContainer" containerID="465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0"
Sep 10 14:43:50.280973 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.280953    2577 generic.go:356] "Generic (PLEG): container finished" podID="8c5dabff-ab48-47cb-a55d-ed7270348213" containerID="da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305" exitCode=0
Sep 10 14:43:50.281086 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.281001    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"
Sep 10 14:43:50.281086 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.281037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh" event={"ID":"8c5dabff-ab48-47cb-a55d-ed7270348213","Type":"ContainerDied","Data":"da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305"}
Sep 10 14:43:50.281086 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.281070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh" event={"ID":"8c5dabff-ab48-47cb-a55d-ed7270348213","Type":"ContainerDied","Data":"8153d6e280d904abc6f66c3fbe7b5d9d3cd707b7cfe7c2cb47b0ec7547c87bf2"}
Sep 10 14:43:50.289383 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.289355    2577 scope.go:117] "RemoveContainer" containerID="465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0"
Sep 10 14:43:50.289742 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:43:50.289722    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0\": container with ID starting with 465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0 not found: ID does not exist" containerID="465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0"
Sep 10 14:43:50.289866 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.289748    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0"} err="failed to get container status \"465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0\": rpc error: code = NotFound desc = could not find container \"465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0\": container with ID starting with 465cc9e2670fd5b3f2de245f97b6d439d6b8636771b4c325857866a0fea1cba0 not found: ID does not exist"
Sep 10 14:43:50.289866 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.289765    2577 scope.go:117] "RemoveContainer" containerID="da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305"
Sep 10 14:43:50.299618 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.299596    2577 scope.go:117] "RemoveContainer" containerID="da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305"
Sep 10 14:43:50.300194 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:43:50.300167    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305\": container with ID starting with da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305 not found: ID does not exist" containerID="da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305"
Sep 10 14:43:50.300283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.300202    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305"} err="failed to get container status \"da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305\": rpc error: code = NotFound desc = could not find container \"da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305\": container with ID starting with da7dc45f11f520d911b62b152686b41f0c6a45b2e485c44df8006564724f4305 not found: ID does not exist"
Sep 10 14:43:50.308459 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.308437    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"]
Sep 10 14:43:50.310326 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.310305    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh"]
Sep 10 14:43:50.321136 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.321115    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"]
Sep 10 14:43:50.322780 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:50.322761    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8"]
Sep 10 14:43:51.509746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:51.509712    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c5dabff-ab48-47cb-a55d-ed7270348213" path="/var/lib/kubelet/pods/8c5dabff-ab48-47cb-a55d-ed7270348213/volumes"
Sep 10 14:43:51.510144 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:51.510132    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" path="/var/lib/kubelet/pods/9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10/volumes"
Sep 10 14:43:51.510418 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:51.510405    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5da5806-1ee5-4a1d-af7d-05626591696f" path="/var/lib/kubelet/pods/d5da5806-1ee5-4a1d-af7d-05626591696f/volumes"
Sep 10 14:43:52.088626 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.088581    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"]
Sep 10 14:43:52.088999 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.088986    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5da5806-1ee5-4a1d-af7d-05626591696f" containerName="revoke-keys"
Sep 10 14:43:52.089055 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089001    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5da5806-1ee5-4a1d-af7d-05626591696f" containerName="revoke-keys"
Sep 10 14:43:52.089055 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089010    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" containerName="payload-processing"
Sep 10 14:43:52.089055 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" containerName="payload-processing"
Sep 10 14:43:52.089055 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089026    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5dabff-ab48-47cb-a55d-ed7270348213" containerName="payload-pre-processing"
Sep 10 14:43:52.089055 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089033    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5dabff-ab48-47cb-a55d-ed7270348213" containerName="payload-pre-processing"
Sep 10 14:43:52.089202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089098    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c5dabff-ab48-47cb-a55d-ed7270348213" containerName="payload-pre-processing"
Sep 10 14:43:52.089202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089106    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bdea8f6-3eec-4ee2-b5a8-a34575e6ef10" containerName="payload-processing"
Sep 10 14:43:52.089202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.089115    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5da5806-1ee5-4a1d-af7d-05626591696f" containerName="revoke-keys"
Sep 10 14:43:52.091673 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.091657    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"]
Sep 10 14:43:52.091790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.091771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.093882 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.093867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.094888 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.094865    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-3477ac\""
Sep 10 14:43:52.103809 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.103782    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"]
Sep 10 14:43:52.120118 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.120092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"]
Sep 10 14:43:52.121682 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.121522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.121821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.121692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8sb7\" (UniqueName: \"kubernetes.io/projected/581c470e-5fcb-4cea-93ab-bdbf12925b8c-kube-api-access-s8sb7\") pod \"payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.121821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.121756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581c470e-5fcb-4cea-93ab-bdbf12925b8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.121821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.121790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqv4\" (UniqueName: \"kubernetes.io/projected/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-kube-api-access-hqqv4\") pod \"payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.222615 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.222571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.222821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.222663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8sb7\" (UniqueName: \"kubernetes.io/projected/581c470e-5fcb-4cea-93ab-bdbf12925b8c-kube-api-access-s8sb7\") pod \"payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.222821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.222721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581c470e-5fcb-4cea-93ab-bdbf12925b8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.222821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.222759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqv4\" (UniqueName: \"kubernetes.io/projected/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-kube-api-access-hqqv4\") pod \"payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.223565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.223528    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.223565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.223558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581c470e-5fcb-4cea-93ab-bdbf12925b8c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.235105 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.234927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8sb7\" (UniqueName: \"kubernetes.io/projected/581c470e-5fcb-4cea-93ab-bdbf12925b8c-kube-api-access-s8sb7\") pod \"payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.235626 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.235578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqv4\" (UniqueName: \"kubernetes.io/projected/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-kube-api-access-hqqv4\") pod \"payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.404245 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.404189    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:52.412620 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.412594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:52.680586 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.680557    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"]
Sep 10 14:43:52.682487 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:43:52.682457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581c470e_5fcb_4cea_93ab_bdbf12925b8c.slice/crio-558bcbd50fc384bc2909d5847afd2278728ddefdaa1af0f2d38d113a5d961be2 WatchSource:0}: Error finding container 558bcbd50fc384bc2909d5847afd2278728ddefdaa1af0f2d38d113a5d961be2: Status 404 returned error can't find the container with id 558bcbd50fc384bc2909d5847afd2278728ddefdaa1af0f2d38d113a5d961be2
Sep 10 14:43:52.692683 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:52.692657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"]
Sep 10 14:43:52.695317 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:43:52.695295    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e6e3eb_5dca_4cf1_b650_be2aded3e0f1.slice/crio-8b9ee9c97b647dc4b0cd69b4a013c485cdae38f7fef49ba29904c087a8f4faa8 WatchSource:0}: Error finding container 8b9ee9c97b647dc4b0cd69b4a013c485cdae38f7fef49ba29904c087a8f4faa8: Status 404 returned error can't find the container with id 8b9ee9c97b647dc4b0cd69b4a013c485cdae38f7fef49ba29904c087a8f4faa8
Sep 10 14:43:53.299915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.299878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8" event={"ID":"581c470e-5fcb-4cea-93ab-bdbf12925b8c","Type":"ContainerStarted","Data":"64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873"}
Sep 10 14:43:53.300170 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.300077    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:43:53.300170 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.300117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8" event={"ID":"581c470e-5fcb-4cea-93ab-bdbf12925b8c","Type":"ContainerStarted","Data":"558bcbd50fc384bc2909d5847afd2278728ddefdaa1af0f2d38d113a5d961be2"}
Sep 10 14:43:53.301597 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.301571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz" event={"ID":"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1","Type":"ContainerStarted","Data":"b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a"}
Sep 10 14:43:53.301716 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.301614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz" event={"ID":"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1","Type":"ContainerStarted","Data":"8b9ee9c97b647dc4b0cd69b4a013c485cdae38f7fef49ba29904c087a8f4faa8"}
Sep 10 14:43:53.301771 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.301740    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:43:53.317939 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.317884    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8" podStartSLOduration=1.317865592 podStartE2EDuration="1.317865592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:53.314518743 +0000 UTC m=+1444.291648098" watchObservedRunningTime="2026-09-10 14:43:53.317865592 +0000 UTC m=+1444.294994949"
Sep 10 14:43:53.330294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:53.330246    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz" podStartSLOduration=1.330234696 podStartE2EDuration="1.330234696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:43:53.328030344 +0000 UTC m=+1444.305159698" watchObservedRunningTime="2026-09-10 14:43:53.330234696 +0000 UTC m=+1444.307364050"
Sep 10 14:43:56.317138 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:56.317102    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"]
Sep 10 14:43:56.317732 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:56.317378    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" containerID="cri-o://333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813" gracePeriod=30
Sep 10 14:43:58.629732 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:58.629692    2577 patch_prober.go:28] interesting pod/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 14:43:58.630161 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:43:58.629763    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:44:01.568390 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.568361    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:44:01.614780 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.614737    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-podinfo\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.614997 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.614796    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istiod-ca-cert\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.614997 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.614886    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drfjm\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-kube-api-access-drfjm\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.614997 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.614917    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-socket\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.614997 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.614952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-envoy\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.615218 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-credential-socket\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.615218 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615069    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-data\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.615218 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615102    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-certs\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.615218 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615147    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-token\") pod \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\" (UID: \"79daee80-cfc6-4dcb-bbe0-c999edc10a17\") "
Sep 10 14:44:01.615432 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615266    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:44:01.615432 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:44:01.615544 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615434    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-data" (OuterVolumeSpecName: "istio-data") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:44:01.615544 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615520    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:44:01.615667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615558    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.615667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615578    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.615667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615595    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.615819 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.615700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:44:01.617080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.617049    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:44:01.617358 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.617340    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-token" (OuterVolumeSpecName: "istio-token") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:44:01.617412 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.617361    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:44:01.617578 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.617557    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-kube-api-access-drfjm" (OuterVolumeSpecName: "kube-api-access-drfjm") pod "79daee80-cfc6-4dcb-bbe0-c999edc10a17" (UID: "79daee80-cfc6-4dcb-bbe0-c999edc10a17"). InnerVolumeSpecName "kube-api-access-drfjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:44:01.716742 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.716700    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.716742 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.716734    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.716742 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.716747    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.717030 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.716758    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.717030 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.716769    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drfjm\" (UniqueName: \"kubernetes.io/projected/79daee80-cfc6-4dcb-bbe0-c999edc10a17-kube-api-access-drfjm\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:01.717030 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:01.716783    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79daee80-cfc6-4dcb-bbe0-c999edc10a17-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:44:02.355200 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.355161    2577 generic.go:356] "Generic (PLEG): container finished" podID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerID="333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813" exitCode=0
Sep 10 14:44:02.355398 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.355214    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"
Sep 10 14:44:02.355398 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.355248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" event={"ID":"79daee80-cfc6-4dcb-bbe0-c999edc10a17","Type":"ContainerDied","Data":"333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813"}
Sep 10 14:44:02.355398 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.355304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc" event={"ID":"79daee80-cfc6-4dcb-bbe0-c999edc10a17","Type":"ContainerDied","Data":"ce891dfc0c0344d93866fcbef2f6c6cf70c8255782c7bfdad475d763d746cf90"}
Sep 10 14:44:02.355398 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.355328    2577 scope.go:117] "RemoveContainer" containerID="333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813"
Sep 10 14:44:02.365915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.365898    2577 scope.go:117] "RemoveContainer" containerID="c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1"
Sep 10 14:44:02.373907 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.373885    2577 scope.go:117] "RemoveContainer" containerID="333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813"
Sep 10 14:44:02.374227 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:44:02.374204    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813\": container with ID starting with 333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813 not found: ID does not exist" containerID="333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813"
Sep 10 14:44:02.374273 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.374237    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813"} err="failed to get container status \"333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813\": rpc error: code = NotFound desc = could not find container \"333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813\": container with ID starting with 333345441af2ecaf93be0558e4f9ca9155dbbb514838ef37f02a12155a9be813 not found: ID does not exist"
Sep 10 14:44:02.374273 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.374255    2577 scope.go:117] "RemoveContainer" containerID="c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1"
Sep 10 14:44:02.374701 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:44:02.374600    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1\": container with ID starting with c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1 not found: ID does not exist" containerID="c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1"
Sep 10 14:44:02.374701 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.374633    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1"} err="failed to get container status \"c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1\": rpc error: code = NotFound desc = could not find container \"c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1\": container with ID starting with c5186fd6ec9aff858f1e939d8a2ac6b5583922603c202d4cf39647ebdb8637c1 not found: ID does not exist"
Sep 10 14:44:02.377125 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.377102    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"]
Sep 10 14:44:02.382816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:02.382789    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc"]
Sep 10 14:44:03.510389 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:03.510358    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" path="/var/lib/kubelet/pods/79daee80-cfc6-4dcb-bbe0-c999edc10a17/volumes"
Sep 10 14:44:04.309737 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:04.309706    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:44:04.309937 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:04.309889    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:44:10.086193 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.086157    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"]
Sep 10 14:44:10.086774 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.086753    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy"
Sep 10 14:44:10.086865 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.086778    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy"
Sep 10 14:44:10.086865 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.086801    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy"
Sep 10 14:44:10.086865 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.086811    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy"
Sep 10 14:44:10.086999 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.086945    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy"
Sep 10 14:44:10.091938 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.091913    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.094354 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.094331    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-bc9af3-openshift-default-dockercfg-zmfvv\""
Sep 10 14:44:10.104778 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.104751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"]
Sep 10 14:44:10.195349 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195304    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-credential-socket\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-certs\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70b7326-374b-4a7d-bc94-35484c5063bd-istiod-ca-cert\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195554 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-podinfo\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195702 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-token\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195702 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-envoy\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195815 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-socket\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195901 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-data\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.195901 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.195867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnggf\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-kube-api-access-vnggf\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70b7326-374b-4a7d-bc94-35484c5063bd-istiod-ca-cert\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-podinfo\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-token\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-envoy\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-socket\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-data\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnggf\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-kube-api-access-vnggf\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-credential-socket\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-certs\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297712 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297650    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-data\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297765 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-socket\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.297972 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297952    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-credential-socket\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.298054 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-certs\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.298054 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.297957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70b7326-374b-4a7d-bc94-35484c5063bd-istiod-ca-cert\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.300304 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.300270    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-envoy\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.300471 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.300451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-podinfo\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.305054 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.305029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-token\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.305155 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.305133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnggf\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-kube-api-access-vnggf\") pod \"e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") " pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.406229 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.406198    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:10.681279 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.681221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"]
Sep 10 14:44:10.683734 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:44:10.683706    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70b7326_374b_4a7d_bc94_35484c5063bd.slice/crio-b4fe5dedd8cb2535d23ecec45c23aaa21682639d7a6a9e20b39963e344d32cbe WatchSource:0}: Error finding container b4fe5dedd8cb2535d23ecec45c23aaa21682639d7a6a9e20b39963e344d32cbe: Status 404 returned error can't find the container with id b4fe5dedd8cb2535d23ecec45c23aaa21682639d7a6a9e20b39963e344d32cbe
Sep 10 14:44:10.686263 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.686222    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:10.686327 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.686310    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:10.686380 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:10.686356    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:11.417597 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:11.417560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" event={"ID":"a70b7326-374b-4a7d-bc94-35484c5063bd","Type":"ContainerStarted","Data":"7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb"}
Sep 10 14:44:11.418016 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:11.417618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" event={"ID":"a70b7326-374b-4a7d-bc94-35484c5063bd","Type":"ContainerStarted","Data":"b4fe5dedd8cb2535d23ecec45c23aaa21682639d7a6a9e20b39963e344d32cbe"}
Sep 10 14:44:11.441864 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:11.438353    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podStartSLOduration=1.438330482 podStartE2EDuration="1.438330482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:11.435007169 +0000 UTC m=+1462.412136523" watchObservedRunningTime="2026-09-10 14:44:11.438330482 +0000 UTC m=+1462.415459850"
Sep 10 14:44:12.406796 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:12.406761    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:12.411816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:12.411791    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:12.422119 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:12.422090    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:12.422966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:12.422946    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:15.363686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.363649    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"]
Sep 10 14:44:15.364158 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.364142    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="79daee80-cfc6-4dcb-bbe0-c999edc10a17" containerName="istio-proxy"
Sep 10 14:44:15.367579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.367538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.369553 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.369533    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-bc9af3\""
Sep 10 14:44:15.369673 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.369536    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-bc9af3-dockercfg-2h4vg\""
Sep 10 14:44:15.378930 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.378907    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"]
Sep 10 14:44:15.450802 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.450766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvz8n\" (UniqueName: \"kubernetes.io/projected/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-kube-api-access-wvz8n\") pod \"payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.451012 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.450838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.551667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.551633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvz8n\" (UniqueName: \"kubernetes.io/projected/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-kube-api-access-wvz8n\") pod \"payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.551909 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.551691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.552426 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.552405    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.559632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.559610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvz8n\" (UniqueName: \"kubernetes.io/projected/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-kube-api-access-wvz8n\") pod \"payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.680046 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.679956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:15.954502 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:15.954414    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"]
Sep 10 14:44:15.958036 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:44:15.958012    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57e0cc9_fbfa_4da4_8b0d_fd0c86724326.slice/crio-dff7b89e434d7b79816ada73235406697057c9fb8ca3b5a4eeceb5f0ff01899e WatchSource:0}: Error finding container dff7b89e434d7b79816ada73235406697057c9fb8ca3b5a4eeceb5f0ff01899e: Status 404 returned error can't find the container with id dff7b89e434d7b79816ada73235406697057c9fb8ca3b5a4eeceb5f0ff01899e
Sep 10 14:44:16.443110 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:16.443067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl" event={"ID":"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326","Type":"ContainerStarted","Data":"66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f"}
Sep 10 14:44:16.443564 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:16.443239    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:16.443564 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:16.443263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl" event={"ID":"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326","Type":"ContainerStarted","Data":"dff7b89e434d7b79816ada73235406697057c9fb8ca3b5a4eeceb5f0ff01899e"}
Sep 10 14:44:16.458701 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:16.458648    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl" podStartSLOduration=1.458630031 podStartE2EDuration="1.458630031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:16.456952485 +0000 UTC m=+1467.434081842" watchObservedRunningTime="2026-09-10 14:44:16.458630031 +0000 UTC m=+1467.435759384"
Sep 10 14:44:27.450269 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:27.450235    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:44:28.464989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:28.464943    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:44:28.465456 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:28.465021    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:44:29.530360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:29.530327    2577 generic.go:356] "Generic (PLEG): container finished" podID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerID="7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb" exitCode=0
Sep 10 14:44:29.530360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:29.530362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" event={"ID":"a70b7326-374b-4a7d-bc94-35484c5063bd","Type":"ContainerDied","Data":"7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb"}
Sep 10 14:44:29.530821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:29.530789    2577 scope.go:117] "RemoveContainer" containerID="7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb"
Sep 10 14:44:29.532021 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:29.531993    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:29.532111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:29.532057    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:29.532111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:29.532087    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:30.538240 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:30.538206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" event={"ID":"a70b7326-374b-4a7d-bc94-35484c5063bd","Type":"ContainerStarted","Data":"ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2"}
Sep 10 14:44:31.406374 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:31.406336    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:31.406621 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:31.406599    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:44:31.406693 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:31.406655    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 14:44:32.407299 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:32.407264    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:44:32.407726 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:32.407319    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 14:44:33.407008 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:33.406972    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:44:33.407189 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:33.407030    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 14:44:34.407484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:34.407450    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:44:34.407898 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:34.407509    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 14:44:35.407211 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:35.407172    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 10 14:44:35.407422 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:35.407229    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 10 14:44:36.410889 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:36.410854    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:36.411389 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:36.411198    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:36.411893 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:36.411875    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:44:38.890599 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.890566    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"]
Sep 10 14:44:38.895479 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.895447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.897421 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.897388    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-86a2c6-openshift-default-dockercfg-m8bzs\""
Sep 10 14:44:38.904266 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.904169    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"]
Sep 10 14:44:38.967915 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.967877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d469439-4c1c-4ad5-b156-063f44a3f952-istiod-ca-cert\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968119 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.967977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-credential-socket\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968119 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.968027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-socket\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968119 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.968049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-certs\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968119 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.968072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9tg\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-kube-api-access-7b9tg\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.968146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-envoy\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.968266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-token\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968378 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.968311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-data\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:38.968378 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:38.968360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-podinfo\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.068974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.068943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-credential-socket\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069188 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.068982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-socket\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069188 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-certs\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069188 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9tg\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-kube-api-access-7b9tg\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069188 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-envoy\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069188 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-token\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069188 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-data\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069521 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-podinfo\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069521 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d469439-4c1c-4ad5-b156-063f44a3f952-istiod-ca-cert\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069521 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-certs\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069665 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-data\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069811 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-credential-socket\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069911 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-socket\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.069971 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.069949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d469439-4c1c-4ad5-b156-063f44a3f952-istiod-ca-cert\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.071648 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.071622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-envoy\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.071747 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.071707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-podinfo\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.076561 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.076536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-token\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.076724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.076707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9tg\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-kube-api-access-7b9tg\") pod \"e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") " pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.213261 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.213168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:39.498048 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.498023    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"]
Sep 10 14:44:39.500566 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:44:39.500536    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d469439_4c1c_4ad5_b156_063f44a3f952.slice/crio-9ddfdcb672bdb0b96f7c1c826974425ac4aa9dfd318576602f1ae56eb58e9777 WatchSource:0}: Error finding container 9ddfdcb672bdb0b96f7c1c826974425ac4aa9dfd318576602f1ae56eb58e9777: Status 404 returned error can't find the container with id 9ddfdcb672bdb0b96f7c1c826974425ac4aa9dfd318576602f1ae56eb58e9777
Sep 10 14:44:39.503221 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.503184    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:39.503318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.503254    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:39.503318 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.503288    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:39.585547 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.585502    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" event={"ID":"1d469439-4c1c-4ad5-b156-063f44a3f952","Type":"ContainerStarted","Data":"ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5"}
Sep 10 14:44:39.585699 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.585575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" event={"ID":"1d469439-4c1c-4ad5-b156-063f44a3f952","Type":"ContainerStarted","Data":"9ddfdcb672bdb0b96f7c1c826974425ac4aa9dfd318576602f1ae56eb58e9777"}
Sep 10 14:44:39.605834 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:39.605756    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podStartSLOduration=1.6057359340000001 podStartE2EDuration="1.605735934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:39.604802146 +0000 UTC m=+1490.581931503" watchObservedRunningTime="2026-09-10 14:44:39.605735934 +0000 UTC m=+1490.582865290"
Sep 10 14:44:40.213326 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:40.213286    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:40.219474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:40.219446    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:40.590428 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:40.590340    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:40.591234 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:40.591212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:44:43.390377 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.390341    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"]
Sep 10 14:44:43.393973 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.393955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.396204 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.396183    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-86a2c6\""
Sep 10 14:44:43.396311 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.396292    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-86a2c6-dockercfg-qjb9l\""
Sep 10 14:44:43.409446 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.409414    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"]
Sep 10 14:44:43.416391 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.416361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.416532 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.416480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvvzc\" (UniqueName: \"kubernetes.io/projected/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-kube-api-access-xvvzc\") pod \"payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.517325 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.517284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvvzc\" (UniqueName: \"kubernetes.io/projected/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-kube-api-access-xvvzc\") pod \"payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.517516 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.517414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.518123 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.518099    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.526751 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.526725    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvvzc\" (UniqueName: \"kubernetes.io/projected/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-kube-api-access-xvvzc\") pod \"payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.705834 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.705728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:43.977767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:43.977742    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"]
Sep 10 14:44:43.980501 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:44:43.980476    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda67b54b_52f7_411c_bb1f_6c57fb8b10e0.slice/crio-3e21f4862b49bfcbadce112898fa02c6c03e037d308cac8ae3fb2428997492dd WatchSource:0}: Error finding container 3e21f4862b49bfcbadce112898fa02c6c03e037d308cac8ae3fb2428997492dd: Status 404 returned error can't find the container with id 3e21f4862b49bfcbadce112898fa02c6c03e037d308cac8ae3fb2428997492dd
Sep 10 14:44:44.611934 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:44.611889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj" event={"ID":"da67b54b-52f7-411c-bb1f-6c57fb8b10e0","Type":"ContainerStarted","Data":"b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214"}
Sep 10 14:44:44.612315 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:44.611988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj" event={"ID":"da67b54b-52f7-411c-bb1f-6c57fb8b10e0","Type":"ContainerStarted","Data":"3e21f4862b49bfcbadce112898fa02c6c03e037d308cac8ae3fb2428997492dd"}
Sep 10 14:44:44.612315 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:44.612139    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:44.627572 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:44.627524    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj" podStartSLOduration=1.6275077119999999 podStartE2EDuration="1.627507712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:44.626404845 +0000 UTC m=+1495.603534201" watchObservedRunningTime="2026-09-10 14:44:44.627507712 +0000 UTC m=+1495.604637128"
Sep 10 14:44:49.505581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:49.505548    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:44:49.507926 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:49.507896    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:44:55.619739 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:55.619711    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:44:59.691989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:59.691952    2577 generic.go:356] "Generic (PLEG): container finished" podID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerID="ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5" exitCode=0
Sep 10 14:44:59.692421 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:59.692023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" event={"ID":"1d469439-4c1c-4ad5-b156-063f44a3f952","Type":"ContainerDied","Data":"ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5"}
Sep 10 14:44:59.692468 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:59.692419    2577 scope.go:117] "RemoveContainer" containerID="ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5"
Sep 10 14:44:59.693507 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:59.693478    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:59.693566 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:59.693545    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:44:59.693606 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:44:59.693577    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:45:00.148283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.148225    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4"]
Sep 10 14:45:00.151304 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.151261    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"]
Sep 10 14:45:00.151524 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.151396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4"
Sep 10 14:45:00.153540 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.153505    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:45:00.153540 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.153536    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"]
Sep 10 14:45:00.153756 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.153675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"
Sep 10 14:45:00.155593 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.155577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"
Sep 10 14:45:00.158362 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.158336    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4"]
Sep 10 14:45:00.163181 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.163156    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"]
Sep 10 14:45:00.170474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.168076    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"]
Sep 10 14:45:00.170474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.169321    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4"
Sep 10 14:45:00.187351 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.187165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"
Sep 10 14:45:00.233289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.233261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"
Sep 10 14:45:00.494659 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.490469    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4"]
Sep 10 14:45:00.499937 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:45:00.499896    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa97ea8_c75d_44cf_8b85_0cbbce468586.slice/crio-cc4351be69609e76f57fd234750e8c06684c83ce8158d86dbd956ff317922f18 WatchSource:0}: Error finding container cc4351be69609e76f57fd234750e8c06684c83ce8158d86dbd956ff317922f18: Status 404 returned error can't find the container with id cc4351be69609e76f57fd234750e8c06684c83ce8158d86dbd956ff317922f18
Sep 10 14:45:00.528671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.528643    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"]
Sep 10 14:45:00.529932 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:45:00.529906    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630a1bd0_b49a_434a_bf9a_9965e75e8583.slice/crio-96361e3b9ec601b106e2f5903b3afdd4478b33fba4cc43efd843e3a7da47d86a WatchSource:0}: Error finding container 96361e3b9ec601b106e2f5903b3afdd4478b33fba4cc43efd843e3a7da47d86a: Status 404 returned error can't find the container with id 96361e3b9ec601b106e2f5903b3afdd4478b33fba4cc43efd843e3a7da47d86a
Sep 10 14:45:00.554135 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.554113    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"]
Sep 10 14:45:00.559071 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:45:00.559032    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f477f7_1e06_49c8_84c0_3c61655e76dc.slice/crio-c84e515a469f3143c169db9ac9671fcccb2ff9aae7f20aeb9c7904b1c327e7da WatchSource:0}: Error finding container c84e515a469f3143c169db9ac9671fcccb2ff9aae7f20aeb9c7904b1c327e7da: Status 404 returned error can't find the container with id c84e515a469f3143c169db9ac9671fcccb2ff9aae7f20aeb9c7904b1c327e7da
Sep 10 14:45:00.701519 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.701483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6" event={"ID":"61f477f7-1e06-49c8-84c0-3c61655e76dc","Type":"ContainerStarted","Data":"c84e515a469f3143c169db9ac9671fcccb2ff9aae7f20aeb9c7904b1c327e7da"}
Sep 10 14:45:00.703489 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.703458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" event={"ID":"1d469439-4c1c-4ad5-b156-063f44a3f952","Type":"ContainerStarted","Data":"243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66"}
Sep 10 14:45:00.704677 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.704654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc" event={"ID":"630a1bd0-b49a-434a-bf9a-9965e75e8583","Type":"ContainerStarted","Data":"96361e3b9ec601b106e2f5903b3afdd4478b33fba4cc43efd843e3a7da47d86a"}
Sep 10 14:45:00.705931 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:00.705907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4" event={"ID":"4aa97ea8-c75d-44cf-8b85-0cbbce468586","Type":"ContainerStarted","Data":"cc4351be69609e76f57fd234750e8c06684c83ce8158d86dbd956ff317922f18"}
Sep 10 14:45:01.213746 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.213711    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:45:01.214307 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.214284    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:45:01.214409 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.214341    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 14:45:01.712900 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.712867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6" event={"ID":"61f477f7-1e06-49c8-84c0-3c61655e76dc","Type":"ContainerStarted","Data":"db200a1adec477d915f6a029da814be0a0c7059d443dde939cec166fabf62eec"}
Sep 10 14:45:01.714365 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.714335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc" event={"ID":"630a1bd0-b49a-434a-bf9a-9965e75e8583","Type":"ContainerStarted","Data":"ba9b3299691bd2569dfc2039636df1eff5433f974d7663adcfe802d0a6c24cdc"}
Sep 10 14:45:01.715953 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.715930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4" event={"ID":"4aa97ea8-c75d-44cf-8b85-0cbbce468586","Type":"ContainerStarted","Data":"1ad3f2dfa655244c295ae940d079345bfe9238bbfce9f8a8049a0d74b4f20a64"}
Sep 10 14:45:01.730256 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.730201    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6" podStartSLOduration=1.730186823 podStartE2EDuration="1.730186823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.729268176 +0000 UTC m=+1512.706397560" watchObservedRunningTime="2026-09-10 14:45:01.730186823 +0000 UTC m=+1512.707316176"
Sep 10 14:45:01.745116 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.745040    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4" podStartSLOduration=1.745024108 podStartE2EDuration="1.745024108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.742820823 +0000 UTC m=+1512.719950180" watchObservedRunningTime="2026-09-10 14:45:01.745024108 +0000 UTC m=+1512.722153461"
Sep 10 14:45:01.757549 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:01.757496    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc" podStartSLOduration=1.757481165 podStartE2EDuration="1.757481165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.756057503 +0000 UTC m=+1512.733186857" watchObservedRunningTime="2026-09-10 14:45:01.757481165 +0000 UTC m=+1512.734610515"
Sep 10 14:45:02.214520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.214481    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:45:02.214704 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.214544    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 14:45:02.722821 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.722790    2577 generic.go:356] "Generic (PLEG): container finished" podID="61f477f7-1e06-49c8-84c0-3c61655e76dc" containerID="db200a1adec477d915f6a029da814be0a0c7059d443dde939cec166fabf62eec" exitCode=0
Sep 10 14:45:02.723302 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.722881    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6" event={"ID":"61f477f7-1e06-49c8-84c0-3c61655e76dc","Type":"ContainerDied","Data":"db200a1adec477d915f6a029da814be0a0c7059d443dde939cec166fabf62eec"}
Sep 10 14:45:02.724419 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.724394    2577 generic.go:356] "Generic (PLEG): container finished" podID="630a1bd0-b49a-434a-bf9a-9965e75e8583" containerID="ba9b3299691bd2569dfc2039636df1eff5433f974d7663adcfe802d0a6c24cdc" exitCode=0
Sep 10 14:45:02.724541 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.724422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc" event={"ID":"630a1bd0-b49a-434a-bf9a-9965e75e8583","Type":"ContainerDied","Data":"ba9b3299691bd2569dfc2039636df1eff5433f974d7663adcfe802d0a6c24cdc"}
Sep 10 14:45:02.725740 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.725721    2577 generic.go:356] "Generic (PLEG): container finished" podID="4aa97ea8-c75d-44cf-8b85-0cbbce468586" containerID="1ad3f2dfa655244c295ae940d079345bfe9238bbfce9f8a8049a0d74b4f20a64" exitCode=0
Sep 10 14:45:02.725833 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:02.725742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4" event={"ID":"4aa97ea8-c75d-44cf-8b85-0cbbce468586","Type":"ContainerDied","Data":"1ad3f2dfa655244c295ae940d079345bfe9238bbfce9f8a8049a0d74b4f20a64"}
Sep 10 14:45:03.214478 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:03.214443    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:45:03.214688 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:03.214499    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 14:45:03.959366 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:03.959341    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4"
Sep 10 14:45:03.962631 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:03.962608    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"
Sep 10 14:45:03.966444 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:03.966423    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"
Sep 10 14:45:04.214583 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.214544    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:45:04.214776 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.214607    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 14:45:04.740390 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.740359    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"
Sep 10 14:45:04.740583 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.740360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6" event={"ID":"61f477f7-1e06-49c8-84c0-3c61655e76dc","Type":"ContainerDied","Data":"c84e515a469f3143c169db9ac9671fcccb2ff9aae7f20aeb9c7904b1c327e7da"}
Sep 10 14:45:04.740583 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.740495    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c84e515a469f3143c169db9ac9671fcccb2ff9aae7f20aeb9c7904b1c327e7da"
Sep 10 14:45:04.741658 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.741639    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"
Sep 10 14:45:04.741791 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.741637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc" event={"ID":"630a1bd0-b49a-434a-bf9a-9965e75e8583","Type":"ContainerDied","Data":"96361e3b9ec601b106e2f5903b3afdd4478b33fba4cc43efd843e3a7da47d86a"}
Sep 10 14:45:04.741791 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.741766    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96361e3b9ec601b106e2f5903b3afdd4478b33fba4cc43efd843e3a7da47d86a"
Sep 10 14:45:04.742979 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.742963    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4"
Sep 10 14:45:04.743083 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.743003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-vzpd4" event={"ID":"4aa97ea8-c75d-44cf-8b85-0cbbce468586","Type":"ContainerDied","Data":"cc4351be69609e76f57fd234750e8c06684c83ce8158d86dbd956ff317922f18"}
Sep 10 14:45:04.743083 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:04.743032    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc4351be69609e76f57fd234750e8c06684c83ce8158d86dbd956ff317922f18"
Sep 10 14:45:05.214242 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:05.214204    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:45:05.214682 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:05.214264    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 14:45:06.217732 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:06.217701    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:45:06.218150 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:06.218105    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:45:06.218706 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:06.218689    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:45:16.196077 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196002    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"]
Sep 10 14:45:16.196430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196391    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f477f7-1e06-49c8-84c0-3c61655e76dc" containerName="cleanup"
Sep 10 14:45:16.196430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196403    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f477f7-1e06-49c8-84c0-3c61655e76dc" containerName="cleanup"
Sep 10 14:45:16.196430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196424    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630a1bd0-b49a-434a-bf9a-9965e75e8583" containerName="cleanup"
Sep 10 14:45:16.196430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196430    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="630a1bd0-b49a-434a-bf9a-9965e75e8583" containerName="cleanup"
Sep 10 14:45:16.196566 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196437    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa97ea8-c75d-44cf-8b85-0cbbce468586" containerName="cleanup"
Sep 10 14:45:16.196566 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196443    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa97ea8-c75d-44cf-8b85-0cbbce468586" containerName="cleanup"
Sep 10 14:45:16.196566 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196503    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aa97ea8-c75d-44cf-8b85-0cbbce468586" containerName="cleanup"
Sep 10 14:45:16.196566 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196511    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="61f477f7-1e06-49c8-84c0-3c61655e76dc" containerName="cleanup"
Sep 10 14:45:16.196566 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.196519    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="630a1bd0-b49a-434a-bf9a-9965e75e8583" containerName="cleanup"
Sep 10 14:45:16.198791 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.198771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.200671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.200654    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dfd05fbc-openshift-default-dockercfg-hjmzg\""
Sep 10 14:45:16.210765 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.210741    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"]
Sep 10 14:45:16.253410 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253370    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dadd509-340b-40b2-90be-4e05c2bf5cff-istiod-ca-cert\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253451    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-podinfo\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-certs\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-data\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253687 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-token\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253687 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-credential-socket\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253761 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-socket\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253761 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lgbj\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-kube-api-access-9lgbj\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.253826 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.253768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-envoy\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-data\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-token\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-credential-socket\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-socket\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lgbj\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-kube-api-access-9lgbj\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-envoy\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dadd509-340b-40b2-90be-4e05c2bf5cff-istiod-ca-cert\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-podinfo\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.354757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-certs\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.355142 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.354970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-data\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.355142 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.355048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-credential-socket\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.355142 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.355061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-socket\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.355411 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.355384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-certs\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.355617 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.355591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dadd509-340b-40b2-90be-4e05c2bf5cff-istiod-ca-cert\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.357144 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.357123    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-envoy\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.357412 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.357394    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-podinfo\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.363873 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.363821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-token\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.364142 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.364120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lgbj\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-kube-api-access-9lgbj\") pod \"e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") " pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.510530 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.510441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:16.784981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.784950    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"]
Sep 10 14:45:16.786040 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:45:16.786013    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dadd509_340b_40b2_90be_4e05c2bf5cff.slice/crio-b071536ef8ecefc05762d123f408426301e764648e0e8535f0752f25f6c4cca0 WatchSource:0}: Error finding container b071536ef8ecefc05762d123f408426301e764648e0e8535f0752f25f6c4cca0: Status 404 returned error can't find the container with id b071536ef8ecefc05762d123f408426301e764648e0e8535f0752f25f6c4cca0
Sep 10 14:45:16.788823 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.788789    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:45:16.788917 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.788881    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:45:16.788972 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.788914    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:45:16.809430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:16.809404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" event={"ID":"9dadd509-340b-40b2-90be-4e05c2bf5cff","Type":"ContainerStarted","Data":"b071536ef8ecefc05762d123f408426301e764648e0e8535f0752f25f6c4cca0"}
Sep 10 14:45:17.816829 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:17.816789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" event={"ID":"9dadd509-340b-40b2-90be-4e05c2bf5cff","Type":"ContainerStarted","Data":"7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376"}
Sep 10 14:45:17.833680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:17.833613    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" podStartSLOduration=1.833597677 podStartE2EDuration="1.833597677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:17.832462186 +0000 UTC m=+1528.809591540" watchObservedRunningTime="2026-09-10 14:45:17.833597677 +0000 UTC m=+1528.810727031"
Sep 10 14:45:18.511531 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:18.511496    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:18.517111 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:18.517086    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:18.822629 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:18.822540    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:18.823637 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:18.823615    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:21.617306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.617271    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"]
Sep 10 14:45:21.621055 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.621031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:21.623280 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.623258    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-dfd05fbc-dockercfg-8m9vw\""
Sep 10 14:45:21.623385 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.623258    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-dfd05fbc\""
Sep 10 14:45:21.629560 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.629408    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"]
Sep 10 14:45:21.721808 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.721752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693969cc-89a3-4271-accf-7644d9486471-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:21.722171 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.722120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dx7r\" (UniqueName: \"kubernetes.io/projected/693969cc-89a3-4271-accf-7644d9486471-kube-api-access-2dx7r\") pod \"payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:21.824012 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.823974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693969cc-89a3-4271-accf-7644d9486471-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:21.824192 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.824027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dx7r\" (UniqueName: \"kubernetes.io/projected/693969cc-89a3-4271-accf-7644d9486471-kube-api-access-2dx7r\") pod \"payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:21.824735 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.824714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693969cc-89a3-4271-accf-7644d9486471-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:21.831483 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.831449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dx7r\" (UniqueName: \"kubernetes.io/projected/693969cc-89a3-4271-accf-7644d9486471-kube-api-access-2dx7r\") pod \"payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:21.934387 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:21.934300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:22.204576 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:22.204551    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"]
Sep 10 14:45:22.206098 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:45:22.206057    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693969cc_89a3_4271_accf_7644d9486471.slice/crio-89199a6fecdef9fca06c1be11a34991d23dea6bba7824f794443ecfabeff32fb WatchSource:0}: Error finding container 89199a6fecdef9fca06c1be11a34991d23dea6bba7824f794443ecfabeff32fb: Status 404 returned error can't find the container with id 89199a6fecdef9fca06c1be11a34991d23dea6bba7824f794443ecfabeff32fb
Sep 10 14:45:22.846526 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:22.846483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b" event={"ID":"693969cc-89a3-4271-accf-7644d9486471","Type":"ContainerStarted","Data":"5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4"}
Sep 10 14:45:22.846996 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:22.846549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b" event={"ID":"693969cc-89a3-4271-accf-7644d9486471","Type":"ContainerStarted","Data":"89199a6fecdef9fca06c1be11a34991d23dea6bba7824f794443ecfabeff32fb"}
Sep 10 14:45:22.846996 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:22.846672    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:22.863522 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:22.863465    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b" podStartSLOduration=1.8634478049999998 podStartE2EDuration="1.863447805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:22.861782484 +0000 UTC m=+1533.838911837" watchObservedRunningTime="2026-09-10 14:45:22.863447805 +0000 UTC m=+1533.840577156"
Sep 10 14:45:33.854112 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:33.854078    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:45:39.946361 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:39.946327    2577 generic.go:356] "Generic (PLEG): container finished" podID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerID="7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376" exitCode=0
Sep 10 14:45:39.946787 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:39.946400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" event={"ID":"9dadd509-340b-40b2-90be-4e05c2bf5cff","Type":"ContainerDied","Data":"7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376"}
Sep 10 14:45:39.946872 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:39.946810    2577 scope.go:117] "RemoveContainer" containerID="7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376"
Sep 10 14:45:39.947984 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:39.947957    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:45:39.948049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:39.948022    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:45:39.948086 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:39.948071    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:45:40.957395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:40.957356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" event={"ID":"9dadd509-340b-40b2-90be-4e05c2bf5cff","Type":"ContainerStarted","Data":"f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299"}
Sep 10 14:45:41.515339 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:41.515304    2577 patch_prober.go:28] interesting pod/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 14:45:41.515556 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:41.515367    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 14:45:41.516232 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:41.516212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:42.511025 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:42.510984    2577 patch_prober.go:28] interesting pod/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 14:45:42.511456 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:42.511061    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 14:45:43.511199 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:43.511160    2577 patch_prober.go:28] interesting pod/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 14:45:43.511570 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:43.511240    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 14:45:44.511555 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:44.511521    2577 patch_prober.go:28] interesting pod/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 14:45:44.511992 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:44.511572    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 14:45:45.510871 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:45.510821    2577 patch_prober.go:28] interesting pod/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 14:45:45.511049 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:45.510908    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 14:45:46.514785 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:46.514754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:46.515248 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:46.515054    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:45:46.515701 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:45:46.515684    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:46:23.759925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.759887    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"]
Sep 10 14:46:23.763673 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.763654    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"
Sep 10 14:46:23.765557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.765528    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:46:23.765712 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.765581    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:46:23.769413 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.769382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77e429-82a9-436e-b7b1-cf0bde7e37b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p\" (UID: \"ef77e429-82a9-436e-b7b1-cf0bde7e37b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"
Sep 10 14:46:23.769753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.769731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"]
Sep 10 14:46:23.870106 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.870065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77e429-82a9-436e-b7b1-cf0bde7e37b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p\" (UID: \"ef77e429-82a9-436e-b7b1-cf0bde7e37b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"
Sep 10 14:46:23.870661 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:23.870641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77e429-82a9-436e-b7b1-cf0bde7e37b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p\" (UID: \"ef77e429-82a9-436e-b7b1-cf0bde7e37b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"
Sep 10 14:46:24.076033 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:24.075938    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"
Sep 10 14:46:24.347124 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:24.347099    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"]
Sep 10 14:46:24.349910 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:46:24.349883    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef77e429_82a9_436e_b7b1_cf0bde7e37b1.slice/crio-9893ffa6c1f09ff1692f14ad1026117bc825a7a709120d952d459a23f325d663 WatchSource:0}: Error finding container 9893ffa6c1f09ff1692f14ad1026117bc825a7a709120d952d459a23f325d663: Status 404 returned error can't find the container with id 9893ffa6c1f09ff1692f14ad1026117bc825a7a709120d952d459a23f325d663
Sep 10 14:46:25.214920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:25.214888    2577 generic.go:356] "Generic (PLEG): container finished" podID="ef77e429-82a9-436e-b7b1-cf0bde7e37b1" containerID="2e313061d7e3dd33104db32a655c7efe4f6b5fb1b306acab135c159a11034120" exitCode=0
Sep 10 14:46:25.215303 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:25.214973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p" event={"ID":"ef77e429-82a9-436e-b7b1-cf0bde7e37b1","Type":"ContainerDied","Data":"2e313061d7e3dd33104db32a655c7efe4f6b5fb1b306acab135c159a11034120"}
Sep 10 14:46:25.215303 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:25.215030    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p" event={"ID":"ef77e429-82a9-436e-b7b1-cf0bde7e37b1","Type":"ContainerStarted","Data":"9893ffa6c1f09ff1692f14ad1026117bc825a7a709120d952d459a23f325d663"}
Sep 10 14:46:26.349713 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:26.349685    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"
Sep 10 14:46:26.394814 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:26.394781    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77e429-82a9-436e-b7b1-cf0bde7e37b1-maas-api-service-ca\") pod \"ef77e429-82a9-436e-b7b1-cf0bde7e37b1\" (UID: \"ef77e429-82a9-436e-b7b1-cf0bde7e37b1\") "
Sep 10 14:46:26.395213 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:26.395194    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef77e429-82a9-436e-b7b1-cf0bde7e37b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef77e429-82a9-436e-b7b1-cf0bde7e37b1" (UID: "ef77e429-82a9-436e-b7b1-cf0bde7e37b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:26.495831 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:26.495743    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef77e429-82a9-436e-b7b1-cf0bde7e37b1-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:46:27.227116 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:27.227086    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"
Sep 10 14:46:27.227270 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:27.227111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p" event={"ID":"ef77e429-82a9-436e-b7b1-cf0bde7e37b1","Type":"ContainerDied","Data":"9893ffa6c1f09ff1692f14ad1026117bc825a7a709120d952d459a23f325d663"}
Sep 10 14:46:27.227270 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:27.227156    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9893ffa6c1f09ff1692f14ad1026117bc825a7a709120d952d459a23f325d663"
Sep 10 14:46:39.385607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.385573    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"]
Sep 10 14:46:39.386216 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.385813    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b" podUID="693969cc-89a3-4271-accf-7644d9486471" containerName="payload-pre-processing" containerID="cri-o://5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4" gracePeriod=30
Sep 10 14:46:39.557590 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.557550    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"]
Sep 10 14:46:39.559707 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.559683    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dfd05fbc-q6r4p"]
Sep 10 14:46:39.663929 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.663613    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:46:39.734657 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.734623    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693969cc-89a3-4271-accf-7644d9486471-plugins-config-volume\") pod \"693969cc-89a3-4271-accf-7644d9486471\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") "
Sep 10 14:46:39.734831 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.734673    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dx7r\" (UniqueName: \"kubernetes.io/projected/693969cc-89a3-4271-accf-7644d9486471-kube-api-access-2dx7r\") pod \"693969cc-89a3-4271-accf-7644d9486471\" (UID: \"693969cc-89a3-4271-accf-7644d9486471\") "
Sep 10 14:46:39.735003 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.734981    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/693969cc-89a3-4271-accf-7644d9486471-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "693969cc-89a3-4271-accf-7644d9486471" (UID: "693969cc-89a3-4271-accf-7644d9486471"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:39.736826 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.736791    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693969cc-89a3-4271-accf-7644d9486471-kube-api-access-2dx7r" (OuterVolumeSpecName: "kube-api-access-2dx7r") pod "693969cc-89a3-4271-accf-7644d9486471" (UID: "693969cc-89a3-4271-accf-7644d9486471"). InnerVolumeSpecName "kube-api-access-2dx7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:46:39.835578 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.835547    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dx7r\" (UniqueName: \"kubernetes.io/projected/693969cc-89a3-4271-accf-7644d9486471-kube-api-access-2dx7r\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:46:39.835578 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:39.835573    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/693969cc-89a3-4271-accf-7644d9486471-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:46:40.300767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.300731    2577 generic.go:356] "Generic (PLEG): container finished" podID="693969cc-89a3-4271-accf-7644d9486471" containerID="5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4" exitCode=0
Sep 10 14:46:40.301002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.300791    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"
Sep 10 14:46:40.301002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.300815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b" event={"ID":"693969cc-89a3-4271-accf-7644d9486471","Type":"ContainerDied","Data":"5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4"}
Sep 10 14:46:40.301002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.300916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b" event={"ID":"693969cc-89a3-4271-accf-7644d9486471","Type":"ContainerDied","Data":"89199a6fecdef9fca06c1be11a34991d23dea6bba7824f794443ecfabeff32fb"}
Sep 10 14:46:40.301002 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.300946    2577 scope.go:117] "RemoveContainer" containerID="5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4"
Sep 10 14:46:40.311394 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.311367    2577 scope.go:117] "RemoveContainer" containerID="5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4"
Sep 10 14:46:40.311723 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:46:40.311685    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4\": container with ID starting with 5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4 not found: ID does not exist" containerID="5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4"
Sep 10 14:46:40.311816 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.311730    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4"} err="failed to get container status \"5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4\": rpc error: code = NotFound desc = could not find container \"5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4\": container with ID starting with 5c5682d1862950d22e2ea531a89a83a3ecedd9fbc046e025ea625a6407ff37c4 not found: ID does not exist"
Sep 10 14:46:40.321778 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.321751    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"]
Sep 10 14:46:40.326380 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:40.326361    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b"]
Sep 10 14:46:41.510893 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:41.510839    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693969cc-89a3-4271-accf-7644d9486471" path="/var/lib/kubelet/pods/693969cc-89a3-4271-accf-7644d9486471/volumes"
Sep 10 14:46:41.511399 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:41.511319    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef77e429-82a9-436e-b7b1-cf0bde7e37b1" path="/var/lib/kubelet/pods/ef77e429-82a9-436e-b7b1-cf0bde7e37b1/volumes"
Sep 10 14:46:49.642407 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:46:49.642379    2577 scope.go:117] "RemoveContainer" containerID="e4d89b512eafa80a2a27dcee3cf44210d1c2d74d4720060287ee3e2ed3d8893d"
Sep 10 14:47:35.834686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:35.834653    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"]
Sep 10 14:47:35.835331 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:35.834869    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy" containerID="cri-o://f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299" gracePeriod=30
Sep 10 14:47:41.101965 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.101901    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:47:41.156081 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156039    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-token\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156100    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-envoy\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156133    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-certs\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156193    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-socket\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156223    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-data\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156289 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156276    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-podinfo\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156316    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lgbj\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-kube-api-access-9lgbj\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156372    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-credential-socket\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156459    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dadd509-340b-40b2-90be-4e05c2bf5cff-istiod-ca-cert\") pod \"9dadd509-340b-40b2-90be-4e05c2bf5cff\" (UID: \"9dadd509-340b-40b2-90be-4e05c2bf5cff\") "
Sep 10 14:47:41.156557 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156542    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:41.156767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156554    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:41.156767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156531    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-data" (OuterVolumeSpecName: "istio-data") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:41.156905 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156774    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:41.156905 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156826    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.156905 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156856    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.156905 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156875    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.156905 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.156896    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dadd509-340b-40b2-90be-4e05c2bf5cff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:47:41.158462 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.158436    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:41.158577 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.158557    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-kube-api-access-9lgbj" (OuterVolumeSpecName: "kube-api-access-9lgbj") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "kube-api-access-9lgbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:41.158750 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.158722    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:47:41.158906 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.158754    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-token" (OuterVolumeSpecName: "istio-token") pod "9dadd509-340b-40b2-90be-4e05c2bf5cff" (UID: "9dadd509-340b-40b2-90be-4e05c2bf5cff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:41.258253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.258215    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.258253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.258247    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dadd509-340b-40b2-90be-4e05c2bf5cff-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.258253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.258256    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.258253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.258265    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.258520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.258273    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dadd509-340b-40b2-90be-4e05c2bf5cff-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.258520 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.258282    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lgbj\" (UniqueName: \"kubernetes.io/projected/9dadd509-340b-40b2-90be-4e05c2bf5cff-kube-api-access-9lgbj\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:47:41.643686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.643649    2577 generic.go:356] "Generic (PLEG): container finished" podID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerID="f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299" exitCode=0
Sep 10 14:47:41.643892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.643704    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"
Sep 10 14:47:41.643892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.643718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" event={"ID":"9dadd509-340b-40b2-90be-4e05c2bf5cff","Type":"ContainerDied","Data":"f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299"}
Sep 10 14:47:41.643892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.643774    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c" event={"ID":"9dadd509-340b-40b2-90be-4e05c2bf5cff","Type":"ContainerDied","Data":"b071536ef8ecefc05762d123f408426301e764648e0e8535f0752f25f6c4cca0"}
Sep 10 14:47:41.643892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.643804    2577 scope.go:117] "RemoveContainer" containerID="f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299"
Sep 10 14:47:41.653315 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.653297    2577 scope.go:117] "RemoveContainer" containerID="7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376"
Sep 10 14:47:41.662422 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.662394    2577 scope.go:117] "RemoveContainer" containerID="f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299"
Sep 10 14:47:41.662690 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:47:41.662669    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299\": container with ID starting with f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299 not found: ID does not exist" containerID="f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299"
Sep 10 14:47:41.662753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.662700    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299"} err="failed to get container status \"f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299\": rpc error: code = NotFound desc = could not find container \"f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299\": container with ID starting with f9fb34cb2d1b4da58bcdfe120000d93b74efb5cf4fda671608fdea7405d14299 not found: ID does not exist"
Sep 10 14:47:41.662753 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.662718    2577 scope.go:117] "RemoveContainer" containerID="7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376"
Sep 10 14:47:41.663008 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:47:41.662986    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376\": container with ID starting with 7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376 not found: ID does not exist" containerID="7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376"
Sep 10 14:47:41.663075 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.663017    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376"} err="failed to get container status \"7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376\": rpc error: code = NotFound desc = could not find container \"7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376\": container with ID starting with 7d2be8da05b306c86b467877a9ecd87531509e1b3ee7be9d82c44fe2bd9cb376 not found: ID does not exist"
Sep 10 14:47:41.663358 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.663344    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"]
Sep 10 14:47:41.665536 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:41.665511    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c"]
Sep 10 14:47:43.510234 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:47:43.510205    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" path="/var/lib/kubelet/pods/9dadd509-340b-40b2-90be-4e05c2bf5cff/volumes"
Sep 10 14:48:30.002490 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.002398    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"]
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003000    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693969cc-89a3-4271-accf-7644d9486471" containerName="payload-pre-processing"
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="693969cc-89a3-4271-accf-7644d9486471" containerName="payload-pre-processing"
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003029    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy"
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003037    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy"
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003047    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy"
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003056    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy"
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003078    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef77e429-82a9-436e-b7b1-cf0bde7e37b1" containerName="revoke-keys"
Sep 10 14:48:30.003080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003085    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef77e429-82a9-436e-b7b1-cf0bde7e37b1" containerName="revoke-keys"
Sep 10 14:48:30.003518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003185    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy"
Sep 10 14:48:30.003518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003196    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="693969cc-89a3-4271-accf-7644d9486471" containerName="payload-pre-processing"
Sep 10 14:48:30.003518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.003209    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef77e429-82a9-436e-b7b1-cf0bde7e37b1" containerName="revoke-keys"
Sep 10 14:48:30.006481 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.006461    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.008479 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.008457    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9c318b-openshift-default-dockercfg-wgtc6\""
Sep 10 14:48:30.018424 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.018403    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"]
Sep 10 14:48:30.152075 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-envoy\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152245 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152105    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-socket\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152245 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qg8k\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-kube-api-access-9qg8k\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152245 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-podinfo\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-credential-socket\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b0afc-6b38-435e-b54d-cedf7e352ef1-istiod-ca-cert\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152352 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-token\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152451 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-certs\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.152451 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.152417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-data\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253527 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-socket\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253527 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qg8k\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-kube-api-access-9qg8k\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-podinfo\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-credential-socket\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b0afc-6b38-435e-b54d-cedf7e352ef1-istiod-ca-cert\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-token\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-certs\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.253760 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.253675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-data\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.254115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.254000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-credential-socket\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.254115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.254032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-envoy\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.254115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.254069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-certs\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.254286 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.254115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-socket\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.254286 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.254152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-data\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.254577 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.254558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b0afc-6b38-435e-b54d-cedf7e352ef1-istiod-ca-cert\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.256084 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.256054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-envoy\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.256190 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.256109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-podinfo\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.260294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.260267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-token\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.260406 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.260359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qg8k\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-kube-api-access-9qg8k\") pod \"e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") " pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.318588 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.318560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:30.598027 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.598000    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"]
Sep 10 14:48:30.600549 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:48:30.600521    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136b0afc_6b38_435e_b54d_cedf7e352ef1.slice/crio-6b7c0d33e4fc7fe36b2aaeddbb5604c1898d4ce931aeb26e1eb5ac57d5bd041c WatchSource:0}: Error finding container 6b7c0d33e4fc7fe36b2aaeddbb5604c1898d4ce931aeb26e1eb5ac57d5bd041c: Status 404 returned error can't find the container with id 6b7c0d33e4fc7fe36b2aaeddbb5604c1898d4ce931aeb26e1eb5ac57d5bd041c
Sep 10 14:48:30.603018 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.602975    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:30.603108 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.603076    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:30.603165 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.603148    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:30.924183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.924128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" event={"ID":"136b0afc-6b38-435e-b54d-cedf7e352ef1","Type":"ContainerStarted","Data":"0c9f460f900aed890a679564c8f5b52bef89055b5141cd176879f7b72835c054"}
Sep 10 14:48:30.924399 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.924212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" event={"ID":"136b0afc-6b38-435e-b54d-cedf7e352ef1","Type":"ContainerStarted","Data":"6b7c0d33e4fc7fe36b2aaeddbb5604c1898d4ce931aeb26e1eb5ac57d5bd041c"}
Sep 10 14:48:30.947497 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:30.947452    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podStartSLOduration=1.9474149330000001 podStartE2EDuration="1.947414933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:48:30.945551186 +0000 UTC m=+1721.922680539" watchObservedRunningTime="2026-09-10 14:48:30.947414933 +0000 UTC m=+1721.924544286"
Sep 10 14:48:31.319635 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:31.319549    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:31.325792 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:31.325759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:31.930295 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:31.930259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:31.931397 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:31.931368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:49.682551 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:49.682513    2577 scope.go:117] "RemoveContainer" containerID="9b37901d2d72b08fe4862c4f0a3b29e36d585cc2d9d1c243d6fec34efa7d6092"
Sep 10 14:48:51.044714 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:51.044681    2577 generic.go:356] "Generic (PLEG): container finished" podID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerID="0c9f460f900aed890a679564c8f5b52bef89055b5141cd176879f7b72835c054" exitCode=0
Sep 10 14:48:51.045278 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:51.044755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" event={"ID":"136b0afc-6b38-435e-b54d-cedf7e352ef1","Type":"ContainerDied","Data":"0c9f460f900aed890a679564c8f5b52bef89055b5141cd176879f7b72835c054"}
Sep 10 14:48:51.045278 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:51.045185    2577 scope.go:117] "RemoveContainer" containerID="0c9f460f900aed890a679564c8f5b52bef89055b5141cd176879f7b72835c054"
Sep 10 14:48:51.046394 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:51.046365    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:51.046453 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:51.046432    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:51.046488 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:51.046465    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:52.051941 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:52.051906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" event={"ID":"136b0afc-6b38-435e-b54d-cedf7e352ef1","Type":"ContainerStarted","Data":"5989c9ff2b785fcf5b1096951aa90659d0ab4fd01a7e88f84a617f3b544f6fcd"}
Sep 10 14:48:52.319154 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:52.319063    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:52.319348 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:52.319326    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:48:52.319391 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:52.319378    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 10 14:48:53.319301 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:53.319262    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:48:53.319741 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:53.319330    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 10 14:48:54.319180 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:54.319145    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:48:54.319369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:54.319210    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 10 14:48:55.319211 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:55.319177    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:48:55.319396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:55.319235    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 10 14:48:56.319006 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:56.318968    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:48:56.319191 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:56.319045    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 10 14:48:57.324294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:57.324260    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:57.324794 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:57.324531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:57.325168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:57.325149    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:48:58.460925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.460888    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"]
Sep 10 14:48:58.461547 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.461527    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dadd509-340b-40b2-90be-4e05c2bf5cff" containerName="istio-proxy"
Sep 10 14:48:58.463967 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.463943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.466005 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.465939    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-84eb72-openshift-default-dockercfg-klcq2\""
Sep 10 14:48:58.476432 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.476405    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"]
Sep 10 14:48:58.559481 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-envoy\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-credential-socket\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042b8ee7-ea87-4395-a232-7c519e15afa3-istiod-ca-cert\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-data\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-token\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559948 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwwh\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-kube-api-access-6bwwh\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559948 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-podinfo\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559948 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-socket\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.559948 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.559931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-certs\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.660686 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-envoy\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.660914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-credential-socket\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.660914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042b8ee7-ea87-4395-a232-7c519e15afa3-istiod-ca-cert\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.660914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-data\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.660914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-token\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.660914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwwh\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-kube-api-access-6bwwh\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.660914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-podinfo\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.661250 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-socket\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.661250 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.660972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-certs\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.661250 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.661229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-data\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.661400 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.661263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-credential-socket\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.661466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.661404    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-socket\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.661524 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.661498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-certs\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.661800 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.661775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042b8ee7-ea87-4395-a232-7c519e15afa3-istiod-ca-cert\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.663297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.663274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-envoy\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.663539 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.663519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-podinfo\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.668196 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.668165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwwh\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-kube-api-access-6bwwh\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.668281 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.668171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-token\") pod \"e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") " pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:58.776499 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:58.776407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:48:59.056372 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:59.056346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"]
Sep 10 14:48:59.059111 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:48:59.059061    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042b8ee7_ea87_4395_a232_7c519e15afa3.slice/crio-35a9a72b435c78e89e87b9352b2b36a931cec997fe79d724fa15287988d0696b WatchSource:0}: Error finding container 35a9a72b435c78e89e87b9352b2b36a931cec997fe79d724fa15287988d0696b: Status 404 returned error can't find the container with id 35a9a72b435c78e89e87b9352b2b36a931cec997fe79d724fa15287988d0696b
Sep 10 14:48:59.061591 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:59.061557    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:59.061706 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:59.061623    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:59.061706 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:59.061654    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:48:59.097262 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:48:59.097229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" event={"ID":"042b8ee7-ea87-4395-a232-7c519e15afa3","Type":"ContainerStarted","Data":"35a9a72b435c78e89e87b9352b2b36a931cec997fe79d724fa15287988d0696b"}
Sep 10 14:49:00.104516 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:00.104477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" event={"ID":"042b8ee7-ea87-4395-a232-7c519e15afa3","Type":"ContainerStarted","Data":"8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28"}
Sep 10 14:49:00.124220 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:00.124168    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" podStartSLOduration=2.124150722 podStartE2EDuration="2.124150722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:49:00.122744401 +0000 UTC m=+1751.099873754" watchObservedRunningTime="2026-09-10 14:49:00.124150722 +0000 UTC m=+1751.101280398"
Sep 10 14:49:00.777499 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:00.777463    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:00.783140 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:00.783110    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:01.110250 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:01.110173    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:01.111276 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:01.111256    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:03.819608 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:03.819563    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"]
Sep 10 14:49:03.822070 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:03.822054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:03.824014 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:03.823985    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-84eb72\""
Sep 10 14:49:03.824153 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:03.824061    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-84eb72-dockercfg-hbz9q\""
Sep 10 14:49:03.833327 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:03.833300    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"]
Sep 10 14:49:03.919516 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:03.919477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:03.919883 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:03.919836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqpbw\" (UniqueName: \"kubernetes.io/projected/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-kube-api-access-lqpbw\") pod \"payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:04.021109 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:04.021073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:04.021109 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:04.021114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqpbw\" (UniqueName: \"kubernetes.io/projected/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-kube-api-access-lqpbw\") pod \"payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:04.021736 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:04.021715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:04.029236 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:04.029204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqpbw\" (UniqueName: \"kubernetes.io/projected/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-kube-api-access-lqpbw\") pod \"payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:04.134311 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:04.134287    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:04.405720 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:04.405694    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"]
Sep 10 14:49:04.408112 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:49:04.408084    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5e7c64_735f_4e2c_8c31_55eca6f5a69b.slice/crio-2ee6b5f8021334e1a626adae0413293f888e76c53cafceddfd9b3d305ced24a5 WatchSource:0}: Error finding container 2ee6b5f8021334e1a626adae0413293f888e76c53cafceddfd9b3d305ced24a5: Status 404 returned error can't find the container with id 2ee6b5f8021334e1a626adae0413293f888e76c53cafceddfd9b3d305ced24a5
Sep 10 14:49:05.134680 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:05.134650    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp" event={"ID":"be5e7c64-735f-4e2c-8c31-55eca6f5a69b","Type":"ContainerStarted","Data":"1fceafd2c5605f00d816908c38045c71984496aa7dcaa5df32c2b62b9c3f2a72"}
Sep 10 14:49:05.135128 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:05.134698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp" event={"ID":"be5e7c64-735f-4e2c-8c31-55eca6f5a69b","Type":"ContainerStarted","Data":"2ee6b5f8021334e1a626adae0413293f888e76c53cafceddfd9b3d305ced24a5"}
Sep 10 14:49:05.135128 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:05.134800    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:05.150717 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:05.150664    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp" podStartSLOduration=2.150645821 podStartE2EDuration="2.150645821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:49:05.150288178 +0000 UTC m=+1756.127417578" watchObservedRunningTime="2026-09-10 14:49:05.150645821 +0000 UTC m=+1756.127775175"
Sep 10 14:49:16.142627 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:16.142590    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:49:21.238003 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:21.237967    2577 generic.go:356] "Generic (PLEG): container finished" podID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerID="8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28" exitCode=0
Sep 10 14:49:21.238485 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:21.238041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" event={"ID":"042b8ee7-ea87-4395-a232-7c519e15afa3","Type":"ContainerDied","Data":"8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28"}
Sep 10 14:49:21.238565 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:21.238511    2577 scope.go:117] "RemoveContainer" containerID="8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28"
Sep 10 14:49:21.239621 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:21.239595    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:49:21.239676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:21.239662    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:49:21.239719 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:21.239692    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:49:22.245230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:22.245194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" event={"ID":"042b8ee7-ea87-4395-a232-7c519e15afa3","Type":"ContainerStarted","Data":"59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a"}
Sep 10 14:49:22.776984 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:22.776940    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:22.777206 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:22.777075    2577 patch_prober.go:28] interesting pod/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:49:22.777206 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:22.777139    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:49:23.777239 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:23.777199    2577 patch_prober.go:28] interesting pod/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:49:23.777856 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:23.777809    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:49:24.777307 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:24.777270    2577 patch_prober.go:28] interesting pod/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:49:24.778581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:24.778550    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:49:25.778015 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:25.777973    2577 patch_prober.go:28] interesting pod/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:49:25.778609 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:25.778575    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:49:26.777358 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:26.777316    2577 patch_prober.go:28] interesting pod/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:49:26.777676 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:26.777642    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:49:27.781756 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:27.781724    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:27.782238 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:27.782140    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:27.782815 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:27.782796    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:49:29.922169 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:29.922129    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"]
Sep 10 14:49:29.925579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:29.925559    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"
Sep 10 14:49:29.927909 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:29.927890    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:49:29.928014 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:29.927891    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:49:29.933625 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:29.933376    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"]
Sep 10 14:49:29.998813 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:29.998775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9c318b-kjslv\" (UID: \"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"
Sep 10 14:49:30.100176 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:30.100137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9c318b-kjslv\" (UID: \"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"
Sep 10 14:49:30.100875 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:30.100816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9c318b-kjslv\" (UID: \"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"
Sep 10 14:49:30.237451 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:30.237350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"
Sep 10 14:49:30.508967 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:30.508941    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"]
Sep 10 14:49:30.511614 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:49:30.511585    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e544e34_fd0a_4524_8f9f_fb9aa0bbe4c7.slice/crio-6d2ace62c9d745cc786efb995c286170dcb66700e4bb7e238d9d5b8a3dc9b6c5 WatchSource:0}: Error finding container 6d2ace62c9d745cc786efb995c286170dcb66700e4bb7e238d9d5b8a3dc9b6c5: Status 404 returned error can't find the container with id 6d2ace62c9d745cc786efb995c286170dcb66700e4bb7e238d9d5b8a3dc9b6c5
Sep 10 14:49:31.313681 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:31.313647    2577 generic.go:356] "Generic (PLEG): container finished" podID="3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7" containerID="0dfaef4880000569099f4f63e23324f4ddf6d5cfc45d12c49dcce9a6315bc6bb" exitCode=0
Sep 10 14:49:31.314066 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:31.313732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv" event={"ID":"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7","Type":"ContainerDied","Data":"0dfaef4880000569099f4f63e23324f4ddf6d5cfc45d12c49dcce9a6315bc6bb"}
Sep 10 14:49:31.314066 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:31.313788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv" event={"ID":"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7","Type":"ContainerStarted","Data":"6d2ace62c9d745cc786efb995c286170dcb66700e4bb7e238d9d5b8a3dc9b6c5"}
Sep 10 14:49:32.460879 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:32.460853    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"
Sep 10 14:49:32.529756 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:32.529719    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7-maas-api-service-ca\") pod \"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7\" (UID: \"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7\") "
Sep 10 14:49:32.530120 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:32.530097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7" (UID: "3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:49:32.631439 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:32.631392    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:33.326537 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:33.326507    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"
Sep 10 14:49:33.326716 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:33.326543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv" event={"ID":"3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7","Type":"ContainerDied","Data":"6d2ace62c9d745cc786efb995c286170dcb66700e4bb7e238d9d5b8a3dc9b6c5"}
Sep 10 14:49:33.326716 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:33.326588    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d2ace62c9d745cc786efb995c286170dcb66700e4bb7e238d9d5b8a3dc9b6c5"
Sep 10 14:49:45.926186 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:45.926102    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"]
Sep 10 14:49:45.928353 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:45.928329    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9c318b-kjslv"]
Sep 10 14:49:47.511524 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:47.511490    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7" path="/var/lib/kubelet/pods/3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7/volumes"
Sep 10 14:49:49.541320 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:49.541294    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:49:49.545101 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:49.545078    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:49:49.706689 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:49.706649    2577 scope.go:117] "RemoveContainer" containerID="44c8cf1d024136be937625a9e02bf31841d9cf36b88c2ed657eaad273ec25cf9"
Sep 10 14:49:49.715530 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:49.715509    2577 scope.go:117] "RemoveContainer" containerID="8870254608c6c87667a3eb5a2bf90280be4b4e70a2b78898b654731aad57a1fc"
Sep 10 14:49:52.267905 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.267870    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"]
Sep 10 14:49:52.268357 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.268149    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy" containerID="cri-o://5989c9ff2b785fcf5b1096951aa90659d0ab4fd01a7e88f84a617f3b544f6fcd" gracePeriod=30
Sep 10 14:49:52.634703 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.634670    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"]
Sep 10 14:49:52.635121 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.635107    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7" containerName="revoke-keys"
Sep 10 14:49:52.635170 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.635123    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7" containerName="revoke-keys"
Sep 10 14:49:52.635217 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.635206    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e544e34-fd0a-4524-8f9f-fb9aa0bbe4c7" containerName="revoke-keys"
Sep 10 14:49:52.638267 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.638250    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"
Sep 10 14:49:52.640242 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.640219    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:49:52.640242 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.640228    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:49:52.644589 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.644564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"]
Sep 10 14:49:52.740512 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.740473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae036a1-17a7-4d98-aa3b-076293a0aedf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc\" (UID: \"dae036a1-17a7-4d98-aa3b-076293a0aedf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"
Sep 10 14:49:52.841942 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.841907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae036a1-17a7-4d98-aa3b-076293a0aedf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc\" (UID: \"dae036a1-17a7-4d98-aa3b-076293a0aedf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"
Sep 10 14:49:52.842580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.842555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae036a1-17a7-4d98-aa3b-076293a0aedf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc\" (UID: \"dae036a1-17a7-4d98-aa3b-076293a0aedf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"
Sep 10 14:49:52.950539 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:52.950450    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"
Sep 10 14:49:53.223618 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:53.223590    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"]
Sep 10 14:49:53.226107 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:49:53.226080    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae036a1_17a7_4d98_aa3b_076293a0aedf.slice/crio-7f32ec0ec5197f35093e84cd515688fd35c4ceeb578a65d880fd3a34c2d9e460 WatchSource:0}: Error finding container 7f32ec0ec5197f35093e84cd515688fd35c4ceeb578a65d880fd3a34c2d9e460: Status 404 returned error can't find the container with id 7f32ec0ec5197f35093e84cd515688fd35c4ceeb578a65d880fd3a34c2d9e460
Sep 10 14:49:53.444857 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:53.444805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc" event={"ID":"dae036a1-17a7-4d98-aa3b-076293a0aedf","Type":"ContainerStarted","Data":"7f32ec0ec5197f35093e84cd515688fd35c4ceeb578a65d880fd3a34c2d9e460"}
Sep 10 14:49:54.451487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:54.451455    2577 generic.go:356] "Generic (PLEG): container finished" podID="dae036a1-17a7-4d98-aa3b-076293a0aedf" containerID="d1e639ab27ad8c6e3529b34fae25bd6902ad2485b1b01fbf3fd90c854d4f94c9" exitCode=0
Sep 10 14:49:54.451954 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:54.451528    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc" event={"ID":"dae036a1-17a7-4d98-aa3b-076293a0aedf","Type":"ContainerDied","Data":"d1e639ab27ad8c6e3529b34fae25bd6902ad2485b1b01fbf3fd90c854d4f94c9"}
Sep 10 14:49:55.599042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:55.599017    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"
Sep 10 14:49:55.671553 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:55.671523    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae036a1-17a7-4d98-aa3b-076293a0aedf-maas-api-service-ca\") pod \"dae036a1-17a7-4d98-aa3b-076293a0aedf\" (UID: \"dae036a1-17a7-4d98-aa3b-076293a0aedf\") "
Sep 10 14:49:55.671959 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:55.671938    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dae036a1-17a7-4d98-aa3b-076293a0aedf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dae036a1-17a7-4d98-aa3b-076293a0aedf" (UID: "dae036a1-17a7-4d98-aa3b-076293a0aedf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:49:55.773039 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:55.772958    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dae036a1-17a7-4d98-aa3b-076293a0aedf-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:56.463538 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:56.463505    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"
Sep 10 14:49:56.463538 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:56.463514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc" event={"ID":"dae036a1-17a7-4d98-aa3b-076293a0aedf","Type":"ContainerDied","Data":"7f32ec0ec5197f35093e84cd515688fd35c4ceeb578a65d880fd3a34c2d9e460"}
Sep 10 14:49:56.463757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:56.463570    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f32ec0ec5197f35093e84cd515688fd35c4ceeb578a65d880fd3a34c2d9e460"
Sep 10 14:49:57.326099 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.326063    2577 patch_prober.go:28] interesting pod/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:49:57.326487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.326143    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 10 14:49:57.471633 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.471598    2577 generic.go:356] "Generic (PLEG): container finished" podID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerID="5989c9ff2b785fcf5b1096951aa90659d0ab4fd01a7e88f84a617f3b544f6fcd" exitCode=0
Sep 10 14:49:57.471795 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.471669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" event={"ID":"136b0afc-6b38-435e-b54d-cedf7e352ef1","Type":"ContainerDied","Data":"5989c9ff2b785fcf5b1096951aa90659d0ab4fd01a7e88f84a617f3b544f6fcd"}
Sep 10 14:49:57.471795 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.471736    2577 scope.go:117] "RemoveContainer" containerID="0c9f460f900aed890a679564c8f5b52bef89055b5141cd176879f7b72835c054"
Sep 10 14:49:57.535138 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.535076    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:49:57.592568 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592540    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b0afc-6b38-435e-b54d-cedf7e352ef1-istiod-ca-cert\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.592568 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592570    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-token\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.592803 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592588    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-envoy\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.592803 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592659    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-credential-socket\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.592803 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592726    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qg8k\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-kube-api-access-9qg8k\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.592803 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-certs\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.593042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592805    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-podinfo\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.593042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592855    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-data\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.593042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.592899    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-socket\") pod \"136b0afc-6b38-435e-b54d-cedf7e352ef1\" (UID: \"136b0afc-6b38-435e-b54d-cedf7e352ef1\") "
Sep 10 14:49:57.593042 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.593012    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:49:57.593243 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.593200    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:49:57.593427 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.593314    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.593427 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.593340    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.593427 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.593359    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-data" (OuterVolumeSpecName: "istio-data") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:49:57.593636 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.593427    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:49:57.593636 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.593571    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136b0afc-6b38-435e-b54d-cedf7e352ef1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:49:57.595207 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.595176    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:49:57.595368 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.595346    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:49:57.595447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.595362    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-token" (OuterVolumeSpecName: "istio-token") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:49:57.595447 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.595347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-kube-api-access-9qg8k" (OuterVolumeSpecName: "kube-api-access-9qg8k") pod "136b0afc-6b38-435e-b54d-cedf7e352ef1" (UID: "136b0afc-6b38-435e-b54d-cedf7e352ef1"). InnerVolumeSpecName "kube-api-access-9qg8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:49:57.694823 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.694791    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qg8k\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-kube-api-access-9qg8k\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.694823 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.694820    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.695035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.694871    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.695035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.694886    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.695035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.694900    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b0afc-6b38-435e-b54d-cedf7e352ef1-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.695035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.694912    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:57.695035 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:57.694924    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b0afc-6b38-435e-b54d-cedf7e352ef1-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:49:58.479087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:58.479046    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"
Sep 10 14:49:58.479533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:58.479086    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f" event={"ID":"136b0afc-6b38-435e-b54d-cedf7e352ef1","Type":"ContainerDied","Data":"6b7c0d33e4fc7fe36b2aaeddbb5604c1898d4ce931aeb26e1eb5ac57d5bd041c"}
Sep 10 14:49:58.479533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:58.479151    2577 scope.go:117] "RemoveContainer" containerID="5989c9ff2b785fcf5b1096951aa90659d0ab4fd01a7e88f84a617f3b544f6fcd"
Sep 10 14:49:58.500272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:58.500236    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"]
Sep 10 14:49:58.505440 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:58.505417    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f"]
Sep 10 14:49:59.511291 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:49:59.511258    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" path="/var/lib/kubelet/pods/136b0afc-6b38-435e-b54d-cedf7e352ef1/volumes"
Sep 10 14:50:08.361636 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.361603    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"]
Sep 10 14:50:08.362175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.361903    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp" podUID="be5e7c64-735f-4e2c-8c31-55eca6f5a69b" containerName="payload-pre-processing" containerID="cri-o://1fceafd2c5605f00d816908c38045c71984496aa7dcaa5df32c2b62b9c3f2a72" gracePeriod=30
Sep 10 14:50:08.520528 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.520480    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"]
Sep 10 14:50:08.522581 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.522558    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84eb72-g2bfc"]
Sep 10 14:50:08.539378 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.539343    2577 generic.go:356] "Generic (PLEG): container finished" podID="be5e7c64-735f-4e2c-8c31-55eca6f5a69b" containerID="1fceafd2c5605f00d816908c38045c71984496aa7dcaa5df32c2b62b9c3f2a72" exitCode=0
Sep 10 14:50:08.539530 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.539407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp" event={"ID":"be5e7c64-735f-4e2c-8c31-55eca6f5a69b","Type":"ContainerDied","Data":"1fceafd2c5605f00d816908c38045c71984496aa7dcaa5df32c2b62b9c3f2a72"}
Sep 10 14:50:08.625206 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.625182    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:50:08.716259 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.716224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-plugins-config-volume\") pod \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") "
Sep 10 14:50:08.716455 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.716284    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqpbw\" (UniqueName: \"kubernetes.io/projected/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-kube-api-access-lqpbw\") pod \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\" (UID: \"be5e7c64-735f-4e2c-8c31-55eca6f5a69b\") "
Sep 10 14:50:08.716617 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.716592    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be5e7c64-735f-4e2c-8c31-55eca6f5a69b" (UID: "be5e7c64-735f-4e2c-8c31-55eca6f5a69b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:08.718494 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.718470    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-kube-api-access-lqpbw" (OuterVolumeSpecName: "kube-api-access-lqpbw") pod "be5e7c64-735f-4e2c-8c31-55eca6f5a69b" (UID: "be5e7c64-735f-4e2c-8c31-55eca6f5a69b"). InnerVolumeSpecName "kube-api-access-lqpbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:08.818045 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.818006    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:08.818045 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:08.818039    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqpbw\" (UniqueName: \"kubernetes.io/projected/be5e7c64-735f-4e2c-8c31-55eca6f5a69b-kube-api-access-lqpbw\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:09.511295 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:09.511266    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae036a1-17a7-4d98-aa3b-076293a0aedf" path="/var/lib/kubelet/pods/dae036a1-17a7-4d98-aa3b-076293a0aedf/volumes"
Sep 10 14:50:09.546048 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:09.546024    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"
Sep 10 14:50:09.546176 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:09.546050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp" event={"ID":"be5e7c64-735f-4e2c-8c31-55eca6f5a69b","Type":"ContainerDied","Data":"2ee6b5f8021334e1a626adae0413293f888e76c53cafceddfd9b3d305ced24a5"}
Sep 10 14:50:09.546176 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:09.546104    2577 scope.go:117] "RemoveContainer" containerID="1fceafd2c5605f00d816908c38045c71984496aa7dcaa5df32c2b62b9c3f2a72"
Sep 10 14:50:09.561050 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:09.561026    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"]
Sep 10 14:50:09.563115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:09.563093    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp"]
Sep 10 14:50:11.510393 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:11.510361    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be5e7c64-735f-4e2c-8c31-55eca6f5a69b" path="/var/lib/kubelet/pods/be5e7c64-735f-4e2c-8c31-55eca6f5a69b/volumes"
Sep 10 14:50:14.704349 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:14.704296    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"]
Sep 10 14:50:14.704921 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:14.704581    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy" containerID="cri-o://59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a" gracePeriod=30
Sep 10 14:50:15.086737 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.086653    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"]
Sep 10 14:50:15.087135 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087118    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae036a1-17a7-4d98-aa3b-076293a0aedf" containerName="revoke-keys"
Sep 10 14:50:15.087189 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087139    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae036a1-17a7-4d98-aa3b-076293a0aedf" containerName="revoke-keys"
Sep 10 14:50:15.087189 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087157    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy"
Sep 10 14:50:15.087189 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087165    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy"
Sep 10 14:50:15.087292 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087191    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be5e7c64-735f-4e2c-8c31-55eca6f5a69b" containerName="payload-pre-processing"
Sep 10 14:50:15.087292 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087201    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be5e7c64-735f-4e2c-8c31-55eca6f5a69b" containerName="payload-pre-processing"
Sep 10 14:50:15.087356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087319    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy"
Sep 10 14:50:15.087356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087331    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy"
Sep 10 14:50:15.087356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087340    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae036a1-17a7-4d98-aa3b-076293a0aedf" containerName="revoke-keys"
Sep 10 14:50:15.087356 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.087353    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="be5e7c64-735f-4e2c-8c31-55eca6f5a69b" containerName="payload-pre-processing"
Sep 10 14:50:15.092142 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.092121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"
Sep 10 14:50:15.094156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.094127    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:50:15.094306 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.094135    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:50:15.097283 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.097247    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"]
Sep 10 14:50:15.180512 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.180471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63f78edf-bd86-4da3-9715-0d40ccbb9534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4\" (UID: \"63f78edf-bd86-4da3-9715-0d40ccbb9534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"
Sep 10 14:50:15.281617 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.281579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63f78edf-bd86-4da3-9715-0d40ccbb9534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4\" (UID: \"63f78edf-bd86-4da3-9715-0d40ccbb9534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"
Sep 10 14:50:15.282238 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.282216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63f78edf-bd86-4da3-9715-0d40ccbb9534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4\" (UID: \"63f78edf-bd86-4da3-9715-0d40ccbb9534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"
Sep 10 14:50:15.404479 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.404444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"
Sep 10 14:50:15.699330 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:15.699304    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"]
Sep 10 14:50:15.701651 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:50:15.701621    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f78edf_bd86_4da3_9715_0d40ccbb9534.slice/crio-5c4499f52ed1594a75186cead155ff60a947ee4e2acb8fd2a9f41c53bbcc0b65 WatchSource:0}: Error finding container 5c4499f52ed1594a75186cead155ff60a947ee4e2acb8fd2a9f41c53bbcc0b65: Status 404 returned error can't find the container with id 5c4499f52ed1594a75186cead155ff60a947ee4e2acb8fd2a9f41c53bbcc0b65
Sep 10 14:50:16.594877 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:16.594809    2577 generic.go:356] "Generic (PLEG): container finished" podID="63f78edf-bd86-4da3-9715-0d40ccbb9534" containerID="af4ae0c6ea1478a0291dd35f572b12dd9096847fb24c29f9594c63a070bb2eb4" exitCode=0
Sep 10 14:50:16.595343 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:16.594900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4" event={"ID":"63f78edf-bd86-4da3-9715-0d40ccbb9534","Type":"ContainerDied","Data":"af4ae0c6ea1478a0291dd35f572b12dd9096847fb24c29f9594c63a070bb2eb4"}
Sep 10 14:50:16.595343 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:16.594953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4" event={"ID":"63f78edf-bd86-4da3-9715-0d40ccbb9534","Type":"ContainerStarted","Data":"5c4499f52ed1594a75186cead155ff60a947ee4e2acb8fd2a9f41c53bbcc0b65"}
Sep 10 14:50:17.737937 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:17.737908    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"
Sep 10 14:50:17.809677 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:17.809644    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63f78edf-bd86-4da3-9715-0d40ccbb9534-maas-api-service-ca\") pod \"63f78edf-bd86-4da3-9715-0d40ccbb9534\" (UID: \"63f78edf-bd86-4da3-9715-0d40ccbb9534\") "
Sep 10 14:50:17.809985 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:17.809964    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63f78edf-bd86-4da3-9715-0d40ccbb9534-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63f78edf-bd86-4da3-9715-0d40ccbb9534" (UID: "63f78edf-bd86-4da3-9715-0d40ccbb9534"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:17.911484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:17.911450    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63f78edf-bd86-4da3-9715-0d40ccbb9534-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:18.607521 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:18.607488    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4" event={"ID":"63f78edf-bd86-4da3-9715-0d40ccbb9534","Type":"ContainerDied","Data":"5c4499f52ed1594a75186cead155ff60a947ee4e2acb8fd2a9f41c53bbcc0b65"}
Sep 10 14:50:18.607521 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:18.607521    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"
Sep 10 14:50:18.607743 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:18.607538    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c4499f52ed1594a75186cead155ff60a947ee4e2acb8fd2a9f41c53bbcc0b65"
Sep 10 14:50:19.968021 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:19.967961    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:50:20.032442 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032413    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-credential-socket\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032450    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-token\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032500    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042b8ee7-ea87-4395-a232-7c519e15afa3-istiod-ca-cert\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032537    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bwwh\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-kube-api-access-6bwwh\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032560    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-socket\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032583    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-data\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032608    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-envoy\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032664    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-certs\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032705    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:20.032989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032750    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-podinfo\") pod \"042b8ee7-ea87-4395-a232-7c519e15afa3\" (UID: \"042b8ee7-ea87-4395-a232-7c519e15afa3\") "
Sep 10 14:50:20.032989 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.032961    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-data" (OuterVolumeSpecName: "istio-data") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:20.033381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.033050    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:20.033381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.033111    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042b8ee7-ea87-4395-a232-7c519e15afa3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:20.033381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.033220    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/042b8ee7-ea87-4395-a232-7c519e15afa3-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.033381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.033261    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.033381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.033267    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:20.033381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.033274    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.033381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.033298    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.035096 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.035075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:50:20.035202 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.035071    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:20.035292 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.035277    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-kube-api-access-6bwwh" (OuterVolumeSpecName: "kube-api-access-6bwwh") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "kube-api-access-6bwwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:20.035292 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.035284    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-token" (OuterVolumeSpecName: "istio-token") pod "042b8ee7-ea87-4395-a232-7c519e15afa3" (UID: "042b8ee7-ea87-4395-a232-7c519e15afa3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:20.134533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.134496    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bwwh\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-kube-api-access-6bwwh\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.134533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.134530    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.134533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.134543    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.134768 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.134551    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.134768 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.134560    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/042b8ee7-ea87-4395-a232-7c519e15afa3-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:20.621642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.621607    2577 generic.go:356] "Generic (PLEG): container finished" podID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerID="59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a" exitCode=0
Sep 10 14:50:20.621790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.621654    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"
Sep 10 14:50:20.621790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.621682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" event={"ID":"042b8ee7-ea87-4395-a232-7c519e15afa3","Type":"ContainerDied","Data":"59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a"}
Sep 10 14:50:20.621790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.621733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4" event={"ID":"042b8ee7-ea87-4395-a232-7c519e15afa3","Type":"ContainerDied","Data":"35a9a72b435c78e89e87b9352b2b36a931cec997fe79d724fa15287988d0696b"}
Sep 10 14:50:20.621790 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.621756    2577 scope.go:117] "RemoveContainer" containerID="59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a"
Sep 10 14:50:20.632154 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.632129    2577 scope.go:117] "RemoveContainer" containerID="8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28"
Sep 10 14:50:20.641501 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.641481    2577 scope.go:117] "RemoveContainer" containerID="59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a"
Sep 10 14:50:20.641771 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:20.641752    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a\": container with ID starting with 59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a not found: ID does not exist" containerID="59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a"
Sep 10 14:50:20.641860 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.641779    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a"} err="failed to get container status \"59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a\": rpc error: code = NotFound desc = could not find container \"59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a\": container with ID starting with 59a6b08fdb9bddd69a553e315f963cc47c66641e81842291d1b445db050f876a not found: ID does not exist"
Sep 10 14:50:20.641860 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.641796    2577 scope.go:117] "RemoveContainer" containerID="8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28"
Sep 10 14:50:20.642111 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:20.642087    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28\": container with ID starting with 8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28 not found: ID does not exist" containerID="8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28"
Sep 10 14:50:20.642161 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.642122    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28"} err="failed to get container status \"8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28\": rpc error: code = NotFound desc = could not find container \"8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28\": container with ID starting with 8a87ccfd090823134903088132628a6a8d786741b42d241d9e3e46b071dc4b28 not found: ID does not exist"
Sep 10 14:50:20.643077 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.643059    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"]
Sep 10 14:50:20.646499 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:20.646481    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4"]
Sep 10 14:50:21.516167 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:21.516131    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" path="/var/lib/kubelet/pods/042b8ee7-ea87-4395-a232-7c519e15afa3/volumes"
Sep 10 14:50:22.534103 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534062    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"]
Sep 10 14:50:22.534480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534468    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy"
Sep 10 14:50:22.534480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534478    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="136b0afc-6b38-435e-b54d-cedf7e352ef1" containerName="istio-proxy"
Sep 10 14:50:22.534552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534492    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy"
Sep 10 14:50:22.534552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534499    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy"
Sep 10 14:50:22.534552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534507    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy"
Sep 10 14:50:22.534552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534513    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy"
Sep 10 14:50:22.534552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534534    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f78edf-bd86-4da3-9715-0d40ccbb9534" containerName="revoke-keys"
Sep 10 14:50:22.534552 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534539    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f78edf-bd86-4da3-9715-0d40ccbb9534" containerName="revoke-keys"
Sep 10 14:50:22.534728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534599    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f78edf-bd86-4da3-9715-0d40ccbb9534" containerName="revoke-keys"
Sep 10 14:50:22.534728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534607    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy"
Sep 10 14:50:22.534728 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.534614    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="042b8ee7-ea87-4395-a232-7c519e15afa3" containerName="istio-proxy"
Sep 10 14:50:22.537642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.537620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.539646 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.539619    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-cc50fd-openshift-default-dockercfg-brls7\""
Sep 10 14:50:22.548783 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.548678    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"]
Sep 10 14:50:22.662730 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.662674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-data\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.662936 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.662784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de21c12-35f8-4618-9a61-ad2486335689-istiod-ca-cert\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.662936 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.662818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-kube-api-access-ttrjg\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.662936 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.662919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de21c12-35f8-4618-9a61-ad2486335689-istio-podinfo\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.663146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.662972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-credential-socket\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.663146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.663020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-envoy\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.663146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.663043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-istio-token\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.663146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.663085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-socket\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.663146 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.663117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-certs\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764032 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.763992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-envoy\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764032 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-istio-token\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764270 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-socket\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764270 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-certs\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764270 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-data\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764433 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de21c12-35f8-4618-9a61-ad2486335689-istiod-ca-cert\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764433 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-kube-api-access-ttrjg\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764433 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de21c12-35f8-4618-9a61-ad2486335689-istio-podinfo\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764586 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-credential-socket\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764651 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-socket\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764651 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-certs\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764651 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-data\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.764892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.764830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-credential-socket\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.765265 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.765248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de21c12-35f8-4618-9a61-ad2486335689-istiod-ca-cert\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.766474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.766453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-envoy\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.766957 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.766934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de21c12-35f8-4618-9a61-ad2486335689-istio-podinfo\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.771345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.771323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-istio-token\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.772189 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.772168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-kube-api-access-ttrjg\") pod \"e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") " pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:22.851003 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:22.850918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:23.125020 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.124991    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"]
Sep 10 14:50:23.126784 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:50:23.126751    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de21c12_35f8_4618_9a61_ad2486335689.slice/crio-2dba73d87c367bd44df523f0004842b2c854f3bb6a9d0e39e9a141aa52de96aa WatchSource:0}: Error finding container 2dba73d87c367bd44df523f0004842b2c854f3bb6a9d0e39e9a141aa52de96aa: Status 404 returned error can't find the container with id 2dba73d87c367bd44df523f0004842b2c854f3bb6a9d0e39e9a141aa52de96aa
Sep 10 14:50:23.129651 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.129612    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:50:23.129743 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.129686    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:50:23.129743 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.129721    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:50:23.644966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.644926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" event={"ID":"3de21c12-35f8-4618-9a61-ad2486335689","Type":"ContainerStarted","Data":"cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1"}
Sep 10 14:50:23.645375 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.644986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" event={"ID":"3de21c12-35f8-4618-9a61-ad2486335689","Type":"ContainerStarted","Data":"2dba73d87c367bd44df523f0004842b2c854f3bb6a9d0e39e9a141aa52de96aa"}
Sep 10 14:50:23.663131 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.663070    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podStartSLOduration=1.663048223 podStartE2EDuration="1.663048223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:50:23.661640124 +0000 UTC m=+1834.638769477" watchObservedRunningTime="2026-09-10 14:50:23.663048223 +0000 UTC m=+1834.640177580"
Sep 10 14:50:23.851029 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:23.850988    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:24.856596 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:24.856566    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:25.656786 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:25.656749    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:25.657991 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:25.657967    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:25.685036 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:25.685005    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"]
Sep 10 14:50:25.685253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:25.685214    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl" podUID="c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" containerName="payload-processing" containerID="cri-o://66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f" gracePeriod=30
Sep 10 14:50:25.952645 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:25.952616    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:50:25.986004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:25.985957    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"]
Sep 10 14:50:25.991252 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:25.991221    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-bc9af3-br2d4"]
Sep 10 14:50:26.008215 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.008177    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-plugins-config-volume\") pod \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") "
Sep 10 14:50:26.008354 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.008270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvz8n\" (UniqueName: \"kubernetes.io/projected/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-kube-api-access-wvz8n\") pod \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\" (UID: \"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326\") "
Sep 10 14:50:26.008683 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.008644    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" (UID: "c57e0cc9-fbfa-4da4-8b0d-fd0c86724326"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:26.010370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.010345    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-kube-api-access-wvz8n" (OuterVolumeSpecName: "kube-api-access-wvz8n") pod "c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" (UID: "c57e0cc9-fbfa-4da4-8b0d-fd0c86724326"). InnerVolumeSpecName "kube-api-access-wvz8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:26.109907 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.109831    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvz8n\" (UniqueName: \"kubernetes.io/projected/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-kube-api-access-wvz8n\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:26.109907 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.109903    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:26.662928 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.662896    2577 generic.go:356] "Generic (PLEG): container finished" podID="c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" containerID="66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f" exitCode=0
Sep 10 14:50:26.663103 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.662941    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"
Sep 10 14:50:26.663103 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.662956    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl" event={"ID":"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326","Type":"ContainerDied","Data":"66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f"}
Sep 10 14:50:26.663103 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.663007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl" event={"ID":"c57e0cc9-fbfa-4da4-8b0d-fd0c86724326","Type":"ContainerDied","Data":"dff7b89e434d7b79816ada73235406697057c9fb8ca3b5a4eeceb5f0ff01899e"}
Sep 10 14:50:26.663103 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.663031    2577 scope.go:117] "RemoveContainer" containerID="66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f"
Sep 10 14:50:26.673276 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.673258    2577 scope.go:117] "RemoveContainer" containerID="66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f"
Sep 10 14:50:26.673561 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:26.673543    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f\": container with ID starting with 66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f not found: ID does not exist" containerID="66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f"
Sep 10 14:50:26.673628 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.673567    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f"} err="failed to get container status \"66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f\": rpc error: code = NotFound desc = could not find container \"66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f\": container with ID starting with 66f737a8867ba2bb211baa3fd148a1ddb4acdbe25b66d15115322788c2a73e3f not found: ID does not exist"
Sep 10 14:50:26.699885 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.699836    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"]
Sep 10 14:50:26.704302 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:26.704273    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl"]
Sep 10 14:50:27.423701 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.423668    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"]
Sep 10 14:50:27.424138 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.424123    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" containerName="payload-processing"
Sep 10 14:50:27.424138 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.424140    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" containerName="payload-processing"
Sep 10 14:50:27.424222 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.424209    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" containerName="payload-processing"
Sep 10 14:50:27.428538 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.428520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:27.430542 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.430517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-cc50fd\""
Sep 10 14:50:27.430542 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.430532    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-cc50fd-dockercfg-rgnv4\""
Sep 10 14:50:27.435572 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.435549    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"]
Sep 10 14:50:27.516156 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.516119    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63f78edf-bd86-4da3-9715-0d40ccbb9534" path="/var/lib/kubelet/pods/63f78edf-bd86-4da3-9715-0d40ccbb9534/volumes"
Sep 10 14:50:27.516659 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.516621    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57e0cc9-fbfa-4da4-8b0d-fd0c86724326" path="/var/lib/kubelet/pods/c57e0cc9-fbfa-4da4-8b0d-fd0c86724326/volumes"
Sep 10 14:50:27.527314 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.524888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw5bg\" (UniqueName: \"kubernetes.io/projected/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-kube-api-access-lw5bg\") pod \"payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:27.527314 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.525037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:27.626257 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.626216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:27.626443 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.626297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw5bg\" (UniqueName: \"kubernetes.io/projected/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-kube-api-access-lw5bg\") pod \"payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:27.627015 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.626995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:27.634238 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.634212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw5bg\" (UniqueName: \"kubernetes.io/projected/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-kube-api-access-lw5bg\") pod \"payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:27.743454 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:27.743362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:28.017374 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:28.015587    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"]
Sep 10 14:50:28.021067 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:50:28.021038    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode694d1cb_59f7_4ec5_bc95_6c2b20d70420.slice/crio-a680192ad18f5ddf69adba071f9a47e29a60c41ec80999d24126bd0cfb615170 WatchSource:0}: Error finding container a680192ad18f5ddf69adba071f9a47e29a60c41ec80999d24126bd0cfb615170: Status 404 returned error can't find the container with id a680192ad18f5ddf69adba071f9a47e29a60c41ec80999d24126bd0cfb615170
Sep 10 14:50:28.676918 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:28.676875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9" event={"ID":"e694d1cb-59f7-4ec5-bc95-6c2b20d70420","Type":"ContainerStarted","Data":"486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746"}
Sep 10 14:50:28.677365 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:28.676939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9" event={"ID":"e694d1cb-59f7-4ec5-bc95-6c2b20d70420","Type":"ContainerStarted","Data":"a680192ad18f5ddf69adba071f9a47e29a60c41ec80999d24126bd0cfb615170"}
Sep 10 14:50:28.677365 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:28.676972    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:28.693955 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:28.693903    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9" podStartSLOduration=1.6938856580000001 podStartE2EDuration="1.693885658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:50:28.691739847 +0000 UTC m=+1839.668869234" watchObservedRunningTime="2026-09-10 14:50:28.693885658 +0000 UTC m=+1839.671015013"
Sep 10 14:50:32.223975 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.223942    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"]
Sep 10 14:50:32.224372 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.224145    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" containerID="cri-o://ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2" gracePeriod=30
Sep 10 14:50:32.567797 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.567711    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"]
Sep 10 14:50:32.571470 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.571454    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"
Sep 10 14:50:32.573467 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.573443    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:50:32.573580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.573465    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:50:32.577619 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.577594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"]
Sep 10 14:50:32.680698 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.680665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65659f8-ff15-47d1-8a8b-a47c212a047d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh\" (UID: \"b65659f8-ff15-47d1-8a8b-a47c212a047d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"
Sep 10 14:50:32.781795 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.781762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65659f8-ff15-47d1-8a8b-a47c212a047d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh\" (UID: \"b65659f8-ff15-47d1-8a8b-a47c212a047d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"
Sep 10 14:50:32.782369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.782350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65659f8-ff15-47d1-8a8b-a47c212a047d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh\" (UID: \"b65659f8-ff15-47d1-8a8b-a47c212a047d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"
Sep 10 14:50:32.883054 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:32.883021    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"
Sep 10 14:50:33.158076 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:33.158048    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"]
Sep 10 14:50:33.160969 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:50:33.160935    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65659f8_ff15_47d1_8a8b_a47c212a047d.slice/crio-c690fac5f303bc14f4361e1c4c916cb07116295e81c452d8b48e08361e288d21 WatchSource:0}: Error finding container c690fac5f303bc14f4361e1c4c916cb07116295e81c452d8b48e08361e288d21: Status 404 returned error can't find the container with id c690fac5f303bc14f4361e1c4c916cb07116295e81c452d8b48e08361e288d21
Sep 10 14:50:33.706152 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:33.706115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh" event={"ID":"b65659f8-ff15-47d1-8a8b-a47c212a047d","Type":"ContainerStarted","Data":"a4c63022a6541d3fddad286f6f2211a933230f05b428dc7cf0ffffa0780c334e"}
Sep 10 14:50:33.706542 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:33.706174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh" event={"ID":"b65659f8-ff15-47d1-8a8b-a47c212a047d","Type":"ContainerStarted","Data":"c690fac5f303bc14f4361e1c4c916cb07116295e81c452d8b48e08361e288d21"}
Sep 10 14:50:33.719568 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:33.719521    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh" podStartSLOduration=1.7195062 podStartE2EDuration="1.7195062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:50:33.718179437 +0000 UTC m=+1844.695308792" watchObservedRunningTime="2026-09-10 14:50:33.7195062 +0000 UTC m=+1844.696635618"
Sep 10 14:50:34.713430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:34.713397    2577 generic.go:356] "Generic (PLEG): container finished" podID="b65659f8-ff15-47d1-8a8b-a47c212a047d" containerID="a4c63022a6541d3fddad286f6f2211a933230f05b428dc7cf0ffffa0780c334e" exitCode=0
Sep 10 14:50:34.713822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:34.713447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh" event={"ID":"b65659f8-ff15-47d1-8a8b-a47c212a047d","Type":"ContainerDied","Data":"a4c63022a6541d3fddad286f6f2211a933230f05b428dc7cf0ffffa0780c334e"}
Sep 10 14:50:35.858525 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:35.858496    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"
Sep 10 14:50:36.016867 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.016746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65659f8-ff15-47d1-8a8b-a47c212a047d-maas-api-service-ca\") pod \"b65659f8-ff15-47d1-8a8b-a47c212a047d\" (UID: \"b65659f8-ff15-47d1-8a8b-a47c212a047d\") "
Sep 10 14:50:36.017608 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.017582    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65659f8-ff15-47d1-8a8b-a47c212a047d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b65659f8-ff15-47d1-8a8b-a47c212a047d" (UID: "b65659f8-ff15-47d1-8a8b-a47c212a047d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:36.118441 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.118397    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b65659f8-ff15-47d1-8a8b-a47c212a047d-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:36.413608 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.413573    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:50:36.413774 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.413666    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:50:36.732424 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.732346    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"
Sep 10 14:50:36.732580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.732346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh" event={"ID":"b65659f8-ff15-47d1-8a8b-a47c212a047d","Type":"ContainerDied","Data":"c690fac5f303bc14f4361e1c4c916cb07116295e81c452d8b48e08361e288d21"}
Sep 10 14:50:36.732580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:36.732498    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c690fac5f303bc14f4361e1c4c916cb07116295e81c452d8b48e08361e288d21"
Sep 10 14:50:37.518918 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.518895    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:50:37.637258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637225    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70b7326-374b-4a7d-bc94-35484c5063bd-istiod-ca-cert\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637266    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-podinfo\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637335    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-envoy\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-certs\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnggf\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-kube-api-access-vnggf\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637421    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-credential-socket\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637446    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-token\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637487 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637475    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-data\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637801 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637522    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-socket\") pod \"a70b7326-374b-4a7d-bc94-35484c5063bd\" (UID: \"a70b7326-374b-4a7d-bc94-35484c5063bd\") "
Sep 10 14:50:37.637801 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637602    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:37.637801 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:37.637801 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637762    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:37.638037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637901    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70b7326-374b-4a7d-bc94-35484c5063bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:37.638037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637929    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:37.638037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.637981    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.638037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.638001    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.638037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.638015    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.638037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.638029    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a70b7326-374b-4a7d-bc94-35484c5063bd-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.639663 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.639632    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:50:37.639793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.639685    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:37.639793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.639722    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-kube-api-access-vnggf" (OuterVolumeSpecName: "kube-api-access-vnggf") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "kube-api-access-vnggf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:37.639793 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.639726    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a70b7326-374b-4a7d-bc94-35484c5063bd" (UID: "a70b7326-374b-4a7d-bc94-35484c5063bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:37.738636 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.738604    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.738636 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.738633    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.738914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.738650    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnggf\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-kube-api-access-vnggf\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.738914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.738664    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a70b7326-374b-4a7d-bc94-35484c5063bd-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.738914 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.738676    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a70b7326-374b-4a7d-bc94-35484c5063bd-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:37.739711 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.739684    2577 generic.go:356] "Generic (PLEG): container finished" podID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerID="ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2" exitCode=0
Sep 10 14:50:37.739813 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.739739    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"
Sep 10 14:50:37.739813 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.739775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" event={"ID":"a70b7326-374b-4a7d-bc94-35484c5063bd","Type":"ContainerDied","Data":"ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2"}
Sep 10 14:50:37.739950 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.739831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5" event={"ID":"a70b7326-374b-4a7d-bc94-35484c5063bd","Type":"ContainerDied","Data":"b4fe5dedd8cb2535d23ecec45c23aaa21682639d7a6a9e20b39963e344d32cbe"}
Sep 10 14:50:37.739950 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.739885    2577 scope.go:117] "RemoveContainer" containerID="ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2"
Sep 10 14:50:37.752783 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.752764    2577 scope.go:117] "RemoveContainer" containerID="7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb"
Sep 10 14:50:37.761330 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.761302    2577 scope.go:117] "RemoveContainer" containerID="ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2"
Sep 10 14:50:37.761950 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:37.761920    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2\": container with ID starting with ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2 not found: ID does not exist" containerID="ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2"
Sep 10 14:50:37.762159 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.761962    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2"} err="failed to get container status \"ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2\": rpc error: code = NotFound desc = could not find container \"ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2\": container with ID starting with ccf378d94c23cfcf59e1cf3f96f2501a1a6e2b1b09b621d6f32d2201df2a1ee2 not found: ID does not exist"
Sep 10 14:50:37.762159 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.761985    2577 scope.go:117] "RemoveContainer" containerID="7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb"
Sep 10 14:50:37.762459 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:37.762435    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb\": container with ID starting with 7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb not found: ID does not exist" containerID="7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb"
Sep 10 14:50:37.762528 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.762470    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb"} err="failed to get container status \"7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb\": rpc error: code = NotFound desc = could not find container \"7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb\": container with ID starting with 7e614984c25fea5e2b40fc2cadd5b074c6b1850be95655175b6e04312ff22feb not found: ID does not exist"
Sep 10 14:50:37.764515 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.764495    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"]
Sep 10 14:50:37.784866 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:37.771191    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5"]
Sep 10 14:50:39.510349 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:39.510311    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" path="/var/lib/kubelet/pods/a70b7326-374b-4a7d-bc94-35484c5063bd/volumes"
Sep 10 14:50:39.686335 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:39.686297    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:50:43.192444 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.192405    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"]
Sep 10 14:50:43.195550 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.195518    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-86a2c6-29817525-67cc6"]
Sep 10 14:50:43.231504 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.231232    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"]
Sep 10 14:50:43.234014 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.233615    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj" podUID="da67b54b-52f7-411c-bb1f-6c57fb8b10e0" containerName="payload-pre-processing" containerID="cri-o://b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214" gracePeriod=30
Sep 10 14:50:43.404953 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.404828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"]
Sep 10 14:50:43.409877 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.409828    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-86a2c6-2dkjh"]
Sep 10 14:50:43.515314 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.515279    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61f477f7-1e06-49c8-84c0-3c61655e76dc" path="/var/lib/kubelet/pods/61f477f7-1e06-49c8-84c0-3c61655e76dc/volumes"
Sep 10 14:50:43.515710 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.515695    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65659f8-ff15-47d1-8a8b-a47c212a047d" path="/var/lib/kubelet/pods/b65659f8-ff15-47d1-8a8b-a47c212a047d/volumes"
Sep 10 14:50:43.517090 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.517071    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:50:43.597024 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.596981    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvvzc\" (UniqueName: \"kubernetes.io/projected/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-kube-api-access-xvvzc\") pod \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") "
Sep 10 14:50:43.597230 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.597067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-plugins-config-volume\") pod \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\" (UID: \"da67b54b-52f7-411c-bb1f-6c57fb8b10e0\") "
Sep 10 14:50:43.597469 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.597441    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da67b54b-52f7-411c-bb1f-6c57fb8b10e0" (UID: "da67b54b-52f7-411c-bb1f-6c57fb8b10e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:43.599200 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.599174    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-kube-api-access-xvvzc" (OuterVolumeSpecName: "kube-api-access-xvvzc") pod "da67b54b-52f7-411c-bb1f-6c57fb8b10e0" (UID: "da67b54b-52f7-411c-bb1f-6c57fb8b10e0"). InnerVolumeSpecName "kube-api-access-xvvzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:43.698499 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.698459    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvvzc\" (UniqueName: \"kubernetes.io/projected/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-kube-api-access-xvvzc\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:43.698499 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.698490    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da67b54b-52f7-411c-bb1f-6c57fb8b10e0-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:43.778089 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.778008    2577 generic.go:356] "Generic (PLEG): container finished" podID="da67b54b-52f7-411c-bb1f-6c57fb8b10e0" containerID="b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214" exitCode=0
Sep 10 14:50:43.778089 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.778049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj" event={"ID":"da67b54b-52f7-411c-bb1f-6c57fb8b10e0","Type":"ContainerDied","Data":"b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214"}
Sep 10 14:50:43.778089 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.778070    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"
Sep 10 14:50:43.778338 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.778111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj" event={"ID":"da67b54b-52f7-411c-bb1f-6c57fb8b10e0","Type":"ContainerDied","Data":"3e21f4862b49bfcbadce112898fa02c6c03e037d308cac8ae3fb2428997492dd"}
Sep 10 14:50:43.778338 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.778136    2577 scope.go:117] "RemoveContainer" containerID="b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214"
Sep 10 14:50:43.787160 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.787132    2577 scope.go:117] "RemoveContainer" containerID="b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214"
Sep 10 14:50:43.787489 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:43.787461    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214\": container with ID starting with b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214 not found: ID does not exist" containerID="b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214"
Sep 10 14:50:43.787568 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.787503    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214"} err="failed to get container status \"b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214\": rpc error: code = NotFound desc = could not find container \"b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214\": container with ID starting with b64dfa74136358d57ca1b7194a94c62b6d7a561979e5689b7d708bfee937a214 not found: ID does not exist"
Sep 10 14:50:43.803456 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.803420    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"]
Sep 10 14:50:43.807632 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:43.807604    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj"]
Sep 10 14:50:45.515990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:45.515916    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da67b54b-52f7-411c-bb1f-6c57fb8b10e0" path="/var/lib/kubelet/pods/da67b54b-52f7-411c-bb1f-6c57fb8b10e0/volumes"
Sep 10 14:50:45.791174 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:45.791142    2577 generic.go:356] "Generic (PLEG): container finished" podID="3de21c12-35f8-4618-9a61-ad2486335689" containerID="cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1" exitCode=0
Sep 10 14:50:45.791389 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:45.791190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" event={"ID":"3de21c12-35f8-4618-9a61-ad2486335689","Type":"ContainerDied","Data":"cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1"}
Sep 10 14:50:45.791698 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:45.791679    2577 scope.go:117] "RemoveContainer" containerID="cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1"
Sep 10 14:50:45.792860 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:45.792814    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:50:45.792946 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:45.792903    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:50:45.792946 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:45.792937    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:50:46.801867 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:46.801814    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" event={"ID":"3de21c12-35f8-4618-9a61-ad2486335689","Type":"ContainerStarted","Data":"7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c"}
Sep 10 14:50:46.851307 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:46.851277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:46.851484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:46.851424    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:50:46.851484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:46.851471    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 14:50:47.851672 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:47.851631    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:50:47.852079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:47.851697    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 14:50:48.852004 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:48.851967    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:50:48.852494 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:48.852031    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 14:50:49.851646 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:49.851610    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:50:49.851801 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:49.851663    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 14:50:49.922718 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:49.922690    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"]
Sep 10 14:50:49.923436 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:49.923403    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy" containerID="cri-o://243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66" gracePeriod=30
Sep 10 14:50:50.851716 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:50.851677    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:50:50.851937 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:50.851737    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 14:50:51.220653 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:51.220613    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:50:51.221070 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:51.220677    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:50:51.852294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:51.852253    2577 patch_prober.go:28] interesting pod/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 14:50:51.852510 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:51.852318    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 14:50:52.856125 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:52.856095    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:52.856517 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:52.856437    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:52.857227 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:52.857208    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:50:55.174744 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.174719    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:50:55.325460 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325369    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-certs\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325460 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325418    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-token\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325460 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325440    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-socket\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325482    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-envoy\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325501    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-credential-socket\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325578    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-data\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d469439-4c1c-4ad5-b156-063f44a3f952-istiod-ca-cert\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325673    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b9tg\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-kube-api-access-7b9tg\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.325724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325671    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:55.325724 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325717    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-podinfo\") pod \"1d469439-4c1c-4ad5-b156-063f44a3f952\" (UID: \"1d469439-4c1c-4ad5-b156-063f44a3f952\") "
Sep 10 14:50:55.326100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325891    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:55.326100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325924    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:55.326100 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.325955    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:55.326251 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.326202    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.326251 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.326218    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.326251 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.326227    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.326251 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.326237    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.326459 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.326341    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d469439-4c1c-4ad5-b156-063f44a3f952-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:50:55.327951 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.327926    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:50:55.327951 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.327938    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:50:55.328102 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.327956    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:55.328102 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.327966    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-kube-api-access-7b9tg" (OuterVolumeSpecName: "kube-api-access-7b9tg") pod "1d469439-4c1c-4ad5-b156-063f44a3f952" (UID: "1d469439-4c1c-4ad5-b156-063f44a3f952"). InnerVolumeSpecName "kube-api-access-7b9tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:50:55.427474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.427437    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.427474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.427468    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d469439-4c1c-4ad5-b156-063f44a3f952-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.427474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.427479    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b9tg\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-kube-api-access-7b9tg\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.427710 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.427489    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.427710 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.427498    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d469439-4c1c-4ad5-b156-063f44a3f952-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:50:55.851196 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.851165    2577 generic.go:356] "Generic (PLEG): container finished" podID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerID="243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66" exitCode=0
Sep 10 14:50:55.851360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.851232    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"
Sep 10 14:50:55.851360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.851248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" event={"ID":"1d469439-4c1c-4ad5-b156-063f44a3f952","Type":"ContainerDied","Data":"243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66"}
Sep 10 14:50:55.851360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.851300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t" event={"ID":"1d469439-4c1c-4ad5-b156-063f44a3f952","Type":"ContainerDied","Data":"9ddfdcb672bdb0b96f7c1c826974425ac4aa9dfd318576602f1ae56eb58e9777"}
Sep 10 14:50:55.851360 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.851322    2577 scope.go:117] "RemoveContainer" containerID="243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66"
Sep 10 14:50:55.860178 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.860158    2577 scope.go:117] "RemoveContainer" containerID="ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5"
Sep 10 14:50:55.869078 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.869056    2577 scope.go:117] "RemoveContainer" containerID="243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66"
Sep 10 14:50:55.869383 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:55.869337    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66\": container with ID starting with 243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66 not found: ID does not exist" containerID="243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66"
Sep 10 14:50:55.869484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.869394    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66"} err="failed to get container status \"243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66\": rpc error: code = NotFound desc = could not find container \"243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66\": container with ID starting with 243c8096224b2138a612fe4352e10ac32222e44e3c2f6c8be880597ba879dd66 not found: ID does not exist"
Sep 10 14:50:55.869484 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.869418    2577 scope.go:117] "RemoveContainer" containerID="ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5"
Sep 10 14:50:55.869747 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:50:55.869727    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5\": container with ID starting with ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5 not found: ID does not exist" containerID="ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5"
Sep 10 14:50:55.869817 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.869756    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5"} err="failed to get container status \"ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5\": rpc error: code = NotFound desc = could not find container \"ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5\": container with ID starting with ef5a16859ee220fb15f0e58fed284a685b4ba2f85cef625bfa42a0aa618196b5 not found: ID does not exist"
Sep 10 14:50:55.871029 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.871006    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"]
Sep 10 14:50:55.874183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:55.874163    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t"]
Sep 10 14:50:56.632663 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.632621    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"]
Sep 10 14:50:56.634272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634231    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65659f8-ff15-47d1-8a8b-a47c212a047d" containerName="revoke-keys"
Sep 10 14:50:56.634272 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634265    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65659f8-ff15-47d1-8a8b-a47c212a047d" containerName="revoke-keys"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634300    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634318    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634333    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634342    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634357    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da67b54b-52f7-411c-bb1f-6c57fb8b10e0" containerName="payload-pre-processing"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634365    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da67b54b-52f7-411c-bb1f-6c57fb8b10e0" containerName="payload-pre-processing"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634405    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634414    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634447    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy"
Sep 10 14:50:56.634480 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634456    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy"
Sep 10 14:50:56.634966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634649    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy"
Sep 10 14:50:56.634966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634661    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70b7326-374b-4a7d-bc94-35484c5063bd" containerName="istio-proxy"
Sep 10 14:50:56.634966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634678    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65659f8-ff15-47d1-8a8b-a47c212a047d" containerName="revoke-keys"
Sep 10 14:50:56.634966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634694    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="da67b54b-52f7-411c-bb1f-6c57fb8b10e0" containerName="payload-pre-processing"
Sep 10 14:50:56.634966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634707    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy"
Sep 10 14:50:56.634966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.634722    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" containerName="istio-proxy"
Sep 10 14:50:56.640965 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.640568    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.643626 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.643605    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-eaf326-dockercfg-wks5g\""
Sep 10 14:50:56.651389 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.651360    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-eaf326\""
Sep 10 14:50:56.658061 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.658041    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"]
Sep 10 14:50:56.709628 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.709599    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"]
Sep 10 14:50:56.713228 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.713210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:56.732719 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.732690    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"]
Sep 10 14:50:56.741861 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.741810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b06294-3e76-43f8-ac8a-34fa72a194d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.742028 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.741989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d59dv\" (UniqueName: \"kubernetes.io/projected/c6b06294-3e76-43f8-ac8a-34fa72a194d1-kube-api-access-d59dv\") pod \"payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.842596 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.842541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b06294-3e76-43f8-ac8a-34fa72a194d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.842802 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.842637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7581ac48-8f15-457c-8144-e28aecb582e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:56.842802 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.842668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7fx\" (UniqueName: \"kubernetes.io/projected/7581ac48-8f15-457c-8144-e28aecb582e0-kube-api-access-xz7fx\") pod \"payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:56.842802 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.842776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d59dv\" (UniqueName: \"kubernetes.io/projected/c6b06294-3e76-43f8-ac8a-34fa72a194d1-kube-api-access-d59dv\") pod \"payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.843362 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.843336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b06294-3e76-43f8-ac8a-34fa72a194d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.864168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.864136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d59dv\" (UniqueName: \"kubernetes.io/projected/c6b06294-3e76-43f8-ac8a-34fa72a194d1-kube-api-access-d59dv\") pod \"payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.943652 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.943556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7581ac48-8f15-457c-8144-e28aecb582e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:56.943652 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.943594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fx\" (UniqueName: \"kubernetes.io/projected/7581ac48-8f15-457c-8144-e28aecb582e0-kube-api-access-xz7fx\") pod \"payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:56.944361 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.944334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7581ac48-8f15-457c-8144-e28aecb582e0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:56.951817 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.951787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:56.952865 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:56.952817    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7fx\" (UniqueName: \"kubernetes.io/projected/7581ac48-8f15-457c-8144-e28aecb582e0-kube-api-access-xz7fx\") pod \"payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:57.023020 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.022991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:57.227651 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.227624    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"]
Sep 10 14:50:57.229605 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:50:57.229577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b06294_3e76_43f8_ac8a_34fa72a194d1.slice/crio-14aec81a011e8acac96aaf1b1c41e497072352380cb9a0b5a695fc238720780f WatchSource:0}: Error finding container 14aec81a011e8acac96aaf1b1c41e497072352380cb9a0b5a695fc238720780f: Status 404 returned error can't find the container with id 14aec81a011e8acac96aaf1b1c41e497072352380cb9a0b5a695fc238720780f
Sep 10 14:50:57.303012 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.302985    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"]
Sep 10 14:50:57.303966 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:50:57.303937    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7581ac48_8f15_457c_8144_e28aecb582e0.slice/crio-ccd63f972ddfcb60de3b214116b05cfc5d7bae1dbb3d42a33720f11fdca50528 WatchSource:0}: Error finding container ccd63f972ddfcb60de3b214116b05cfc5d7bae1dbb3d42a33720f11fdca50528: Status 404 returned error can't find the container with id ccd63f972ddfcb60de3b214116b05cfc5d7bae1dbb3d42a33720f11fdca50528
Sep 10 14:50:57.511957 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.511869    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d469439-4c1c-4ad5-b156-063f44a3f952" path="/var/lib/kubelet/pods/1d469439-4c1c-4ad5-b156-063f44a3f952/volumes"
Sep 10 14:50:57.866118 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.866066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs" event={"ID":"c6b06294-3e76-43f8-ac8a-34fa72a194d1","Type":"ContainerStarted","Data":"a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8"}
Sep 10 14:50:57.866580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.866141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs" event={"ID":"c6b06294-3e76-43f8-ac8a-34fa72a194d1","Type":"ContainerStarted","Data":"14aec81a011e8acac96aaf1b1c41e497072352380cb9a0b5a695fc238720780f"}
Sep 10 14:50:57.866580 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.866247    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:50:57.867836 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.867813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj" event={"ID":"7581ac48-8f15-457c-8144-e28aecb582e0","Type":"ContainerStarted","Data":"d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85"}
Sep 10 14:50:57.867994 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.867869    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj" event={"ID":"7581ac48-8f15-457c-8144-e28aecb582e0","Type":"ContainerStarted","Data":"ccd63f972ddfcb60de3b214116b05cfc5d7bae1dbb3d42a33720f11fdca50528"}
Sep 10 14:50:57.867994 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.867900    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:50:57.886342 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.886278    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs" podStartSLOduration=1.886259532 podStartE2EDuration="1.886259532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:50:57.885140606 +0000 UTC m=+1868.862269987" watchObservedRunningTime="2026-09-10 14:50:57.886259532 +0000 UTC m=+1868.863388886"
Sep 10 14:50:57.904941 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:50:57.904889    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj" podStartSLOduration=1.904866081 podStartE2EDuration="1.904866081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:50:57.903239078 +0000 UTC m=+1868.880368433" watchObservedRunningTime="2026-09-10 14:50:57.904866081 +0000 UTC m=+1868.881995437"
Sep 10 14:51:08.875942 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:08.875911    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:51:08.876444 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:08.875995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:51:24.638070 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:24.637948    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj_7581ac48-8f15-457c-8144-e28aecb582e0/payload-processing/0.log"
Sep 10 14:51:49.781757 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:49.781724    2577 scope.go:117] "RemoveContainer" containerID="db200a1adec477d915f6a029da814be0a0c7059d443dde939cec166fabf62eec"
Sep 10 14:51:55.045143 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.045106    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9_e694d1cb-59f7-4ec5-bc95-6c2b20d70420/payload-processing/0.log"
Sep 10 14:51:55.291291 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.291260    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj_7581ac48-8f15-457c-8144-e28aecb582e0/payload-processing/0.log"
Sep 10 14:51:55.818250 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.818213    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"]
Sep 10 14:51:55.822258 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.822234    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.824623 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.824589    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3876ff-openshift-default-dockercfg-bshzl\""
Sep 10 14:51:55.831903 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.831878    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"]
Sep 10 14:51:55.952615 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-credential-socket\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.952615 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-envoy\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.952835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d75z4\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-kube-api-access-d75z4\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.952835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-istio-token\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.952835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-certs\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.952835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-socket\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.952835 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-data\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.953037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395945df-bbad-4734-a813-78bc4d22429e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:55.953037 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:55.952912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395945df-bbad-4734-a813-78bc4d22429e-istio-podinfo\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054062 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395945df-bbad-4734-a813-78bc4d22429e-istio-podinfo\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-credential-socket\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-envoy\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d75z4\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-kube-api-access-d75z4\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-istio-token\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-certs\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-socket\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-data\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054466 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-credential-socket\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395945df-bbad-4734-a813-78bc4d22429e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-socket\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054822 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-data\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.054979 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.054957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-certs\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.055139 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.055120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395945df-bbad-4734-a813-78bc4d22429e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.056482 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.056463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-envoy\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.056586 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.056557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395945df-bbad-4734-a813-78bc4d22429e-istio-podinfo\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.061827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.061799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-istio-token\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.062540 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.062521    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d75z4\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-kube-api-access-d75z4\") pod \"e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") " pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.135206 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.135169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:56.412979 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.412951    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"]
Sep 10 14:51:56.415945 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:51:56.415916    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395945df_bbad_4734_a813_78bc4d22429e.slice/crio-28bd4f559bdd51daa6c11accb554b2beac7aa5e6b2dda49c1f89e46d77b8f618 WatchSource:0}: Error finding container 28bd4f559bdd51daa6c11accb554b2beac7aa5e6b2dda49c1f89e46d77b8f618: Status 404 returned error can't find the container with id 28bd4f559bdd51daa6c11accb554b2beac7aa5e6b2dda49c1f89e46d77b8f618
Sep 10 14:51:56.418284 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.418252    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:51:56.418353 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.418344    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:51:56.418396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:56.418374    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:51:57.191794 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:57.191760    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" event={"ID":"395945df-bbad-4734-a813-78bc4d22429e","Type":"ContainerStarted","Data":"ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4"}
Sep 10 14:51:57.192232 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:57.191812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" event={"ID":"395945df-bbad-4734-a813-78bc4d22429e","Type":"ContainerStarted","Data":"28bd4f559bdd51daa6c11accb554b2beac7aa5e6b2dda49c1f89e46d77b8f618"}
Sep 10 14:51:57.211561 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:57.211513    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podStartSLOduration=2.211496488 podStartE2EDuration="2.211496488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:51:57.209838326 +0000 UTC m=+1928.186967693" watchObservedRunningTime="2026-09-10 14:51:57.211496488 +0000 UTC m=+1928.188625843"
Sep 10 14:51:58.136057 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:58.136014    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:58.141370 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:58.141346    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:58.197350 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:58.197322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:51:58.198282 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:51:58.198262    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:52:17.308080 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:17.308043    2577 generic.go:356] "Generic (PLEG): container finished" podID="395945df-bbad-4734-a813-78bc4d22429e" containerID="ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4" exitCode=0
Sep 10 14:52:17.308505 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:17.308118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" event={"ID":"395945df-bbad-4734-a813-78bc4d22429e","Type":"ContainerDied","Data":"ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4"}
Sep 10 14:52:17.308549 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:17.308537    2577 scope.go:117] "RemoveContainer" containerID="ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4"
Sep 10 14:52:17.309828 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:17.309795    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:52:17.309921 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:17.309903    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:52:17.309971 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:17.309956    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 14:52:18.315550 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:18.315511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" event={"ID":"395945df-bbad-4734-a813-78bc4d22429e","Type":"ContainerStarted","Data":"a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10"}
Sep 10 14:52:19.136064 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:19.136026    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:52:19.136317 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:19.136292    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 14:52:19.136406 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:19.136350    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 14:52:20.136072 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:20.136036    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 14:52:20.136512 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:20.136093    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 14:52:21.135941 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:21.135904    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 14:52:21.136221 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:21.135963    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 14:52:22.136058 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:22.136014    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 14:52:22.136270 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:22.136103    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 14:52:23.136508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:23.136468    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 10 14:52:23.136937 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:23.136538    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 10 14:52:24.140021 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.139988    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:52:24.140437 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.140255    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:52:24.141117 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.141098    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:52:24.766393 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.766361    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"]
Sep 10 14:52:24.769642 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.769624    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"
Sep 10 14:52:24.771540 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.771517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:52:24.771651 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.771553    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:52:24.775981 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.775958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"]
Sep 10 14:52:24.861660 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.861625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdb9dba-9a46-46f4-985d-5f83db9b43ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp\" (UID: \"6cdb9dba-9a46-46f4-985d-5f83db9b43ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"
Sep 10 14:52:24.962529 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.962494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdb9dba-9a46-46f4-985d-5f83db9b43ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp\" (UID: \"6cdb9dba-9a46-46f4-985d-5f83db9b43ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"
Sep 10 14:52:24.963122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:24.963104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdb9dba-9a46-46f4-985d-5f83db9b43ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp\" (UID: \"6cdb9dba-9a46-46f4-985d-5f83db9b43ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"
Sep 10 14:52:25.081947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:25.081863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"
Sep 10 14:52:25.350840 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:25.350814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"]
Sep 10 14:52:25.353642 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:52:25.353598    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdb9dba_9a46_46f4_985d_5f83db9b43ee.slice/crio-dfe19ee89319f6580c61bd2ad80dc5094e06db51b8077b1dd8a4f42ed24469fe WatchSource:0}: Error finding container dfe19ee89319f6580c61bd2ad80dc5094e06db51b8077b1dd8a4f42ed24469fe: Status 404 returned error can't find the container with id dfe19ee89319f6580c61bd2ad80dc5094e06db51b8077b1dd8a4f42ed24469fe
Sep 10 14:52:26.360902 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:26.360770    2577 generic.go:356] "Generic (PLEG): container finished" podID="6cdb9dba-9a46-46f4-985d-5f83db9b43ee" containerID="e1552cc4974b292c54f2e8be7ba79db103fe93aaac5735e937ed75356777f1a8" exitCode=0
Sep 10 14:52:26.360902 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:26.360815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp" event={"ID":"6cdb9dba-9a46-46f4-985d-5f83db9b43ee","Type":"ContainerDied","Data":"e1552cc4974b292c54f2e8be7ba79db103fe93aaac5735e937ed75356777f1a8"}
Sep 10 14:52:26.360902 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:26.360895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp" event={"ID":"6cdb9dba-9a46-46f4-985d-5f83db9b43ee","Type":"ContainerStarted","Data":"dfe19ee89319f6580c61bd2ad80dc5094e06db51b8077b1dd8a4f42ed24469fe"}
Sep 10 14:52:27.498056 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:27.498028    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"
Sep 10 14:52:27.591268 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:27.591233    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdb9dba-9a46-46f4-985d-5f83db9b43ee-maas-api-service-ca\") pod \"6cdb9dba-9a46-46f4-985d-5f83db9b43ee\" (UID: \"6cdb9dba-9a46-46f4-985d-5f83db9b43ee\") "
Sep 10 14:52:27.591610 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:27.591585    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cdb9dba-9a46-46f4-985d-5f83db9b43ee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6cdb9dba-9a46-46f4-985d-5f83db9b43ee" (UID: "6cdb9dba-9a46-46f4-985d-5f83db9b43ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:27.692625 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:27.692531    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cdb9dba-9a46-46f4-985d-5f83db9b43ee-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:28.372040 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:28.372012    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"
Sep 10 14:52:28.372213 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:28.372052    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp" event={"ID":"6cdb9dba-9a46-46f4-985d-5f83db9b43ee","Type":"ContainerDied","Data":"dfe19ee89319f6580c61bd2ad80dc5094e06db51b8077b1dd8a4f42ed24469fe"}
Sep 10 14:52:28.372213 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:28.372098    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfe19ee89319f6580c61bd2ad80dc5094e06db51b8077b1dd8a4f42ed24469fe"
Sep 10 14:52:31.045667 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:31.045628    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"]
Sep 10 14:52:31.048226 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:31.048192    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3876ff-ff4wp"]
Sep 10 14:52:31.510726 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:31.510687    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cdb9dba-9a46-46f4-985d-5f83db9b43ee" path="/var/lib/kubelet/pods/6cdb9dba-9a46-46f4-985d-5f83db9b43ee/volumes"
Sep 10 14:52:37.493966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:37.493930    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"]
Sep 10 14:52:37.494446 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:37.494185    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy" containerID="cri-o://a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10" gracePeriod=30
Sep 10 14:52:39.142347 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:39.142311    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:52:39.142742 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:39.142377    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:52:40.988477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.988443    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"]
Sep 10 14:52:40.988920 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.988907    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cdb9dba-9a46-46f4-985d-5f83db9b43ee" containerName="revoke-keys"
Sep 10 14:52:40.988974 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.988923    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cdb9dba-9a46-46f4-985d-5f83db9b43ee" containerName="revoke-keys"
Sep 10 14:52:40.989007 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.988978    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cdb9dba-9a46-46f4-985d-5f83db9b43ee" containerName="revoke-keys"
Sep 10 14:52:40.992153 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.992137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"
Sep 10 14:52:40.994207 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.994187    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:52:40.994322 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.994210    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:52:40.998292 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:40.998266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"]
Sep 10 14:52:41.132744 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:41.132705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9110616-849f-43b8-a956-ec0239c8fa21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428\" (UID: \"e9110616-849f-43b8-a956-ec0239c8fa21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"
Sep 10 14:52:41.234388 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:41.234351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9110616-849f-43b8-a956-ec0239c8fa21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428\" (UID: \"e9110616-849f-43b8-a956-ec0239c8fa21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"
Sep 10 14:52:41.235015 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:41.234995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9110616-849f-43b8-a956-ec0239c8fa21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428\" (UID: \"e9110616-849f-43b8-a956-ec0239c8fa21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"
Sep 10 14:52:41.304477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:41.304395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"
Sep 10 14:52:41.572837 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:41.572813    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"]
Sep 10 14:52:41.574647 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:52:41.574617    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9110616_849f_43b8_a956_ec0239c8fa21.slice/crio-336e0e07e9d534f9989c97ffbf9e67b202dc8cdeeddbaa38aa8d1cc000cfb488 WatchSource:0}: Error finding container 336e0e07e9d534f9989c97ffbf9e67b202dc8cdeeddbaa38aa8d1cc000cfb488: Status 404 returned error can't find the container with id 336e0e07e9d534f9989c97ffbf9e67b202dc8cdeeddbaa38aa8d1cc000cfb488
Sep 10 14:52:42.450346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.450252    2577 generic.go:356] "Generic (PLEG): container finished" podID="e9110616-849f-43b8-a956-ec0239c8fa21" containerID="7405c2a5565cc00e40ca6dbf40510ba37b8b9f0255bab33670d1984daa586cf5" exitCode=0
Sep 10 14:52:42.450346 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.450328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428" event={"ID":"e9110616-849f-43b8-a956-ec0239c8fa21","Type":"ContainerDied","Data":"7405c2a5565cc00e40ca6dbf40510ba37b8b9f0255bab33670d1984daa586cf5"}
Sep 10 14:52:42.450794 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.450365    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428" event={"ID":"e9110616-849f-43b8-a956-ec0239c8fa21","Type":"ContainerStarted","Data":"336e0e07e9d534f9989c97ffbf9e67b202dc8cdeeddbaa38aa8d1cc000cfb488"}
Sep 10 14:52:42.743535 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.743508    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:52:42.850947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.850913    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-envoy\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.850947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.850960    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395945df-bbad-4734-a813-78bc4d22429e-istiod-ca-cert\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851012    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-istio-token\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395945df-bbad-4734-a813-78bc4d22429e-istio-podinfo\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-data\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851175 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851127    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d75z4\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-kube-api-access-d75z4\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851385 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851189    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-certs\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851441 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851395    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-credential-socket\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851441 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851424    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-socket\") pod \"395945df-bbad-4734-a813-78bc4d22429e\" (UID: \"395945df-bbad-4734-a813-78bc4d22429e\") "
Sep 10 14:52:42.851558 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851429    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/395945df-bbad-4734-a813-78bc4d22429e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:42.851558 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851528    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:42.851678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851600    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-data" (OuterVolumeSpecName: "istio-data") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:42.851734 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851696    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:42.851824 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:42.851992 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851975    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.852060 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.851997    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.852060 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.852013    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.852060 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.852026    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.852060 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.852040    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/395945df-bbad-4734-a813-78bc4d22429e-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.853426 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.853394    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-kube-api-access-d75z4" (OuterVolumeSpecName: "kube-api-access-d75z4") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "kube-api-access-d75z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:52:42.853426 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.853415    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:52:42.853709 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.853690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-istio-token" (OuterVolumeSpecName: "istio-token") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:52:42.853709 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.853701    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/395945df-bbad-4734-a813-78bc4d22429e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "395945df-bbad-4734-a813-78bc4d22429e" (UID: "395945df-bbad-4734-a813-78bc4d22429e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:52:42.953000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.952964    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/395945df-bbad-4734-a813-78bc4d22429e-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.953000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.952991    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.953000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.952999    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/395945df-bbad-4734-a813-78bc4d22429e-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:42.953000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:42.953008    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d75z4\" (UniqueName: \"kubernetes.io/projected/395945df-bbad-4734-a813-78bc4d22429e-kube-api-access-d75z4\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:43.457333 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.457300    2577 generic.go:356] "Generic (PLEG): container finished" podID="395945df-bbad-4734-a813-78bc4d22429e" containerID="a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10" exitCode=0
Sep 10 14:52:43.457736 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.457349    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"
Sep 10 14:52:43.457736 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.457379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" event={"ID":"395945df-bbad-4734-a813-78bc4d22429e","Type":"ContainerDied","Data":"a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10"}
Sep 10 14:52:43.457736 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.457430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9" event={"ID":"395945df-bbad-4734-a813-78bc4d22429e","Type":"ContainerDied","Data":"28bd4f559bdd51daa6c11accb554b2beac7aa5e6b2dda49c1f89e46d77b8f618"}
Sep 10 14:52:43.457736 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.457451    2577 scope.go:117] "RemoveContainer" containerID="a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10"
Sep 10 14:52:43.471381 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.471325    2577 scope.go:117] "RemoveContainer" containerID="ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4"
Sep 10 14:52:43.480988 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.480962    2577 scope.go:117] "RemoveContainer" containerID="a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10"
Sep 10 14:52:43.481336 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:52:43.481310    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10\": container with ID starting with a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10 not found: ID does not exist" containerID="a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10"
Sep 10 14:52:43.481442 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.481344    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10"} err="failed to get container status \"a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10\": rpc error: code = NotFound desc = could not find container \"a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10\": container with ID starting with a9f20014917d5fe434d777f2685d218f3a92157fdc2e50e94a493aa7a8cf1a10 not found: ID does not exist"
Sep 10 14:52:43.481442 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.481362    2577 scope.go:117] "RemoveContainer" containerID="ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4"
Sep 10 14:52:43.481668 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:52:43.481652    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4\": container with ID starting with ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4 not found: ID does not exist" containerID="ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4"
Sep 10 14:52:43.481717 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.481673    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4"} err="failed to get container status \"ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4\": rpc error: code = NotFound desc = could not find container \"ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4\": container with ID starting with ad4bb689c42e6fc09eaf6c3d24a0cceca2f19e3580a6ef5227ac307ba5a523a4 not found: ID does not exist"
Sep 10 14:52:43.481867 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.481837    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"]
Sep 10 14:52:43.485501 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.485478    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9"]
Sep 10 14:52:43.511096 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.511070    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="395945df-bbad-4734-a813-78bc4d22429e" path="/var/lib/kubelet/pods/395945df-bbad-4734-a813-78bc4d22429e/volumes"
Sep 10 14:52:43.602593 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.602569    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"
Sep 10 14:52:43.660602 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.660570    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9110616-849f-43b8-a956-ec0239c8fa21-maas-api-service-ca\") pod \"e9110616-849f-43b8-a956-ec0239c8fa21\" (UID: \"e9110616-849f-43b8-a956-ec0239c8fa21\") "
Sep 10 14:52:43.660937 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.660916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9110616-849f-43b8-a956-ec0239c8fa21-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9110616-849f-43b8-a956-ec0239c8fa21" (UID: "e9110616-849f-43b8-a956-ec0239c8fa21"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:43.761944 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:43.761861    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9110616-849f-43b8-a956-ec0239c8fa21-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:44.464783 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:44.464751    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"
Sep 10 14:52:44.465226 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:44.464786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428" event={"ID":"e9110616-849f-43b8-a956-ec0239c8fa21","Type":"ContainerDied","Data":"336e0e07e9d534f9989c97ffbf9e67b202dc8cdeeddbaa38aa8d1cc000cfb488"}
Sep 10 14:52:44.465226 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:44.464834    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="336e0e07e9d534f9989c97ffbf9e67b202dc8cdeeddbaa38aa8d1cc000cfb488"
Sep 10 14:52:49.806855 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:49.806812    2577 scope.go:117] "RemoveContainer" containerID="2e313061d7e3dd33104db32a655c7efe4f6b5fb1b306acab135c159a11034120"
Sep 10 14:52:56.659925 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.659880    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"]
Sep 10 14:52:56.660504 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.660137    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9" podUID="e694d1cb-59f7-4ec5-bc95-6c2b20d70420" containerName="payload-processing" containerID="cri-o://486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746" gracePeriod=30
Sep 10 14:52:56.832677 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.832641    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"]
Sep 10 14:52:56.835179 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.835151    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc50fd-hl428"]
Sep 10 14:52:56.924540 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.924474    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:52:56.999295 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.999265    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw5bg\" (UniqueName: \"kubernetes.io/projected/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-kube-api-access-lw5bg\") pod \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") "
Sep 10 14:52:56.999517 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.999361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-plugins-config-volume\") pod \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\" (UID: \"e694d1cb-59f7-4ec5-bc95-6c2b20d70420\") "
Sep 10 14:52:56.999750 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:56.999696    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e694d1cb-59f7-4ec5-bc95-6c2b20d70420" (UID: "e694d1cb-59f7-4ec5-bc95-6c2b20d70420"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:52:57.001823 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.001788    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-kube-api-access-lw5bg" (OuterVolumeSpecName: "kube-api-access-lw5bg") pod "e694d1cb-59f7-4ec5-bc95-6c2b20d70420" (UID: "e694d1cb-59f7-4ec5-bc95-6c2b20d70420"). InnerVolumeSpecName "kube-api-access-lw5bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:52:57.100477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.100428    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:57.100477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.100467    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw5bg\" (UniqueName: \"kubernetes.io/projected/e694d1cb-59f7-4ec5-bc95-6c2b20d70420-kube-api-access-lw5bg\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:52:57.511473 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.511439    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9110616-849f-43b8-a956-ec0239c8fa21" path="/var/lib/kubelet/pods/e9110616-849f-43b8-a956-ec0239c8fa21/volumes"
Sep 10 14:52:57.537081 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.537053    2577 generic.go:356] "Generic (PLEG): container finished" podID="e694d1cb-59f7-4ec5-bc95-6c2b20d70420" containerID="486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746" exitCode=0
Sep 10 14:52:57.537224 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.537106    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"
Sep 10 14:52:57.537224 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.537133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9" event={"ID":"e694d1cb-59f7-4ec5-bc95-6c2b20d70420","Type":"ContainerDied","Data":"486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746"}
Sep 10 14:52:57.537224 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.537183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9" event={"ID":"e694d1cb-59f7-4ec5-bc95-6c2b20d70420","Type":"ContainerDied","Data":"a680192ad18f5ddf69adba071f9a47e29a60c41ec80999d24126bd0cfb615170"}
Sep 10 14:52:57.537224 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.537205    2577 scope.go:117] "RemoveContainer" containerID="486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746"
Sep 10 14:52:57.546253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.546232    2577 scope.go:117] "RemoveContainer" containerID="486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746"
Sep 10 14:52:57.546564 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:52:57.546541    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746\": container with ID starting with 486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746 not found: ID does not exist" containerID="486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746"
Sep 10 14:52:57.546678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.546572    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746"} err="failed to get container status \"486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746\": rpc error: code = NotFound desc = could not find container \"486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746\": container with ID starting with 486cab3026264e6ed79edaacb2f719cdcb921b6c3076f207785ad38dd2452746 not found: ID does not exist"
Sep 10 14:52:57.552077 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.552044    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"]
Sep 10 14:52:57.558007 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:57.557985    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9"]
Sep 10 14:52:59.511331 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:52:59.511300    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e694d1cb-59f7-4ec5-bc95-6c2b20d70420" path="/var/lib/kubelet/pods/e694d1cb-59f7-4ec5-bc95-6c2b20d70420/volumes"
Sep 10 14:53:59.157562 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.157526    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"]
Sep 10 14:53:59.158102 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.157903    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy" containerID="cri-o://7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c" gracePeriod=30
Sep 10 14:53:59.516355 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516278    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"]
Sep 10 14:53:59.516662 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516650    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e694d1cb-59f7-4ec5-bc95-6c2b20d70420" containerName="payload-processing"
Sep 10 14:53:59.516705 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516663    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e694d1cb-59f7-4ec5-bc95-6c2b20d70420" containerName="payload-processing"
Sep 10 14:53:59.516705 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516677    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy"
Sep 10 14:53:59.516705 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516684    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy"
Sep 10 14:53:59.516705 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516693    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9110616-849f-43b8-a956-ec0239c8fa21" containerName="revoke-keys"
Sep 10 14:53:59.516705 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516700    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9110616-849f-43b8-a956-ec0239c8fa21" containerName="revoke-keys"
Sep 10 14:53:59.516879 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516767    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e694d1cb-59f7-4ec5-bc95-6c2b20d70420" containerName="payload-processing"
Sep 10 14:53:59.516879 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516776    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9110616-849f-43b8-a956-ec0239c8fa21" containerName="revoke-keys"
Sep 10 14:53:59.516879 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.516782    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy"
Sep 10 14:53:59.519853 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.519830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"
Sep 10 14:53:59.521700 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.521680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:53:59.521827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.521682    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:53:59.526789 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.526761    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"]
Sep 10 14:53:59.615704 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.615667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdb4f3e-2551-46fc-a7fb-68349f272a60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf\" (UID: \"2fdb4f3e-2551-46fc-a7fb-68349f272a60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"
Sep 10 14:53:59.717333 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.717295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdb4f3e-2551-46fc-a7fb-68349f272a60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf\" (UID: \"2fdb4f3e-2551-46fc-a7fb-68349f272a60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"
Sep 10 14:53:59.717953 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.717931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdb4f3e-2551-46fc-a7fb-68349f272a60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf\" (UID: \"2fdb4f3e-2551-46fc-a7fb-68349f272a60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"
Sep 10 14:53:59.831475 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:53:59.831394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"
Sep 10 14:54:00.100334 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:00.100307    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"]
Sep 10 14:54:00.103015 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:54:00.102985    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdb4f3e_2551_46fc_a7fb_68349f272a60.slice/crio-45434caa9a01b88928bc47305b6c58fe63d77a3a875e062237932380c6577515 WatchSource:0}: Error finding container 45434caa9a01b88928bc47305b6c58fe63d77a3a875e062237932380c6577515: Status 404 returned error can't find the container with id 45434caa9a01b88928bc47305b6c58fe63d77a3a875e062237932380c6577515
Sep 10 14:54:00.881702 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:00.881669    2577 generic.go:356] "Generic (PLEG): container finished" podID="2fdb4f3e-2551-46fc-a7fb-68349f272a60" containerID="ece0386326c1db769a956d15069e877b297204225059833b07715df6a88b0b34" exitCode=0
Sep 10 14:54:00.882118 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:00.881755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf" event={"ID":"2fdb4f3e-2551-46fc-a7fb-68349f272a60","Type":"ContainerDied","Data":"ece0386326c1db769a956d15069e877b297204225059833b07715df6a88b0b34"}
Sep 10 14:54:00.882118 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:00.881806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf" event={"ID":"2fdb4f3e-2551-46fc-a7fb-68349f272a60","Type":"ContainerStarted","Data":"45434caa9a01b88928bc47305b6c58fe63d77a3a875e062237932380c6577515"}
Sep 10 14:54:02.018715 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:02.018689    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"
Sep 10 14:54:02.039132 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:02.039104    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdb4f3e-2551-46fc-a7fb-68349f272a60-maas-api-service-ca\") pod \"2fdb4f3e-2551-46fc-a7fb-68349f272a60\" (UID: \"2fdb4f3e-2551-46fc-a7fb-68349f272a60\") "
Sep 10 14:54:02.039533 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:02.039507    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdb4f3e-2551-46fc-a7fb-68349f272a60-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fdb4f3e-2551-46fc-a7fb-68349f272a60" (UID: "2fdb4f3e-2551-46fc-a7fb-68349f272a60"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:02.140694 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:02.140599    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fdb4f3e-2551-46fc-a7fb-68349f272a60-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:02.893182 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:02.893154    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"
Sep 10 14:54:02.893385 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:02.893195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf" event={"ID":"2fdb4f3e-2551-46fc-a7fb-68349f272a60","Type":"ContainerDied","Data":"45434caa9a01b88928bc47305b6c58fe63d77a3a875e062237932380c6577515"}
Sep 10 14:54:02.893385 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:02.893247    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45434caa9a01b88928bc47305b6c58fe63d77a3a875e062237932380c6577515"
Sep 10 14:54:04.431461 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.431387    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:54:04.464518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464485    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-data\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464696 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464587    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de21c12-35f8-4618-9a61-ad2486335689-istio-podinfo\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464696 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464605    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-credential-socket\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464696 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464645    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-socket\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464696 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464664    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de21c12-35f8-4618-9a61-ad2486335689-istiod-ca-cert\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464696 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-kube-api-access-ttrjg\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464769    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-istio-token\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464767    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-data" (OuterVolumeSpecName: "istio-data") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:54:04.464990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464830    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-certs\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.464990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.464876    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-envoy\") pod \"3de21c12-35f8-4618-9a61-ad2486335689\" (UID: \"3de21c12-35f8-4618-9a61-ad2486335689\") "
Sep 10 14:54:04.465195 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:54:04.465195 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465059    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:54:04.465195 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465168    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3de21c12-35f8-4618-9a61-ad2486335689-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:04.465349 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465259    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:54:04.465349 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465341    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-data\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.465461 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465358    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-credential-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.465461 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465373    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-socket\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.465461 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465387    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de21c12-35f8-4618-9a61-ad2486335689-istiod-ca-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.465461 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.465400    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-workload-certs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.466966 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.466934    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3de21c12-35f8-4618-9a61-ad2486335689-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:54:04.467294 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.467271    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-istio-token" (OuterVolumeSpecName: "istio-token") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:54:04.467429 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.467412    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:54:04.467477 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.467440    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-kube-api-access-ttrjg" (OuterVolumeSpecName: "kube-api-access-ttrjg") pod "3de21c12-35f8-4618-9a61-ad2486335689" (UID: "3de21c12-35f8-4618-9a61-ad2486335689"). InnerVolumeSpecName "kube-api-access-ttrjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:54:04.566654 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.566614    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-istio-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.566654 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.566651    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de21c12-35f8-4618-9a61-ad2486335689-istio-envoy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.566654 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.566665    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de21c12-35f8-4618-9a61-ad2486335689-istio-podinfo\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.566967 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.566679    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttrjg\" (UniqueName: \"kubernetes.io/projected/3de21c12-35f8-4618-9a61-ad2486335689-kube-api-access-ttrjg\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:04.905430 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.905395    2577 generic.go:356] "Generic (PLEG): container finished" podID="3de21c12-35f8-4618-9a61-ad2486335689" containerID="7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c" exitCode=0
Sep 10 14:54:04.905601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.905449    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"
Sep 10 14:54:04.905601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.905449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" event={"ID":"3de21c12-35f8-4618-9a61-ad2486335689","Type":"ContainerDied","Data":"7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c"}
Sep 10 14:54:04.905601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.905505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k" event={"ID":"3de21c12-35f8-4618-9a61-ad2486335689","Type":"ContainerDied","Data":"2dba73d87c367bd44df523f0004842b2c854f3bb6a9d0e39e9a141aa52de96aa"}
Sep 10 14:54:04.905601 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.905535    2577 scope.go:117] "RemoveContainer" containerID="7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c"
Sep 10 14:54:04.915417 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.915393    2577 scope.go:117] "RemoveContainer" containerID="cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1"
Sep 10 14:54:04.924353 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.924320    2577 scope.go:117] "RemoveContainer" containerID="7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c"
Sep 10 14:54:04.924699 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:54:04.924673    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c\": container with ID starting with 7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c not found: ID does not exist" containerID="7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c"
Sep 10 14:54:04.924767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.924708    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c"} err="failed to get container status \"7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c\": rpc error: code = NotFound desc = could not find container \"7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c\": container with ID starting with 7de37c33e2eca237ef383f7cb71270fff4d0d49af861e7539f0a68396a60456c not found: ID does not exist"
Sep 10 14:54:04.924767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.924729    2577 scope.go:117] "RemoveContainer" containerID="cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1"
Sep 10 14:54:04.925059 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:54:04.925010    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1\": container with ID starting with cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1 not found: ID does not exist" containerID="cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1"
Sep 10 14:54:04.925125 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.925063    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1"} err="failed to get container status \"cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1\": rpc error: code = NotFound desc = could not find container \"cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1\": container with ID starting with cacd9c886c405ee962b511c38eab779219ad980320eb24cba9afabfeb027bdb1 not found: ID does not exist"
Sep 10 14:54:04.926415 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.926398    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"]
Sep 10 14:54:04.929872 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:04.929822    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k"]
Sep 10 14:54:05.510604 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:05.510572    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3de21c12-35f8-4618-9a61-ad2486335689" path="/var/lib/kubelet/pods/3de21c12-35f8-4618-9a61-ad2486335689/volumes"
Sep 10 14:54:10.137376 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.137336    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"]
Sep 10 14:54:10.138236 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.138202    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj" podUID="7581ac48-8f15-457c-8144-e28aecb582e0" containerName="payload-processing" containerID="cri-o://d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85" gracePeriod=30
Sep 10 14:54:10.142570 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.142545    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"]
Sep 10 14:54:10.142947 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.142920    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs" podUID="c6b06294-3e76-43f8-ac8a-34fa72a194d1" containerName="payload-pre-processing" containerID="cri-o://a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8" gracePeriod=30
Sep 10 14:54:10.296514 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.296479    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"]
Sep 10 14:54:10.299397 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.299367    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-eaf326-5cddf"]
Sep 10 14:54:10.434743 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.434720    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:54:10.441645 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.441623    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:54:10.518692 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.518657    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d59dv\" (UniqueName: \"kubernetes.io/projected/c6b06294-3e76-43f8-ac8a-34fa72a194d1-kube-api-access-d59dv\") pod \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") "
Sep 10 14:54:10.518907 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.518742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b06294-3e76-43f8-ac8a-34fa72a194d1-plugins-config-volume\") pod \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\" (UID: \"c6b06294-3e76-43f8-ac8a-34fa72a194d1\") "
Sep 10 14:54:10.518907 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.518796    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz7fx\" (UniqueName: \"kubernetes.io/projected/7581ac48-8f15-457c-8144-e28aecb582e0-kube-api-access-xz7fx\") pod \"7581ac48-8f15-457c-8144-e28aecb582e0\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") "
Sep 10 14:54:10.518907 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.518867    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7581ac48-8f15-457c-8144-e28aecb582e0-plugins-config-volume\") pod \"7581ac48-8f15-457c-8144-e28aecb582e0\" (UID: \"7581ac48-8f15-457c-8144-e28aecb582e0\") "
Sep 10 14:54:10.519129 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.519105    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6b06294-3e76-43f8-ac8a-34fa72a194d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6b06294-3e76-43f8-ac8a-34fa72a194d1" (UID: "c6b06294-3e76-43f8-ac8a-34fa72a194d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:10.519297 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.519269    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7581ac48-8f15-457c-8144-e28aecb582e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7581ac48-8f15-457c-8144-e28aecb582e0" (UID: "7581ac48-8f15-457c-8144-e28aecb582e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:10.520903 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.520882    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7581ac48-8f15-457c-8144-e28aecb582e0-kube-api-access-xz7fx" (OuterVolumeSpecName: "kube-api-access-xz7fx") pod "7581ac48-8f15-457c-8144-e28aecb582e0" (UID: "7581ac48-8f15-457c-8144-e28aecb582e0"). InnerVolumeSpecName "kube-api-access-xz7fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:54:10.521065 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.521044    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b06294-3e76-43f8-ac8a-34fa72a194d1-kube-api-access-d59dv" (OuterVolumeSpecName: "kube-api-access-d59dv") pod "c6b06294-3e76-43f8-ac8a-34fa72a194d1" (UID: "c6b06294-3e76-43f8-ac8a-34fa72a194d1"). InnerVolumeSpecName "kube-api-access-d59dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:54:10.620262 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.620227    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz7fx\" (UniqueName: \"kubernetes.io/projected/7581ac48-8f15-457c-8144-e28aecb582e0-kube-api-access-xz7fx\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:10.620262 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.620260    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7581ac48-8f15-457c-8144-e28aecb582e0-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:10.620473 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.620277    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d59dv\" (UniqueName: \"kubernetes.io/projected/c6b06294-3e76-43f8-ac8a-34fa72a194d1-kube-api-access-d59dv\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:10.620473 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.620290    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6b06294-3e76-43f8-ac8a-34fa72a194d1-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:10.938910 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.938878    2577 generic.go:356] "Generic (PLEG): container finished" podID="c6b06294-3e76-43f8-ac8a-34fa72a194d1" containerID="a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8" exitCode=0
Sep 10 14:54:10.939090 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.938985    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"
Sep 10 14:54:10.939090 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.939001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs" event={"ID":"c6b06294-3e76-43f8-ac8a-34fa72a194d1","Type":"ContainerDied","Data":"a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8"}
Sep 10 14:54:10.939090 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.939059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs" event={"ID":"c6b06294-3e76-43f8-ac8a-34fa72a194d1","Type":"ContainerDied","Data":"14aec81a011e8acac96aaf1b1c41e497072352380cb9a0b5a695fc238720780f"}
Sep 10 14:54:10.939090 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.939088    2577 scope.go:117] "RemoveContainer" containerID="a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8"
Sep 10 14:54:10.940415 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.940389    2577 generic.go:356] "Generic (PLEG): container finished" podID="7581ac48-8f15-457c-8144-e28aecb582e0" containerID="d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85" exitCode=0
Sep 10 14:54:10.940530 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.940428    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"
Sep 10 14:54:10.940530 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.940421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj" event={"ID":"7581ac48-8f15-457c-8144-e28aecb582e0","Type":"ContainerDied","Data":"d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85"}
Sep 10 14:54:10.940638 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.940549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj" event={"ID":"7581ac48-8f15-457c-8144-e28aecb582e0","Type":"ContainerDied","Data":"ccd63f972ddfcb60de3b214116b05cfc5d7bae1dbb3d42a33720f11fdca50528"}
Sep 10 14:54:10.948628 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.948609    2577 scope.go:117] "RemoveContainer" containerID="a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8"
Sep 10 14:54:10.949016 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:54:10.948989    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8\": container with ID starting with a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8 not found: ID does not exist" containerID="a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8"
Sep 10 14:54:10.949160 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.949020    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8"} err="failed to get container status \"a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8\": rpc error: code = NotFound desc = could not find container \"a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8\": container with ID starting with a12fc81b1914fd49c59145bf84683d6a16a18af0db97e714123c9ae402fdabf8 not found: ID does not exist"
Sep 10 14:54:10.949160 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.949037    2577 scope.go:117] "RemoveContainer" containerID="d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85"
Sep 10 14:54:10.957339 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.957319    2577 scope.go:117] "RemoveContainer" containerID="d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85"
Sep 10 14:54:10.957616 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:54:10.957595    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85\": container with ID starting with d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85 not found: ID does not exist" containerID="d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85"
Sep 10 14:54:10.957681 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.957621    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85"} err="failed to get container status \"d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85\": rpc error: code = NotFound desc = could not find container \"d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85\": container with ID starting with d029179e0c9c8da3010ba598bca4f503b676776a7d541f97c0b9e490ccbffa85 not found: ID does not exist"
Sep 10 14:54:10.963607 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.963579    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"]
Sep 10 14:54:10.966973 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.966952    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs"]
Sep 10 14:54:10.978958 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.978930    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"]
Sep 10 14:54:10.981319 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:10.981294    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj"]
Sep 10 14:54:11.510292 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:11.510259    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fdb4f3e-2551-46fc-a7fb-68349f272a60" path="/var/lib/kubelet/pods/2fdb4f3e-2551-46fc-a7fb-68349f272a60/volumes"
Sep 10 14:54:11.510668 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:11.510631    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7581ac48-8f15-457c-8144-e28aecb582e0" path="/var/lib/kubelet/pods/7581ac48-8f15-457c-8144-e28aecb582e0/volumes"
Sep 10 14:54:11.510960 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:11.510947    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6b06294-3e76-43f8-ac8a-34fa72a194d1" path="/var/lib/kubelet/pods/c6b06294-3e76-43f8-ac8a-34fa72a194d1/volumes"
Sep 10 14:54:17.012419 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012382    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"]
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012762    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy"
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012773    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy"
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012791    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7581ac48-8f15-457c-8144-e28aecb582e0" containerName="payload-processing"
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012798    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7581ac48-8f15-457c-8144-e28aecb582e0" containerName="payload-processing"
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012805    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy"
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012810    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy"
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012818    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6b06294-3e76-43f8-ac8a-34fa72a194d1" containerName="payload-pre-processing"
Sep 10 14:54:17.012827 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012825    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6b06294-3e76-43f8-ac8a-34fa72a194d1" containerName="payload-pre-processing"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012832    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fdb4f3e-2551-46fc-a7fb-68349f272a60" containerName="revoke-keys"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012838    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fdb4f3e-2551-46fc-a7fb-68349f272a60" containerName="revoke-keys"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012911    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6b06294-3e76-43f8-ac8a-34fa72a194d1" containerName="payload-pre-processing"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012917    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012924    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7581ac48-8f15-457c-8144-e28aecb582e0" containerName="payload-processing"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012932    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="395945df-bbad-4734-a813-78bc4d22429e" containerName="istio-proxy"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012939    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fdb4f3e-2551-46fc-a7fb-68349f272a60" containerName="revoke-keys"
Sep 10 14:54:17.013095 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.012945    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy"
Sep 10 14:54:17.017529 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.017510    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"
Sep 10 14:54:17.019551 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.019531    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:54:17.019668 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.019590    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:54:17.024029 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.024004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"]
Sep 10 14:54:17.082023 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.081987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ad9546-c057-4b0a-912b-55d31f7b9b36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z\" (UID: \"82ad9546-c057-4b0a-912b-55d31f7b9b36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"
Sep 10 14:54:17.183368 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.183328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ad9546-c057-4b0a-912b-55d31f7b9b36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z\" (UID: \"82ad9546-c057-4b0a-912b-55d31f7b9b36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"
Sep 10 14:54:17.183991 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.183974    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ad9546-c057-4b0a-912b-55d31f7b9b36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z\" (UID: \"82ad9546-c057-4b0a-912b-55d31f7b9b36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"
Sep 10 14:54:17.331345 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.331266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"
Sep 10 14:54:17.602253 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.602224    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"]
Sep 10 14:54:17.603994 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:54:17.603962    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ad9546_c057_4b0a_912b_55d31f7b9b36.slice/crio-69ad391074c82511ca7a9ca50dbba105b4bf090dca219c0cb05b71e3d5007fc5 WatchSource:0}: Error finding container 69ad391074c82511ca7a9ca50dbba105b4bf090dca219c0cb05b71e3d5007fc5: Status 404 returned error can't find the container with id 69ad391074c82511ca7a9ca50dbba105b4bf090dca219c0cb05b71e3d5007fc5
Sep 10 14:54:17.981224 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.981191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z" event={"ID":"82ad9546-c057-4b0a-912b-55d31f7b9b36","Type":"ContainerStarted","Data":"08742d3b7bcbab78052ae0b0a750da1e8351d3b81c9bfb45719951e2998e02fc"}
Sep 10 14:54:17.981396 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.981243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z" event={"ID":"82ad9546-c057-4b0a-912b-55d31f7b9b36","Type":"ContainerStarted","Data":"69ad391074c82511ca7a9ca50dbba105b4bf090dca219c0cb05b71e3d5007fc5"}
Sep 10 14:54:17.995772 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:17.995722    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z" podStartSLOduration=1.995705257 podStartE2EDuration="1.995705257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:54:17.993930879 +0000 UTC m=+2068.971060228" watchObservedRunningTime="2026-09-10 14:54:17.995705257 +0000 UTC m=+2068.972834611"
Sep 10 14:54:18.989823 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:18.989786    2577 generic.go:356] "Generic (PLEG): container finished" podID="82ad9546-c057-4b0a-912b-55d31f7b9b36" containerID="08742d3b7bcbab78052ae0b0a750da1e8351d3b81c9bfb45719951e2998e02fc" exitCode=0
Sep 10 14:54:18.990231 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:18.989880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z" event={"ID":"82ad9546-c057-4b0a-912b-55d31f7b9b36","Type":"ContainerDied","Data":"08742d3b7bcbab78052ae0b0a750da1e8351d3b81c9bfb45719951e2998e02fc"}
Sep 10 14:54:20.124990 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:20.124966    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"
Sep 10 14:54:20.213036 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:20.213000    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ad9546-c057-4b0a-912b-55d31f7b9b36-maas-api-service-ca\") pod \"82ad9546-c057-4b0a-912b-55d31f7b9b36\" (UID: \"82ad9546-c057-4b0a-912b-55d31f7b9b36\") "
Sep 10 14:54:20.213389 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:20.213365    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ad9546-c057-4b0a-912b-55d31f7b9b36-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82ad9546-c057-4b0a-912b-55d31f7b9b36" (UID: "82ad9546-c057-4b0a-912b-55d31f7b9b36"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:20.314693 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:20.314608    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82ad9546-c057-4b0a-912b-55d31f7b9b36-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:21.002087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:21.002058    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"
Sep 10 14:54:21.002087 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:21.002064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z" event={"ID":"82ad9546-c057-4b0a-912b-55d31f7b9b36","Type":"ContainerDied","Data":"69ad391074c82511ca7a9ca50dbba105b4bf090dca219c0cb05b71e3d5007fc5"}
Sep 10 14:54:21.002310 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:21.002115    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69ad391074c82511ca7a9ca50dbba105b4bf090dca219c0cb05b71e3d5007fc5"
Sep 10 14:54:27.514518 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:27.514481    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"]
Sep 10 14:54:27.517114 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:27.517089    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-85d86b-29817525-qv9cc"]
Sep 10 14:54:27.708000 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:27.707968    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"]
Sep 10 14:54:27.713115 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:27.713087    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-85d86b-rfz7z"]
Sep 10 14:54:29.511062 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:29.511030    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="630a1bd0-b49a-434a-bf9a-9965e75e8583" path="/var/lib/kubelet/pods/630a1bd0-b49a-434a-bf9a-9965e75e8583/volumes"
Sep 10 14:54:29.511455 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:29.511388    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ad9546-c057-4b0a-912b-55d31f7b9b36" path="/var/lib/kubelet/pods/82ad9546-c057-4b0a-912b-55d31f7b9b36/volumes"
Sep 10 14:54:34.753369 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.753334    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"]
Sep 10 14:54:34.753868 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.753736    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy"
Sep 10 14:54:34.753868 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.753747    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de21c12-35f8-4618-9a61-ad2486335689" containerName="istio-proxy"
Sep 10 14:54:34.753868 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.753764    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ad9546-c057-4b0a-912b-55d31f7b9b36" containerName="revoke-keys"
Sep 10 14:54:34.753868 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.753770    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ad9546-c057-4b0a-912b-55d31f7b9b36" containerName="revoke-keys"
Sep 10 14:54:34.753868 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.753824    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ad9546-c057-4b0a-912b-55d31f7b9b36" containerName="revoke-keys"
Sep 10 14:54:34.757229 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.757211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"
Sep 10 14:54:34.759397 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.759372    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:54:34.759532 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.759451    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 14:54:34.763395 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.763367    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"]
Sep 10 14:54:34.954579 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:34.954545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8be10c2a-20ab-4ab5-983f-14e06c73bac5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7\" (UID: \"8be10c2a-20ab-4ab5-983f-14e06c73bac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"
Sep 10 14:54:35.055904 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:35.055813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8be10c2a-20ab-4ab5-983f-14e06c73bac5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7\" (UID: \"8be10c2a-20ab-4ab5-983f-14e06c73bac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"
Sep 10 14:54:35.056446 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:35.056425    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8be10c2a-20ab-4ab5-983f-14e06c73bac5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7\" (UID: \"8be10c2a-20ab-4ab5-983f-14e06c73bac5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"
Sep 10 14:54:35.068714 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:35.068685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"
Sep 10 14:54:35.339993 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:35.339896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"]
Sep 10 14:54:35.343471 ip-10-0-135-201 kubenswrapper[2577]: W0910 14:54:35.343446    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be10c2a_20ab_4ab5_983f_14e06c73bac5.slice/crio-90c2f84bd700b9bc4a89273d366c9ab8253c455e0283971c1e31277fcd329db4 WatchSource:0}: Error finding container 90c2f84bd700b9bc4a89273d366c9ab8253c455e0283971c1e31277fcd329db4: Status 404 returned error can't find the container with id 90c2f84bd700b9bc4a89273d366c9ab8253c455e0283971c1e31277fcd329db4
Sep 10 14:54:36.088767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:36.088738    2577 generic.go:356] "Generic (PLEG): container finished" podID="8be10c2a-20ab-4ab5-983f-14e06c73bac5" containerID="f27e2d8228f4e026eae95a20002bc62cb5925f3ee4234573bd8c3e733acb35c4" exitCode=0
Sep 10 14:54:36.089113 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:36.088807    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7" event={"ID":"8be10c2a-20ab-4ab5-983f-14e06c73bac5","Type":"ContainerDied","Data":"f27e2d8228f4e026eae95a20002bc62cb5925f3ee4234573bd8c3e733acb35c4"}
Sep 10 14:54:36.089113 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:36.088868    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7" event={"ID":"8be10c2a-20ab-4ab5-983f-14e06c73bac5","Type":"ContainerStarted","Data":"90c2f84bd700b9bc4a89273d366c9ab8253c455e0283971c1e31277fcd329db4"}
Sep 10 14:54:37.228191 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:37.228162    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"
Sep 10 14:54:37.275177 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:37.275146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8be10c2a-20ab-4ab5-983f-14e06c73bac5-maas-api-service-ca\") pod \"8be10c2a-20ab-4ab5-983f-14e06c73bac5\" (UID: \"8be10c2a-20ab-4ab5-983f-14e06c73bac5\") "
Sep 10 14:54:37.275627 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:37.275599    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be10c2a-20ab-4ab5-983f-14e06c73bac5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8be10c2a-20ab-4ab5-983f-14e06c73bac5" (UID: "8be10c2a-20ab-4ab5-983f-14e06c73bac5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:37.376079 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:37.376040    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8be10c2a-20ab-4ab5-983f-14e06c73bac5-maas-api-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:38.099980 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:38.099953    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"
Sep 10 14:54:38.100149 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:38.099949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7" event={"ID":"8be10c2a-20ab-4ab5-983f-14e06c73bac5","Type":"ContainerDied","Data":"90c2f84bd700b9bc4a89273d366c9ab8253c455e0283971c1e31277fcd329db4"}
Sep 10 14:54:38.100149 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:38.100070    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90c2f84bd700b9bc4a89273d366c9ab8253c455e0283971c1e31277fcd329db4"
Sep 10 14:54:45.277688 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.277650    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"]
Sep 10 14:54:45.278122 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.277933    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz" podUID="32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" containerName="payload-processing" containerID="cri-o://b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a" gracePeriod=30
Sep 10 14:54:45.286738 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.286711    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"]
Sep 10 14:54:45.287021 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.286996    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8" podUID="581c470e-5fcb-4cea-93ab-bdbf12925b8c" containerName="payload-pre-processing" containerID="cri-o://64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873" gracePeriod=30
Sep 10 14:54:45.449032 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.448989    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"]
Sep 10 14:54:45.451839 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.451809    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-3477ac-5g4n7"]
Sep 10 14:54:45.516558 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.516527    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8be10c2a-20ab-4ab5-983f-14e06c73bac5" path="/var/lib/kubelet/pods/8be10c2a-20ab-4ab5-983f-14e06c73bac5/volumes"
Sep 10 14:54:45.569168 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.569141    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:54:45.571781 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.571757    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:54:45.656473 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.656436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581c470e-5fcb-4cea-93ab-bdbf12925b8c-plugins-config-volume\") pod \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") "
Sep 10 14:54:45.656678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.656498    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8sb7\" (UniqueName: \"kubernetes.io/projected/581c470e-5fcb-4cea-93ab-bdbf12925b8c-kube-api-access-s8sb7\") pod \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\" (UID: \"581c470e-5fcb-4cea-93ab-bdbf12925b8c\") "
Sep 10 14:54:45.656678 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.656635    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-plugins-config-volume\") pod \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") "
Sep 10 14:54:45.656806 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.656680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqqv4\" (UniqueName: \"kubernetes.io/projected/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-kube-api-access-hqqv4\") pod \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\" (UID: \"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1\") "
Sep 10 14:54:45.656950 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.656828    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581c470e-5fcb-4cea-93ab-bdbf12925b8c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "581c470e-5fcb-4cea-93ab-bdbf12925b8c" (UID: "581c470e-5fcb-4cea-93ab-bdbf12925b8c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:45.657036 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.657013    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" (UID: "32e6e3eb-5dca-4cf1-b650-be2aded3e0f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:45.657104 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.657073    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581c470e-5fcb-4cea-93ab-bdbf12925b8c-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:45.658689 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.658661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581c470e-5fcb-4cea-93ab-bdbf12925b8c-kube-api-access-s8sb7" (OuterVolumeSpecName: "kube-api-access-s8sb7") pod "581c470e-5fcb-4cea-93ab-bdbf12925b8c" (UID: "581c470e-5fcb-4cea-93ab-bdbf12925b8c"). InnerVolumeSpecName "kube-api-access-s8sb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:54:45.658767 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.658706    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-kube-api-access-hqqv4" (OuterVolumeSpecName: "kube-api-access-hqqv4") pod "32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" (UID: "32e6e3eb-5dca-4cf1-b650-be2aded3e0f1"). InnerVolumeSpecName "kube-api-access-hqqv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:54:45.758434 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.758397    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-plugins-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:45.758434 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.758427    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqqv4\" (UniqueName: \"kubernetes.io/projected/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1-kube-api-access-hqqv4\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:45.758434 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:45.758440    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8sb7\" (UniqueName: \"kubernetes.io/projected/581c470e-5fcb-4cea-93ab-bdbf12925b8c-kube-api-access-s8sb7\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\""
Sep 10 14:54:46.143508 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.143473    2577 generic.go:356] "Generic (PLEG): container finished" podID="32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" containerID="b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a" exitCode=0
Sep 10 14:54:46.143719 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.143526    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"
Sep 10 14:54:46.143719 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.143556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz" event={"ID":"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1","Type":"ContainerDied","Data":"b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a"}
Sep 10 14:54:46.143719 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.143607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz" event={"ID":"32e6e3eb-5dca-4cf1-b650-be2aded3e0f1","Type":"ContainerDied","Data":"8b9ee9c97b647dc4b0cd69b4a013c485cdae38f7fef49ba29904c087a8f4faa8"}
Sep 10 14:54:46.143719 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.143623    2577 scope.go:117] "RemoveContainer" containerID="b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a"
Sep 10 14:54:46.145063 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.145027    2577 generic.go:356] "Generic (PLEG): container finished" podID="581c470e-5fcb-4cea-93ab-bdbf12925b8c" containerID="64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873" exitCode=0
Sep 10 14:54:46.145183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.145061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8" event={"ID":"581c470e-5fcb-4cea-93ab-bdbf12925b8c","Type":"ContainerDied","Data":"64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873"}
Sep 10 14:54:46.145183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.145095    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"
Sep 10 14:54:46.145183 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.145126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8" event={"ID":"581c470e-5fcb-4cea-93ab-bdbf12925b8c","Type":"ContainerDied","Data":"558bcbd50fc384bc2909d5847afd2278728ddefdaa1af0f2d38d113a5d961be2"}
Sep 10 14:54:46.152934 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.152909    2577 scope.go:117] "RemoveContainer" containerID="b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a"
Sep 10 14:54:46.153302 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:54:46.153281    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a\": container with ID starting with b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a not found: ID does not exist" containerID="b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a"
Sep 10 14:54:46.153380 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.153312    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a"} err="failed to get container status \"b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a\": rpc error: code = NotFound desc = could not find container \"b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a\": container with ID starting with b3065eaeb0838c6c13bac410c9a5ae80662b73d5d2dcf2b7727202575767b45a not found: ID does not exist"
Sep 10 14:54:46.153380 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.153330    2577 scope.go:117] "RemoveContainer" containerID="64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873"
Sep 10 14:54:46.162427 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.162407    2577 scope.go:117] "RemoveContainer" containerID="64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873"
Sep 10 14:54:46.162731 ip-10-0-135-201 kubenswrapper[2577]: E0910 14:54:46.162709    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873\": container with ID starting with 64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873 not found: ID does not exist" containerID="64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873"
Sep 10 14:54:46.162798 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.162741    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873"} err="failed to get container status \"64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873\": rpc error: code = NotFound desc = could not find container \"64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873\": container with ID starting with 64fd57d73953d04902bd2173548230eeab77b52a12b3f32285bd48b49795f873 not found: ID does not exist"
Sep 10 14:54:46.171892 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.168337    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"]
Sep 10 14:54:46.175474 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.175447    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz"]
Sep 10 14:54:46.185059 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.185033    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"]
Sep 10 14:54:46.193718 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:46.193689    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8"]
Sep 10 14:54:47.511671 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:47.511636    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" path="/var/lib/kubelet/pods/32e6e3eb-5dca-4cf1-b650-be2aded3e0f1/volumes"
Sep 10 14:54:47.512169 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:47.512034    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581c470e-5fcb-4cea-93ab-bdbf12925b8c" path="/var/lib/kubelet/pods/581c470e-5fcb-4cea-93ab-bdbf12925b8c/volumes"
Sep 10 14:54:49.574014 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:49.573980    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:54:49.579956 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:49.579936    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:54:49.844135 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:54:49.844052    2577 scope.go:117] "RemoveContainer" containerID="ba9b3299691bd2569dfc2039636df1eff5433f974d7663adcfe802d0a6c24cdc"
Sep 10 14:55:49.883648 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:55:49.883564    2577 scope.go:117] "RemoveContainer" containerID="0dfaef4880000569099f4f63e23324f4ddf6d5cfc45d12c49dcce9a6315bc6bb"
Sep 10 14:56:49.904908 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:56:49.904874    2577 scope.go:117] "RemoveContainer" containerID="d1e639ab27ad8c6e3529b34fae25bd6902ad2485b1b01fbf3fd90c854d4f94c9"
Sep 10 14:56:49.913378 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:56:49.913357    2577 scope.go:117] "RemoveContainer" containerID="a4c63022a6541d3fddad286f6f2211a933230f05b428dc7cf0ffffa0780c334e"
Sep 10 14:56:49.921029 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:56:49.921005    2577 scope.go:117] "RemoveContainer" containerID="af4ae0c6ea1478a0291dd35f572b12dd9096847fb24c29f9594c63a070bb2eb4"
Sep 10 14:58:49.956762 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:58:49.956682    2577 scope.go:117] "RemoveContainer" containerID="7405c2a5565cc00e40ca6dbf40510ba37b8b9f0255bab33670d1984daa586cf5"
Sep 10 14:58:49.965182 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:58:49.965161    2577 scope.go:117] "RemoveContainer" containerID="e1552cc4974b292c54f2e8be7ba79db103fe93aaac5735e937ed75356777f1a8"
Sep 10 14:59:49.605177 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:59:49.605148    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 14:59:49.619456 ip-10-0-135-201 kubenswrapper[2577]: I0910 14:59:49.619429    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5fmnl_94ff6d83-2107-4f30-81de-6a7cb1ead18c/ovn-acl-logging/0.log"
Sep 10 15:00:00.163696 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.163647    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl"]
Sep 10 15:00:00.164472 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164449    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" containerName="payload-processing"
Sep 10 15:00:00.164550 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164475    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" containerName="payload-processing"
Sep 10 15:00:00.164550 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164528    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581c470e-5fcb-4cea-93ab-bdbf12925b8c" containerName="payload-pre-processing"
Sep 10 15:00:00.164550 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164538    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="581c470e-5fcb-4cea-93ab-bdbf12925b8c" containerName="payload-pre-processing"
Sep 10 15:00:00.164696 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164553    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be10c2a-20ab-4ab5-983f-14e06c73bac5" containerName="revoke-keys"
Sep 10 15:00:00.164696 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164564    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be10c2a-20ab-4ab5-983f-14e06c73bac5" containerName="revoke-keys"
Sep 10 15:00:00.164794 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164727    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e6e3eb-5dca-4cf1-b650-be2aded3e0f1" containerName="payload-processing"
Sep 10 15:00:00.164794 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164740    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8be10c2a-20ab-4ab5-983f-14e06c73bac5" containerName="revoke-keys"
Sep 10 15:00:00.164794 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.164761    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="581c470e-5fcb-4cea-93ab-bdbf12925b8c" containerName="payload-pre-processing"
Sep 10 15:00:00.168416 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.168392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl"
Sep 10 15:00:00.171458 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.171435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xnxsg\""
Sep 10 15:00:00.177883 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.177865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl"
Sep 10 15:00:00.184482 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.184455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl"]
Sep 10 15:00:00.460684 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.460659    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl"]
Sep 10 15:00:00.462974 ip-10-0-135-201 kubenswrapper[2577]: W0910 15:00:00.462945    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc654f93d_32f2_4e55_be67_8cbdbada2abe.slice/crio-ca2f121eb303103bfd3454a62afbe0ddcf50d1a9cb05da74417f531cdb1f2cf5 WatchSource:0}: Error finding container ca2f121eb303103bfd3454a62afbe0ddcf50d1a9cb05da74417f531cdb1f2cf5: Status 404 returned error can't find the container with id ca2f121eb303103bfd3454a62afbe0ddcf50d1a9cb05da74417f531cdb1f2cf5
Sep 10 15:00:00.741366 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:00.741286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl" event={"ID":"c654f93d-32f2-4e55-be67-8cbdbada2abe","Type":"ContainerStarted","Data":"ca2f121eb303103bfd3454a62afbe0ddcf50d1a9cb05da74417f531cdb1f2cf5"}
Sep 10 15:00:01.747464 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:01.747371    2577 generic.go:356] "Generic (PLEG): container finished" podID="c654f93d-32f2-4e55-be67-8cbdbada2abe" containerID="554f0a0012eda6fb4afc3eb4624cf813485a7f261e542d485bc6dde449c65907" exitCode=0
Sep 10 15:00:01.747464 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:01.747408    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl" event={"ID":"c654f93d-32f2-4e55-be67-8cbdbada2abe","Type":"ContainerDied","Data":"554f0a0012eda6fb4afc3eb4624cf813485a7f261e542d485bc6dde449c65907"}
Sep 10 15:00:02.888065 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:02.888038    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl"
Sep 10 15:00:03.758627 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:03.758594    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl" event={"ID":"c654f93d-32f2-4e55-be67-8cbdbada2abe","Type":"ContainerDied","Data":"ca2f121eb303103bfd3454a62afbe0ddcf50d1a9cb05da74417f531cdb1f2cf5"}
Sep 10 15:00:03.758803 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:03.758643    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca2f121eb303103bfd3454a62afbe0ddcf50d1a9cb05da74417f531cdb1f2cf5"
Sep 10 15:00:03.758803 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:03.758602    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817540-6q9zl"
Sep 10 15:00:46.260912 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:46.260881    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-755bd7f47-wrw9n_b782dd7e-dd2a-495e-bb98-9242c8120abe/manager/0.log"
Sep 10 15:00:46.267097 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:46.267072    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-755bd7f47-wrw9n_b782dd7e-dd2a-495e-bb98-9242c8120abe/copy-manifests/0.log"
Sep 10 15:00:46.821633 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:46.821605    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817525-vzpd4_4aa97ea8-c75d-44cf-8b85-0cbbce468586/cleanup/0.log"
Sep 10 15:00:46.930982 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:46.930956    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817540-6q9zl_c654f93d-32f2-4e55-be67-8cbdbada2abe/cleanup/0.log"
Sep 10 15:00:48.957796 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:48.957764    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr_3213759d-6a62-4b86-986b-cfbd4c63b763/istio-proxy/0.log"
Sep 10 15:00:49.083599 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:49.083566    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cthr2_6b277dc7-76e2-4869-aad5-7b911f242050/discovery/0.log"
Sep 10 15:00:49.464313 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:49.464276    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gmnj8_f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4/istio-proxy/1.log"
Sep 10 15:00:49.591154 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:49.591105    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7pdc7_7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a/payload-pre-processing/0.log"
Sep 10 15:00:49.996038 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:49.996000    2577 scope.go:117] "RemoveContainer" containerID="f27e2d8228f4e026eae95a20002bc62cb5925f3ee4234573bd8c3e733acb35c4"
Sep 10 15:00:50.004429 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:50.004411    2577 scope.go:117] "RemoveContainer" containerID="08742d3b7bcbab78052ae0b0a750da1e8351d3b81c9bfb45719951e2998e02fc"
Sep 10 15:00:50.012383 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:50.012363    2577 scope.go:117] "RemoveContainer" containerID="ece0386326c1db769a956d15069e877b297204225059833b07715df6a88b0b34"
Sep 10 15:00:50.229150 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:50.229119    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-t9bbl_bab2daf0-be49-43a0-ae03-c0d098bd0c9c/main/0.log"
Sep 10 15:00:50.484885 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:50.484833    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-lqbqd_52f4eb40-fa22-4470-8b55-5fba33e1bc68/main/0.log"
Sep 10 15:00:50.722912 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:00:50.722886    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f7ssjb_03d74b00-f7ab-48e8-89a6-4801b1ce4146/main/0.log"
Sep 10 15:01:00.361837 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:00.361806    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d7fcl_3f4440b5-f048-4eec-9320-3e3417e6235e/global-pull-secret-syncer/0.log"
Sep 10 15:01:00.598275 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:00.598236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pdnp7_5d4da659-33c3-4c05-adab-1b3614777fe0/konnectivity-agent/0.log"
Sep 10 15:01:00.761447 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:00.761418    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-201.ec2.internal_c2f6b5702b027da2342207c9447b842c/haproxy/0.log"
Sep 10 15:01:07.734223 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:07.734192    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-8mlt8_5cde8ca2-2cd5-437c-94d5-6510b3b4527a/cluster-monitoring-operator/0.log"
Sep 10 15:01:07.945453 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:07.945428    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-s67cp_12818a0a-237e-4764-bc73-b96c07a3f33c/monitoring-plugin/0.log"
Sep 10 15:01:08.087034 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.087003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fblfg_01332b02-953c-4fd3-8e30-9aff14896209/node-exporter/0.log"
Sep 10 15:01:08.116345 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.116279    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fblfg_01332b02-953c-4fd3-8e30-9aff14896209/kube-rbac-proxy/0.log"
Sep 10 15:01:08.141502 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.141477    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fblfg_01332b02-953c-4fd3-8e30-9aff14896209/init-textfile/0.log"
Sep 10 15:01:08.509251 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.509226    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798fbd64-fae8-4cd5-813a-cb93e5a68168/prometheus/0.log"
Sep 10 15:01:08.536115 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.536081    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798fbd64-fae8-4cd5-813a-cb93e5a68168/config-reloader/0.log"
Sep 10 15:01:08.561806 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.561780    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798fbd64-fae8-4cd5-813a-cb93e5a68168/thanos-sidecar/0.log"
Sep 10 15:01:08.589662 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.589635    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798fbd64-fae8-4cd5-813a-cb93e5a68168/kube-rbac-proxy-web/0.log"
Sep 10 15:01:08.620490 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.620465    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798fbd64-fae8-4cd5-813a-cb93e5a68168/kube-rbac-proxy/0.log"
Sep 10 15:01:08.648424 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.648391    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798fbd64-fae8-4cd5-813a-cb93e5a68168/kube-rbac-proxy-thanos/0.log"
Sep 10 15:01:08.675513 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.675485    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_798fbd64-fae8-4cd5-813a-cb93e5a68168/init-config-reloader/0.log"
Sep 10 15:01:08.719934 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.719898    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-pc2wj_2c6046be-c8b2-4563-840e-5e72792ff601/prometheus-operator/0.log"
Sep 10 15:01:08.752378 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.752352    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-pc2wj_2c6046be-c8b2-4563-840e-5e72792ff601/kube-rbac-proxy/0.log"
Sep 10 15:01:08.789526 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.789445    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-ccq4r_d0982f2d-662c-4205-bb48-cf51e28bdc89/prometheus-operator-admission-webhook/0.log"
Sep 10 15:01:08.835686 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.835658    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff9598449-nkcsd_bc7c2b14-0407-4add-9864-8acc78bb6639/telemeter-client/0.log"
Sep 10 15:01:08.869986 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.869959    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff9598449-nkcsd_bc7c2b14-0407-4add-9864-8acc78bb6639/reload/0.log"
Sep 10 15:01:08.913124 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:08.913098    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff9598449-nkcsd_bc7c2b14-0407-4add-9864-8acc78bb6639/kube-rbac-proxy/0.log"
Sep 10 15:01:10.228059 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.228025    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"]
Sep 10 15:01:10.228442 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.228400    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c654f93d-32f2-4e55-be67-8cbdbada2abe" containerName="cleanup"
Sep 10 15:01:10.228442 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.228412    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c654f93d-32f2-4e55-be67-8cbdbada2abe" containerName="cleanup"
Sep 10 15:01:10.228515 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.228479    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c654f93d-32f2-4e55-be67-8cbdbada2abe" containerName="cleanup"
Sep 10 15:01:10.231578 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.231561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.234815 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.234793    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6dn7\"/\"kube-root-ca.crt\""
Sep 10 15:01:10.235249 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.235235    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6dn7\"/\"openshift-service-ca.crt\""
Sep 10 15:01:10.235304 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.235240    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b6dn7\"/\"default-dockercfg-86sqw\""
Sep 10 15:01:10.241105 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.241080    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"]
Sep 10 15:01:10.252233 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.252130    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-7gzhh_1fd27d88-e9c6-4f01-8bb8-f6ab34a8aeae/networking-console-plugin/0.log"
Sep 10 15:01:10.306255 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.306219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-lib-modules\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.306255 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.306259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86gbp\" (UniqueName: \"kubernetes.io/projected/322e4f74-16d4-47c5-a4e9-1853d301da86-kube-api-access-86gbp\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.306487 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.306376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-podres\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.306487 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.306407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-proc\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.306487 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.306466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-sys\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408021 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.407981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-sys\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408193 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-lib-modules\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408193 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86gbp\" (UniqueName: \"kubernetes.io/projected/322e4f74-16d4-47c5-a4e9-1853d301da86-kube-api-access-86gbp\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408193 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-sys\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408193 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-podres\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408417 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-proc\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408417 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-lib-modules\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408417 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-proc\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.408417 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.408323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/322e4f74-16d4-47c5-a4e9-1853d301da86-podres\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.418969 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.418938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86gbp\" (UniqueName: \"kubernetes.io/projected/322e4f74-16d4-47c5-a4e9-1853d301da86-kube-api-access-86gbp\") pod \"perf-node-gather-daemonset-x6kkg\" (UID: \"322e4f74-16d4-47c5-a4e9-1853d301da86\") " pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.541687 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.541584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:10.835588 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:10.835562    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"]
Sep 10 15:01:10.837272 ip-10-0-135-201 kubenswrapper[2577]: W0910 15:01:10.837240    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod322e4f74_16d4_47c5_a4e9_1853d301da86.slice/crio-f037ecd0657d64ed3984437f7680a1f78decd080294017eaa41d80f48a9f423d WatchSource:0}: Error finding container f037ecd0657d64ed3984437f7680a1f78decd080294017eaa41d80f48a9f423d: Status 404 returned error can't find the container with id f037ecd0657d64ed3984437f7680a1f78decd080294017eaa41d80f48a9f423d
Sep 10 15:01:11.098909 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:11.098801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg" event={"ID":"322e4f74-16d4-47c5-a4e9-1853d301da86","Type":"ContainerStarted","Data":"c49d50bd33551a69b53dcb46b579480e3d1c36ad6615b7e4586c072f11fb73ce"}
Sep 10 15:01:11.098909 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:11.098875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg" event={"ID":"322e4f74-16d4-47c5-a4e9-1853d301da86","Type":"ContainerStarted","Data":"f037ecd0657d64ed3984437f7680a1f78decd080294017eaa41d80f48a9f423d"}
Sep 10 15:01:11.099107 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:11.098988    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:11.130749 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:11.130694    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg" podStartSLOduration=1.130676802 podStartE2EDuration="1.130676802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:01:11.129635356 +0000 UTC m=+2482.106764709" watchObservedRunningTime="2026-09-10 15:01:11.130676802 +0000 UTC m=+2482.107806155"
Sep 10 15:01:12.240531 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:12.240498    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-p7m4f_f78bfc43-91e7-4292-9295-38ee69a47ea1/volume-data-source-validator/0.log"
Sep 10 15:01:13.408895 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:13.408867    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zn59b_1c0136e8-a85c-4317-ae2a-f1c966c7f316/dns/0.log"
Sep 10 15:01:13.434339 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:13.434312    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zn59b_1c0136e8-a85c-4317-ae2a-f1c966c7f316/kube-rbac-proxy/0.log"
Sep 10 15:01:13.460853 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:13.460816    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7d2p_3f3b4437-66f7-459d-b8d1-df60d8436024/dns-node-resolver/0.log"
Sep 10 15:01:14.135564 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:14.135536    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4szv6_316800cc-cd67-42e6-921e-b15d3781b63f/node-ca/0.log"
Sep 10 15:01:15.180799 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:15.180760    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr_3213759d-6a62-4b86-986b-cfbd4c63b763/istio-proxy/0.log"
Sep 10 15:01:15.409141 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:15.409114    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cthr2_6b277dc7-76e2-4869-aad5-7b911f242050/discovery/0.log"
Sep 10 15:01:15.491190 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:15.491109    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gmnj8_f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4/istio-proxy/0.log"
Sep 10 15:01:15.498743 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:15.498723    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gmnj8_f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4/istio-proxy/1.log"
Sep 10 15:01:15.537133 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:15.537103    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7pdc7_7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a/payload-pre-processing/0.log"
Sep 10 15:01:16.547862 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:16.547823    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d7p75_ae25126e-e0bc-47a8-beb1-46281402bded/serve-healthcheck-canary/0.log"
Sep 10 15:01:17.076729 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:17.076696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-sl8gl_ad6563f0-8643-4b37-b96c-4c29c702edbb/insights-operator/0.log"
Sep 10 15:01:17.077049 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:17.077030    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-sl8gl_ad6563f0-8643-4b37-b96c-4c29c702edbb/insights-operator/1.log"
Sep 10 15:01:17.101427 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:17.101398    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62jvc_f42034a5-5519-49bc-a4ae-ba773951b072/kube-rbac-proxy/0.log"
Sep 10 15:01:17.113661 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:17.113633    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b6dn7/perf-node-gather-daemonset-x6kkg"
Sep 10 15:01:17.128881 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:17.128858    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62jvc_f42034a5-5519-49bc-a4ae-ba773951b072/exporter/0.log"
Sep 10 15:01:17.159260 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:17.159230    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62jvc_f42034a5-5519-49bc-a4ae-ba773951b072/extractor/0.log"
Sep 10 15:01:20.545370 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:20.545284    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-755bd7f47-wrw9n_b782dd7e-dd2a-495e-bb98-9242c8120abe/manager/0.log"
Sep 10 15:01:20.565690 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:20.565661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-755bd7f47-wrw9n_b782dd7e-dd2a-495e-bb98-9242c8120abe/copy-manifests/0.log"
Sep 10 15:01:20.609541 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:20.609514    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr_3213759d-6a62-4b86-986b-cfbd4c63b763/istio-proxy/0.log"
Sep 10 15:01:20.831370 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:20.831282    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cthr2_6b277dc7-76e2-4869-aad5-7b911f242050/discovery/0.log"
Sep 10 15:01:20.888753 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:20.888720    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gmnj8_f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4/istio-proxy/0.log"
Sep 10 15:01:20.896410 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:20.896385    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gmnj8_f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4/istio-proxy/1.log"
Sep 10 15:01:20.919655 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:20.919619    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7pdc7_7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a/payload-pre-processing/0.log"
Sep 10 15:01:21.924390 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:21.924367    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8f5db98bf-55jnd_632ef37e-6534-4f94-b949-338c2d32629a/manager/0.log"
Sep 10 15:01:22.501782 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:22.501753    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr_3213759d-6a62-4b86-986b-cfbd4c63b763/istio-proxy/0.log"
Sep 10 15:01:22.728753 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:22.728721    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cthr2_6b277dc7-76e2-4869-aad5-7b911f242050/discovery/0.log"
Sep 10 15:01:22.788910 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:22.788815    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gmnj8_f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4/istio-proxy/0.log"
Sep 10 15:01:22.796961 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:22.796936    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-gmnj8_f6b8dac2-dd9b-4cfe-ac44-cc6a0ad19eb4/istio-proxy/1.log"
Sep 10 15:01:22.822504 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:22.822477    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-7pdc7_7249c3f4-befb-4f68-8fbd-d2fbd8ecd45a/payload-pre-processing/0.log"
Sep 10 15:01:27.479413 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:27.479360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l9ffd_8ba4a21d-201d-44ae-aff0-295b9e1b4311/kube-storage-version-migrator-operator/1.log"
Sep 10 15:01:27.481116 ip-10-0-135-201 kubenswrapper[2577]: I0910 15:01:27.481082    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-l9ffd_8ba4a21d-201d-44ae-aff0-295b9e1b4311/kube-storage-version-migrator-operator/0.log"