Aug 05 16:22:21.366265 ip-10-0-128-82 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 16:22:21.795392 ip-10-0-128-82 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:22:21.795392 ip-10-0-128-82 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 16:22:21.795392 ip-10-0-128-82 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:22:21.795392 ip-10-0-128-82 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 16:22:21.795392 ip-10-0-128-82 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:22:21.797600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.797514    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 16:22:21.805062 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805045    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:22:21.805062 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805060    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:22:21.805062 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805063    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805067    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805070    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805073    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805079    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805082    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805085    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805087    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805091    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805094    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805097    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805099    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805102    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805105    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805107    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805110    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805113    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805116    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805118    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805121    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:22:21.805156 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805123    2576 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805126    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805129    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805132    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805134    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805137    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805139    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805142    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805144    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805147    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805149    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805152    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805155    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805157    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805160    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805163    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805167    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805169    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805172    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805174    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:22:21.805622 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805177    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805180    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805184    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805188    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805191    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805194    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805197    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805200    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805203    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805205    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805208    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805210    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805213    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805215    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805218    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805221    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805225    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805227    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805230    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805232    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:22:21.806150 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805235    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805237    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805240    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805242    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805245    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805247    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805250    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805253    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805255    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805258    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805261    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805264    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805266    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805269    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805274    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805277    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805280    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805283    2576 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805285    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:22:21.806626 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805288    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805290    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805293    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805295    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805297    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805300    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805303    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805305    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805308    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805310    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805313    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805315    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805318    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805320    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805323    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805325    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805329    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:22:21.807100 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.805332    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:22:21.808657 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808644    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:22:21.808657 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808656    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808667    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808672    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808675    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808680    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808683    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808686    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808688    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808692    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808696    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808699    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808701    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808704    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808706    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808709    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808711    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808715    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808719    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808722    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:22:21.808723 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808724    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808727    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808730    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808733    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808736    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808738    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808742    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808746    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808749    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808751    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808754    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808757    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808760    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808762    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808765    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808768    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808770    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808773    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808783    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:22:21.809249 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808785    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808788    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808790    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808793    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808795    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808798    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808800    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808804    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808806    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808808    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808811    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808813    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808816    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808818    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808820    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808825    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808828    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808830    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808833    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808836    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:22:21.809710 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808838    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808841    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808843    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808846    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808849    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808851    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808854    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808856    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808859    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808861    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808864    2576 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808866    2576 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808871    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808874    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808876    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808879    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808881    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808885    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808888    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808890    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808893    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:22:21.810217 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808895    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808898    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808900    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808902    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808905    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808907    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808910    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808913    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808916    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808918    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808921    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808924    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808926    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808929    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808931    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808934    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808936    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808939    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.808942    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809335    2576 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:22:21.810725 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809340    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809342    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809346    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809349    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809352    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809355    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809358    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809360    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809363    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809365    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809368    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809371    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809373    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809376    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809378    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809381    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809383    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809386    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809389    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809392    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:22:21.811236 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809395    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809397    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809400    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809402    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809405    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809407    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809410    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809412    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809415    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809417    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809420    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809422    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809425    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809430    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809433    2576 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809437    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809440    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809443    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809446    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:22:21.811728 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809448    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809451    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809453    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809456    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809458    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809460    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809463    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809466    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809468    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809471    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809473    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809476    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809479    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809481    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809484    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809487    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809489    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809492    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809494    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809497    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:22:21.812197 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809499    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809502    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809504    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809507    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809509    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809512    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809514    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809516    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809519    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809522    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809524    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809529    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809532    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809535    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809538    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809541    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809544    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809546    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809550    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:22:21.812685 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809553    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809556    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809559    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809562    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809565    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809568    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809570    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809573    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809575    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809578    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809581    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809583    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809586    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809588    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809591    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809593    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809596    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809598    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809601    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.809603    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809678    2576 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 16:22:21.813159 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809688    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809697    2576 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809703    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809710    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809715    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809721    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809726    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809730    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809733    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809736    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809739    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809742    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809745    2576 flags.go:64] FLAG: --cgroup-root=""
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809748    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809751    2576 flags.go:64] FLAG: --client-ca-file=""
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809754    2576 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809757    2576 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809761    2576 flags.go:64] FLAG: --cluster-domain=""
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809764    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809767    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809770    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809773    2576 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809777    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 16:22:21.813664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809780    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809783    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809786    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809790    2576 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809792    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809795    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809798    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809801    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809805    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809808    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809811    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809816    2576 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809819    2576 flags.go:64] FLAG: --enable-server="true"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809823    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809828    2576 flags.go:64] FLAG: --event-burst="100"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809831    2576 flags.go:64] FLAG: --event-qps="50"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809834    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809837    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809840    2576 flags.go:64] FLAG: --eviction-hard=""
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809844    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809847    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809850    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809853    2576 flags.go:64] FLAG: --eviction-soft=""
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809855    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809858    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 16:22:21.814260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809861    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809864    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809867    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809869    2576 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809872    2576 flags.go:64] FLAG: --feature-gates=""
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809876    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809879    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809882    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809885    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809888    2576 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809890    2576 flags.go:64] FLAG: --help="false"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809893    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-82.ec2.internal"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809896    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809899    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809902    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809905    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809909    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809912    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809915    2576 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809918    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809921    2576 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809924    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809927    2576 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809930    2576 flags.go:64] FLAG: --kube-reserved=""
Aug 05 16:22:21.814864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809933    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809936    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809939    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809942    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809945    2576 flags.go:64] FLAG: --lock-file=""
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809948    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809950    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809953    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809959    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809961    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809964    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809967    2576 flags.go:64] FLAG: --logging-format="text"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809970    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809973    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809976    2576 flags.go:64] FLAG: --manifest-url=""
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809993    2576 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.809997    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810000    2576 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810004    2576 flags.go:64] FLAG: --max-pods="110"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810007    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810010    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810013    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810016    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810019    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810023    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 16:22:21.815495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810026    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810037    2576 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810040    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810043    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810047    2576 flags.go:64] FLAG: --pod-cidr=""
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810050    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810056    2576 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810059    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810062    2576 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810065    2576 flags.go:64] FLAG: --port="10250"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810068    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810072    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0850aa22f80dbc647"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810075    2576 flags.go:64] FLAG: --qos-reserved=""
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810078    2576 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810081    2576 flags.go:64] FLAG: --register-node="true"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810083    2576 flags.go:64] FLAG: --register-with-taints=""
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810087    2576 flags.go:64] FLAG: --registry-burst="10"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810090    2576 flags.go:64] FLAG: --registry-qps="5"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810093    2576 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810096    2576 flags.go:64] FLAG: --reserved-memory=""
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810100    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810103    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810106    2576 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810109    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810112    2576 flags.go:64] FLAG: --runonce="false"
Aug 05 16:22:21.816113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810115    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810118    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810121    2576 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810124    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810127    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810130    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810133    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810136    2576 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810140    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810143    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810146    2576 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810149    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810152    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810155    2576 flags.go:64] FLAG: --system-cgroups=""
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810158    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810163    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810166    2576 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810169    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810173    2576 flags.go:64] FLAG: --tls-min-version=""
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810176    2576 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810178    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810181    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810184    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810187    2576 flags.go:64] FLAG: --v="2"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810191    2576 flags.go:64] FLAG: --version="false"
Aug 05 16:22:21.816739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810194    2576 flags.go:64] FLAG: --vmodule=""
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810198    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.810201    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810316    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810319    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810322    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810325    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810328    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810331    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810334    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810336    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810339    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810342    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810345    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810348    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810352    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810354    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810357    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810360    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:22:21.817638 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810362    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810365    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810368    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810370    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810374    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810377    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810380    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810383    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810385    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810388    2576 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810390    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810393    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810395    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810398    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810401    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810403    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810406    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810409    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810411    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810414    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:22:21.818501 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810416    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810419    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810421    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810424    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810426    2576 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810429    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810431    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810433    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810437    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810440    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810443    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810445    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810448    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810450    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810453    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810456    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810461    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810463    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810466    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810469    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:22:21.819369 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810471    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810474    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810476    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810479    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810482    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810484    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810487    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810489    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810493    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810497    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810500    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810502    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810505    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810508    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810511    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810514    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810518    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810522    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810525    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:22:21.819842 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810527    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810532    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810534    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810537    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810539    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810542    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810544    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810547    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810549    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810554    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810557    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810561    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810564    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810566    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810569    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810572    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810575    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810577    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810580    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:22:21.820472 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810583    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810586    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810588    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810591    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.810594    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.811488    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.819225    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.819243    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.820152    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.820168    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820254    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820262    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820268    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820273    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820278    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:22:21.821311 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820283    2576 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820289    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820293    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820298    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820303    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820307    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820312    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820317    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820322    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820326    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820331    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820336    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820340    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820344    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820349    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820354    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820360    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820367    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820371    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:22:21.821855 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820376    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820380    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820385    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820390    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820394    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820401    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820405    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820410    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820414    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820418    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820423    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820427    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820431    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820435    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820440    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820444    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820448    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820452    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820456    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820460    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:22:21.822370 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820465    2576 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820469    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820473    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820478    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820482    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820486    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820490    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820494    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820498    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820502    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820507    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820511    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820516    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820520    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820524    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820528    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820533    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820538    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820543    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820548    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:22:21.823168 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820553    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820560    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820567    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820573    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820578    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820582    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820587    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820592    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820596    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820600    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820605    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820609    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820613    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820618    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820622    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820627    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820631    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820635    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820640    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:22:21.823851 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820646    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820652    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820657    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820671    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820676    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820681    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820686    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820691    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820696    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820700    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820704    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820708    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820713    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820717    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820722    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:22:21.824594 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820726    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.820734    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820921    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820930    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820935    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820939    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820943    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820948    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820952    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820956    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820961    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820967    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820973    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.820995    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821000    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:22:21.824963 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821004    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821008    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821013    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821017    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821021    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821025    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821029    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821033    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821038    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821042    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821046    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821050    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821055    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821059    2576 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821063    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821069    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821073    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821078    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821082    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821086    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:22:21.825505 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821090    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821094    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821098    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821102    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821108    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821114    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821119    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821123    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821128    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821132    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821137    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821141    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821146    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821150    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821155    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821159    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821164    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821168    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821173    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:22:21.826018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821178    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821182    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821186    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821190    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821194    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821199    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821203    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821207    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821211    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821216    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821220    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821223    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821228    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821232    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821236    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821240    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821244    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821248    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821252    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821256    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:22:21.826510 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821260    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821264    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821268    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821273    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821277    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821281    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821285    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821290    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821294    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821298    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821303    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821307    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821310    2576 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821314    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821318    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821322    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821326    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821329    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821333    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821337    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:22:21.827014 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821342    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821346    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821350    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821355    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821359    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821366    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:21.821371    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.821379    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.821560    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.825259    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.826997    2576 server.go:1019] "Starting client certificate rotation"
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.827098    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:22:21.827537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.827133    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:22:21.829879 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.829862    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:22:21.834015 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.833998    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:22:21.845842 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.845821    2576 log.go:25] "Validated CRI v1 runtime API"
Aug 05 16:22:21.848352 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.848339    2576 log.go:25] "Validated CRI v1 image API"
Aug 05 16:22:21.849143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.849130    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 16:22:21.853480 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.853452    2576 fs.go:135] Filesystem UUIDs: map[76558c63-78b0-438f-b1c6-e19e6da2c903:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e31cb89d-a0fe-45d6-be89-8e1fd3469308:/dev/nvme0n1p4]
Aug 05 16:22:21.853584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.853474    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 16:22:21.856557 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.856534    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:22:21.859057 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.858919    2576 manager.go:216] Machine: {Timestamp:2026-08-05 16:22:21.857499745 +0000 UTC m=+0.364391448 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096574 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2852ead53853b417766cf8dafdc448 SystemUUID:ec2852ea-d538-53b4-1776-6cf8dafdc448 BootID:5fb3e433-4db3-4ffd-8719-77f7ba910e4f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:49:16:01:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:49:16:01:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:52:ac:27:72:8f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 16:22:21.859057 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.859050    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 16:22:21.859220 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.859159    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 16:22:21.862557 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.862532    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 16:22:21.862708 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.862559    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 16:22:21.863423 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.863410    2576 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 16:22:21.863457 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.863425    2576 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 16:22:21.863457 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.863437    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:22:21.864254 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.864240    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:22:21.865565 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.865553    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 16:22:21.870892 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.870878    2576 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:22:21.871055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871044    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 16:22:21.871091 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871076    2576 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 16:22:21.871119 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871093    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 16:22:21.871119 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871108    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 16:22:21.871194 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871120    2576 kubelet.go:398] "Adding apiserver pod source"
Aug 05 16:22:21.871194 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871129    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 16:22:21.871666 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871633    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:22:21.871666 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.871665    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:22:21.876869 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.876844    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 16:22:21.878898 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.878883    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 16:22:21.878949 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.878914    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 16:22:21.880313 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880300    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 16:22:21.880353 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880319    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 16:22:21.880353 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880330    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 16:22:21.880353 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880339    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 16:22:21.880353 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880352    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 16:22:21.880462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880361    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 16:22:21.880462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880373    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 16:22:21.880462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880381    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 16:22:21.880462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880392    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 16:22:21.880462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880399    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 16:22:21.880462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880411    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 16:22:21.880462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.880419    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 16:22:21.881366 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.881351    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 16:22:21.881401 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.881369    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 16:22:21.884586 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.884568    2576 server.go:1268] "Started kubelet"
Aug 05 16:22:21.884745 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.884646    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 16:22:21.884745 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.884726    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 16:22:21.885099 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.884952    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 16:22:21.885519 ip-10-0-128-82 systemd[1]: Started Kubernetes Kubelet.
Aug 05 16:22:21.885728 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.885526    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 16:22:21.885728 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.885521    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 16:22:21.885728 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.885525    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 16:22:21.886326 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.886308    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 16:22:21.887664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.887651    2576 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 16:22:21.890821 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.890798    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 16:22:21.892598 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.891505    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-82.ec2.internal.18c8f54802b9266c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-82.ec2.internal,UID:ip-10-0-128-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-82.ec2.internal,},FirstTimestamp:2026-08-05 16:22:21.884540524 +0000 UTC m=+0.391432228,LastTimestamp:2026-08-05 16:22:21.884540524 +0000 UTC m=+0.391432228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-82.ec2.internal,}"
Aug 05 16:22:21.893380 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.893357    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 16:22:21.893539 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.893520    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:21.893539 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.893528    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 16:22:21.894551 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.894331    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 16:22:21.894551 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.894346    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 16:22:21.894551 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.894411    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 16:22:21.896069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.894738    2576 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 16:22:21.896069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.894751    2576 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 16:22:21.896956 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.896930    2576 factory.go:55] Registering systemd factory
Aug 05 16:22:21.896956 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.896946    2576 factory.go:223] Registration of the systemd container factory successfully
Aug 05 16:22:21.897243 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.897225    2576 factory.go:153] Registering CRI-O factory
Aug 05 16:22:21.897243 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.897242    2576 factory.go:223] Registration of the crio container factory successfully
Aug 05 16:22:21.897357 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.897321    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 16:22:21.897357 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.897355    2576 factory.go:103] Registering Raw factory
Aug 05 16:22:21.897444 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.897370    2576 manager.go:1196] Started watching for new ooms in manager
Aug 05 16:22:21.897853 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.897836    2576 manager.go:349] Starting recovery of all containers
Aug 05 16:22:21.898958 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.898931    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 16:22:21.899120 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.899078    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 16:22:21.909401 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.909381    2576 manager.go:354] Recovery completed
Aug 05 16:22:21.914241 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.914229    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:21.916066 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.916047    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:21.916147 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.916080    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:21.916147 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.916094    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:21.916610 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.916595    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 16:22:21.916671 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.916609    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 16:22:21.916671 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.916626    2576 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:22:21.916764 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.916601    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:21.917420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.917406    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:21.917483 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.917429    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:21.917483 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.917439    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:21.918374 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.918307    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-82.ec2.internal.18c8f548049a2a71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-82.ec2.internal,UID:ip-10-0-128-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-82.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-82.ec2.internal,},FirstTimestamp:2026-08-05 16:22:21.916064369 +0000 UTC m=+0.422956073,LastTimestamp:2026-08-05 16:22:21.916064369 +0000 UTC m=+0.422956073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-82.ec2.internal,}"
Aug 05 16:22:21.918808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.918741    2576 policy_none.go:49] "None policy: Start"
Aug 05 16:22:21.918808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.918752    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 16:22:21.918808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.918762    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 16:22:21.920687 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.920673    2576 policy_none.go:47] "Start"
Aug 05 16:22:21.924873 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.924786    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-82.ec2.internal.18c8f548049a8036  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-82.ec2.internal,UID:ip-10-0-128-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-82.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-82.ec2.internal,},FirstTimestamp:2026-08-05 16:22:21.916086326 +0000 UTC m=+0.422978031,LastTimestamp:2026-08-05 16:22:21.916086326 +0000 UTC m=+0.422978031,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-82.ec2.internal,}"
Aug 05 16:22:21.926156 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.926133    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xntzj"
Aug 05 16:22:21.926729 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.926644    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-82.ec2.internal.18c8f548049ab4c9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-82.ec2.internal,UID:ip-10-0-128-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-82.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-82.ec2.internal,},FirstTimestamp:2026-08-05 16:22:21.916099785 +0000 UTC m=+0.422991495,LastTimestamp:2026-08-05 16:22:21.916099785 +0000 UTC m=+0.422991495,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-82.ec2.internal,}"
Aug 05 16:22:21.933791 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.933636    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xntzj"
Aug 05 16:22:21.939594 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.939531    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-82.ec2.internal.18c8f548049a2a71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-82.ec2.internal.18c8f548049a2a71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-82.ec2.internal,UID:ip-10-0-128-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-82.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-82.ec2.internal,},FirstTimestamp:2026-08-05 16:22:21.916064369 +0000 UTC m=+0.422956073,LastTimestamp:2026-08-05 16:22:21.917418335 +0000 UTC m=+0.424310037,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-82.ec2.internal,}"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.946767    2576 manager.go:337] "Starting Device Plugin manager"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.946801    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.946811    2576 server.go:87] "Starting device plugin registration server"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.947111    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.947125    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.947208    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.947286    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.947295    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.947770    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.947810    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.982247    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.983407    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.983441    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.983461    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:21.983492    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:21.986065    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.047380    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.048309    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.048334    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.048343    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.048366    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.059804    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.078499 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.059822    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-82.ec2.internal\": node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.083970 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.083953    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"]
Aug 05 16:22:22.084060 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.084036    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:22.085490 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.085476    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:22.085572 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.085498    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:22.085572 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.085507    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:22.086106 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.086092    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.087870 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.087858    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:22.088010 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.087972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.088071 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.088035    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:22.088526 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.088508    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:22.088607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.088532    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:22.088607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.088539    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:22.088607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.088553    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:22.088734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.088555    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:22.088734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.088722    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:22.090858 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.090844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.090928 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.090867    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:22.091497 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.091483    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:22.091570 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.091511    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:22.091570 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.091521    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:22.095954 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.095936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22bdd79b929aba79a130da362ca33b19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"22bdd79b929aba79a130da362ca33b19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.096032 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.095962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22bdd79b929aba79a130da362ca33b19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"22bdd79b929aba79a130da362ca33b19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.096032 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.095991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38682c8c45872d6ae76d00eb5809d129-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"38682c8c45872d6ae76d00eb5809d129\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.114569 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.114548    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-82.ec2.internal\" not found" node="ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.119001 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.118972    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-82.ec2.internal\" not found" node="ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.186617 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.186594    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.196970 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.196949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22bdd79b929aba79a130da362ca33b19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"22bdd79b929aba79a130da362ca33b19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.197060 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.196974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22bdd79b929aba79a130da362ca33b19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"22bdd79b929aba79a130da362ca33b19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.197060 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.197011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38682c8c45872d6ae76d00eb5809d129-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"38682c8c45872d6ae76d00eb5809d129\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.197121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.197050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22bdd79b929aba79a130da362ca33b19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"22bdd79b929aba79a130da362ca33b19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.197121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.197050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22bdd79b929aba79a130da362ca33b19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal\" (UID: \"22bdd79b929aba79a130da362ca33b19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.197121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.197043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38682c8c45872d6ae76d00eb5809d129-config\") pod \"kube-apiserver-proxy-ip-10-0-128-82.ec2.internal\" (UID: \"38682c8c45872d6ae76d00eb5809d129\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.287147 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.287113    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.387955 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.387882    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.417371 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.417344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.422235 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.422214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:22.488532 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.488496    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.590111 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.590059    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.692114 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.692028    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.792334 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.792299    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.792731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.792717    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:22:22.827667 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.827641    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 16:22:22.828087 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.827790    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:22:22.828087 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.827826    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:22:22.893024 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.892997    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:22.925674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.925639    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:22:22.926821 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.926798    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:22:22.926899 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.926833    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:22:22.926899 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.926848    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:22:22.939674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.939641    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 16:17:22 +0000 UTC" deadline="2028-04-10 17:50:13.612760266 +0000 UTC"
Aug 05 16:22:22.939674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:22.939669    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14737h27m50.673094501s"
Aug 05 16:22:22.994164 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:22.994101    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-82.ec2.internal\" not found"
Aug 05 16:22:23.002207 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.002186    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:22:23.095147 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.095112    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:23.108966 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.108940    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:22:23.110785 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.110768    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal"
Aug 05 16:22:23.119812 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.119789    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:22:23.203738 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:23.203702    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bdd79b929aba79a130da362ca33b19.slice/crio-5077467b48dea524446d758d234bf05a09bf44f6b8092b39dd02e8411f143154 WatchSource:0}: Error finding container 5077467b48dea524446d758d234bf05a09bf44f6b8092b39dd02e8411f143154: Status 404 returned error can't find the container with id 5077467b48dea524446d758d234bf05a09bf44f6b8092b39dd02e8411f143154
Aug 05 16:22:23.204104 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:23.204082    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38682c8c45872d6ae76d00eb5809d129.slice/crio-a602187e8785e1353dc3318ae9601d54862ad070a0824723bcb3ce7d2224f309 WatchSource:0}: Error finding container a602187e8785e1353dc3318ae9601d54862ad070a0824723bcb3ce7d2224f309: Status 404 returned error can't find the container with id a602187e8785e1353dc3318ae9601d54862ad070a0824723bcb3ce7d2224f309
Aug 05 16:22:23.211463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.211445    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:22:23.299949 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.299869    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:22:23.800995 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.800890    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:22:23.872316 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.872279    2576 apiserver.go:52] "Watching apiserver"
Aug 05 16:22:23.878336 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.878312    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 16:22:23.880046 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.880005    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-79f65","openshift-network-diagnostics/network-check-target-295rm","openshift-network-operator/iptables-alerter-l8f74","openshift-ovn-kubernetes/ovnkube-node-l8hdr","kube-system/konnectivity-agent-tvzzl","kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm","openshift-cluster-node-tuning-operator/tuned-9fqd8","openshift-dns/node-resolver-k2qmn","openshift-image-registry/node-ca-4ll2k","openshift-multus/multus-additional-cni-plugins-zblqt","openshift-multus/multus-d2s62","kube-system/global-pull-secret-syncer-jl6qt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal"]
Aug 05 16:22:23.882742 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.882720    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.885046 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.885017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:23.885159 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:23.885118    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:23.885500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.885476    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 16:22:23.885500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.885491    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 16:22:23.885656 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.885519    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 16:22:23.885656 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.885487    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n5jnv\""
Aug 05 16:22:23.887559 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.887535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:23.889720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.889699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 16:22:23.890384 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.889948    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:22:23.890384 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.890050    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 16:22:23.890384 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.890126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sxx66\""
Aug 05 16:22:23.890384 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.890187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.892720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892558    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 16:22:23.892720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892569    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 16:22:23.892720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x92ct\""
Aug 05 16:22:23.892720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892611    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 16:22:23.892720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 16:22:23.893055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:23.893055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892884    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 16:22:23.893055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.892901    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 16:22:23.894215 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.894184    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 16:22:23.894858 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.894840    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vp2kf\""
Aug 05 16:22:23.894960 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.894884    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 16:22:23.895237 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.895218    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.895334 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.895238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 16:22:23.897222 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.897204    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:22:23.897322 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.897245    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4j4jf\""
Aug 05 16:22:23.897393 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.897248    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 16:22:23.897734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.897718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:23.900006 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.899803    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 16:22:23.900006 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.899948    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 16:22:23.900293 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.900257    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5wqvc\""
Aug 05 16:22:23.900393 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.900327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:23.900455 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:23.900394    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:23.903625 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.903606    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:23.903723 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:23.903693    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:23.907134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.906559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:23.907134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.907073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcef4172-5179-448e-8f63-bcca5c29b3d2-iptables-alerter-script\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:23.907134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.907113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-systemd-units\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.908925 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.908897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909052 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.908960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-node-log\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909052 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.908989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhv6n\" (UniqueName: \"kubernetes.io/projected/08697cff-cf26-45c8-8ecb-22f429f3eb7b-kube-api-access-qhv6n\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909159 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-modprobe-d\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909200 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-kubernetes\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:23.909253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-log-socket\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909348 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909348 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovnkube-config\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909348 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovnkube-script-lib\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7bf36976-dce4-4748-a01f-67b0df83fb95-agent-certs\") pod \"konnectivity-agent-tvzzl\" (UID: \"7bf36976-dce4-4748-a01f-67b0df83fb95\") " pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:23.909501 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysctl-d\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909501 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-systemd\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909610 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dsh\" (UniqueName: \"kubernetes.io/projected/dcef4172-5179-448e-8f63-bcca5c29b3d2-kube-api-access-s4dsh\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:23.909664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-cni-bin\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909699 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-var-lib-kubelet\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909735 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3626657-c93e-4b61-a652-d956795599bc-etc-tuned\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909769 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-dbus\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:23.909804 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-slash\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.909837 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysctl-conf\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909876 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-sys\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-lib-modules\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp9t7\" (UniqueName: \"kubernetes.io/projected/f3626657-c93e-4b61-a652-d956795599bc-kube-api-access-sp9t7\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.909992 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.909992 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.909982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-registration-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.910097 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.910038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdd9m\" (UniqueName: \"kubernetes.io/projected/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-kube-api-access-cdd9m\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.910160 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.910111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-run-netns\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.910631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.910239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-systemd\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.910631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.910310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3626657-c93e-4b61-a652-d956795599bc-tmp\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.910631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.910443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-kubelet\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.910631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.910476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-cni-netd\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.910631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.910562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovn-node-metrics-cert\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.911731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.911589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7bf36976-dce4-4748-a01f-67b0df83fb95-konnectivity-ca\") pod \"konnectivity-agent-tvzzl\" (UID: \"7bf36976-dce4-4748-a01f-67b0df83fb95\") " pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.911867    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.911851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-socket-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-sys-fs\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-etc-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysconfig\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-host\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-device-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcef4172-5179-448e-8f63-bcca5c29b3d2-host-slash\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-var-lib-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912815    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-ovn\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-env-overrides\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.912990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-run\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.913030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-kubelet-config\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.913085    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pvj9p\""
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.913213    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 16:22:23.913848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.913631    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 16:22:23.914804 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.913951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:23.917275 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.917249    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 16:22:23.917275 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.917254    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 16:22:23.918009 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.917610    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 16:22:23.918009 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.917668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2s62"
Aug 05 16:22:23.918009 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.917842    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bd2tf\""
Aug 05 16:22:23.918009 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.917854    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 16:22:23.918316 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.918134    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 16:22:23.919946 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.919926    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 16:22:23.920093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.920065    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kcv72\""
Aug 05 16:22:23.931863 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.931838    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kttrq"
Aug 05 16:22:23.940961 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.940931    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kttrq"
Aug 05 16:22:23.988502 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.988454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" event={"ID":"38682c8c45872d6ae76d00eb5809d129","Type":"ContainerStarted","Data":"a602187e8785e1353dc3318ae9601d54862ad070a0824723bcb3ce7d2224f309"}
Aug 05 16:22:23.989865 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.989839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"22bdd79b929aba79a130da362ca33b19","Type":"ContainerStarted","Data":"5077467b48dea524446d758d234bf05a09bf44f6b8092b39dd02e8411f143154"}
Aug 05 16:22:23.996318 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:23.996298    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 16:22:24.014217 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcef4172-5179-448e-8f63-bcca5c29b3d2-iptables-alerter-script\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:24.014370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-systemd-units\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.014370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.014370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-node-log\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.014370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-kubernetes\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.014370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysctl-d\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.014370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cthrh\" (UniqueName: \"kubernetes.io/projected/14837c1d-5229-403d-9250-0b77cafea91b-kube-api-access-cthrh\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.014370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-serviceca\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovnkube-config\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovnkube-script-lib\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7bf36976-dce4-4748-a01f-67b0df83fb95-agent-certs\") pod \"konnectivity-agent-tvzzl\" (UID: \"7bf36976-dce4-4748-a01f-67b0df83fb95\") " pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3626657-c93e-4b61-a652-d956795599bc-etc-tuned\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-cnibin\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dsh\" (UniqueName: \"kubernetes.io/projected/dcef4172-5179-448e-8f63-bcca5c29b3d2-kube-api-access-s4dsh\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-k8s-cni-cncf-io\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-slash\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-lib-modules\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14837c1d-5229-403d-9250-0b77cafea91b-tmp-dir\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.014746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-netns\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.015453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-multus-certs\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.015453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-systemd\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.015453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-systemd\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.015453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysctl-d\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.015453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015206    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 16:22:24.015453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.015453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-systemd-units\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.015816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dcef4172-5179-448e-8f63-bcca5c29b3d2-iptables-alerter-script\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:24.015816 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.015556    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:24.015816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-kubernetes\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.015816 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.015651    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret podName:64fe61ce-f5f6-4d9a-b957-fb2591c24cac nodeName:}" failed. No retries permitted until 2026-08-05 16:22:24.515630517 +0000 UTC m=+3.022522211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret") pod "global-pull-secret-syncer-jl6qt" (UID: "64fe61ce-f5f6-4d9a-b957-fb2591c24cac") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:24.015816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-node-log\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.015816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-lib-modules\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.016151 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.014848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3626657-c93e-4b61-a652-d956795599bc-tmp\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.016151 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.015996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:24.016151 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-slash\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016151 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016151 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-system-cni-dir\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-cni-netd\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovn-node-metrics-cert\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7bf36976-dce4-4748-a01f-67b0df83fb95-konnectivity-ca\") pod \"konnectivity-agent-tvzzl\" (UID: \"7bf36976-dce4-4748-a01f-67b0df83fb95\") " pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-hostroot\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-sys-fs\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysconfig\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.016420 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovnkube-script-lib\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcef4172-5179-448e-8f63-bcca5c29b3d2-host-slash\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-sys-fs\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-var-lib-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysconfig\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-run\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14837c1d-5229-403d-9250-0b77cafea91b-hosts-file\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovnkube-config\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcef4172-5179-448e-8f63-bcca5c29b3d2-host-slash\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-run\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-cni-netd\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.016806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-var-lib-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.016998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55gg\" (UniqueName: \"kubernetes.io/projected/9cb1528c-89d6-403f-9a88-772e472da6df-kube-api-access-d55gg\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-os-release\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017152    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7bf36976-dce4-4748-a01f-67b0df83fb95-konnectivity-ca\") pod \"konnectivity-agent-tvzzl\" (UID: \"7bf36976-dce4-4748-a01f-67b0df83fb95\") " pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-system-cni-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-kubelet-config\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhv6n\" (UniqueName: \"kubernetes.io/projected/08697cff-cf26-45c8-8ecb-22f429f3eb7b-kube-api-access-qhv6n\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-modprobe-d\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-sys\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-cni-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.017461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-socket-dir-parent\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-cni-bin\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017459    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-kubelet-config\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-cni-multus\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-modprobe-d\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-log-socket\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-systemd\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-var-lib-kubelet\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-systemd\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-log-socket\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-kubelet\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-conf-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-var-lib-kubelet\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-cni-bin\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-host\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-sys\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-os-release\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vrk\" (UniqueName: \"kubernetes.io/projected/ea1db765-5e59-4cf4-9c04-16542851c285-kube-api-access-m7vrk\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-cni-bin\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-dbus\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.017966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysctl-conf\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-dbus\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp9t7\" (UniqueName: \"kubernetes.io/projected/f3626657-c93e-4b61-a652-d956795599bc-kube-api-access-sp9t7\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsdp\" (UniqueName: \"kubernetes.io/projected/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-kube-api-access-qdsdp\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-etc-sysctl-conf\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-cni-binary-copy\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-cnibin\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-registration-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdd9m\" (UniqueName: \"kubernetes.io/projected/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-kube-api-access-cdd9m\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-run-netns\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.018830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzpjb\" (UniqueName: \"kubernetes.io/projected/4ab866e0-b7dc-4001-adba-ed14b7139311-kube-api-access-mzpjb\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea1db765-5e59-4cf4-9c04-16542851c285-multus-daemon-config\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-kubelet\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea1db765-5e59-4cf4-9c04-16542851c285-cni-binary-copy\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-etc-kubernetes\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-socket-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018726    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-etc-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-kubelet\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-registration-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-socket-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-host-run-netns\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.018728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-etc-openvswitch\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-host\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-device-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-ovn\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.019674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-env-overrides\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.020548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3626657-c93e-4b61-a652-d956795599bc-host\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.020548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3626657-c93e-4b61-a652-d956795599bc-tmp\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.020548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-device-dir\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.020548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08697cff-cf26-45c8-8ecb-22f429f3eb7b-run-ovn\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.020548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.019733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08697cff-cf26-45c8-8ecb-22f429f3eb7b-env-overrides\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.020864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.020652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3626657-c93e-4b61-a652-d956795599bc-etc-tuned\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.021403 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.021370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08697cff-cf26-45c8-8ecb-22f429f3eb7b-ovn-node-metrics-cert\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.021512 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.021484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7bf36976-dce4-4748-a01f-67b0df83fb95-agent-certs\") pod \"konnectivity-agent-tvzzl\" (UID: \"7bf36976-dce4-4748-a01f-67b0df83fb95\") " pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:24.027316 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.027239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dsh\" (UniqueName: \"kubernetes.io/projected/dcef4172-5179-448e-8f63-bcca5c29b3d2-kube-api-access-s4dsh\") pod \"iptables-alerter-l8f74\" (UID: \"dcef4172-5179-448e-8f63-bcca5c29b3d2\") " pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:24.027732 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.027674    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhv6n\" (UniqueName: \"kubernetes.io/projected/08697cff-cf26-45c8-8ecb-22f429f3eb7b-kube-api-access-qhv6n\") pod \"ovnkube-node-l8hdr\" (UID: \"08697cff-cf26-45c8-8ecb-22f429f3eb7b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.028368 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.028343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp9t7\" (UniqueName: \"kubernetes.io/projected/f3626657-c93e-4b61-a652-d956795599bc-kube-api-access-sp9t7\") pod \"tuned-9fqd8\" (UID: \"f3626657-c93e-4b61-a652-d956795599bc\") " pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.029038 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.028954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdd9m\" (UniqueName: \"kubernetes.io/projected/0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19-kube-api-access-cdd9m\") pod \"aws-ebs-csi-driver-node-rlvwm\" (UID: \"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.119731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-cni-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.119731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-socket-dir-parent\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.119731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-cni-bin\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-cni-multus\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-cni-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-socket-dir-parent\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-cni-bin\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-kubelet\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119885    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-cni-multus\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-var-lib-kubelet\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-conf-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.119935    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-host\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.119975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-os-release\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120029 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.119999    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:22:24.61997795 +0000 UTC m=+3.126869644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-os-release\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vrk\" (UniqueName: \"kubernetes.io/projected/ea1db765-5e59-4cf4-9c04-16542851c285-kube-api-access-m7vrk\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsdp\" (UniqueName: \"kubernetes.io/projected/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-kube-api-access-qdsdp\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120091    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-multus-conf-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-cni-binary-copy\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-host\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-cnibin\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzpjb\" (UniqueName: \"kubernetes.io/projected/4ab866e0-b7dc-4001-adba-ed14b7139311-kube-api-access-mzpjb\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea1db765-5e59-4cf4-9c04-16542851c285-multus-daemon-config\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea1db765-5e59-4cf4-9c04-16542851c285-cni-binary-copy\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-etc-kubernetes\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cthrh\" (UniqueName: \"kubernetes.io/projected/14837c1d-5229-403d-9250-0b77cafea91b-kube-api-access-cthrh\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-serviceca\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-cnibin\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.120695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-k8s-cni-cncf-io\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14837c1d-5229-403d-9250-0b77cafea91b-tmp-dir\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-netns\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-multus-certs\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-system-cni-dir\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-hostroot\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14837c1d-5229-403d-9250-0b77cafea91b-hosts-file\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d55gg\" (UniqueName: \"kubernetes.io/projected/9cb1528c-89d6-403f-9a88-772e472da6df-kube-api-access-d55gg\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-os-release\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-k8s-cni-cncf-io\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-system-cni-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.120994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ea1db765-5e59-4cf4-9c04-16542851c285-multus-daemon-config\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-etc-kubernetes\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-netns\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-host-run-multus-certs\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.121603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-os-release\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-serviceca\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-system-cni-dir\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121315    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-system-cni-dir\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-cnibin\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-cnibin\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-cni-binary-copy\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14837c1d-5229-403d-9250-0b77cafea91b-tmp-dir\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ea1db765-5e59-4cf4-9c04-16542851c285-hostroot\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/14837c1d-5229-403d-9250-0b77cafea91b-hosts-file\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab866e0-b7dc-4001-adba-ed14b7139311-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.122429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.121771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea1db765-5e59-4cf4-9c04-16542851c285-cni-binary-copy\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.122979 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.122473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ab866e0-b7dc-4001-adba-ed14b7139311-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.128823 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.128256    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:22:24.128823 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.128280    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:22:24.128823 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.128295    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kxmbp for pod openshift-network-diagnostics/network-check-target-295rm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:24.128823 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.128363    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp podName:a321fc27-4667-4129-8b3e-1d0104f93efa nodeName:}" failed. No retries permitted until 2026-08-05 16:22:24.628346017 +0000 UTC m=+3.135237714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kxmbp" (UniqueName: "kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp") pod "network-check-target-295rm" (UID: "a321fc27-4667-4129-8b3e-1d0104f93efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:24.130207 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.130180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cthrh\" (UniqueName: \"kubernetes.io/projected/14837c1d-5229-403d-9250-0b77cafea91b-kube-api-access-cthrh\") pod \"node-resolver-k2qmn\" (UID: \"14837c1d-5229-403d-9250-0b77cafea91b\") " pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.131333 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.131308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vrk\" (UniqueName: \"kubernetes.io/projected/ea1db765-5e59-4cf4-9c04-16542851c285-kube-api-access-m7vrk\") pod \"multus-d2s62\" (UID: \"ea1db765-5e59-4cf4-9c04-16542851c285\") " pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.132490 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.132446    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzpjb\" (UniqueName: \"kubernetes.io/projected/4ab866e0-b7dc-4001-adba-ed14b7139311-kube-api-access-mzpjb\") pod \"multus-additional-cni-plugins-zblqt\" (UID: \"4ab866e0-b7dc-4001-adba-ed14b7139311\") " pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.132787 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.132768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsdp\" (UniqueName: \"kubernetes.io/projected/f5e15f84-cc68-4adc-b8b7-67ac3d82aba3-kube-api-access-qdsdp\") pod \"node-ca-4ll2k\" (UID: \"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3\") " pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.134029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.133986    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55gg\" (UniqueName: \"kubernetes.io/projected/9cb1528c-89d6-403f-9a88-772e472da6df-kube-api-access-d55gg\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:24.195099 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.195055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm"
Aug 05 16:22:24.204904 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.204869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l8f74"
Aug 05 16:22:24.206618 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.206537    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8af7a2_ed4d_444c_bb9e_d88e74cb0c19.slice/crio-827b538b93bdc52828d06764360b8a85e9faf15a9f3792fadc47ee5bf3a38f78 WatchSource:0}: Error finding container 827b538b93bdc52828d06764360b8a85e9faf15a9f3792fadc47ee5bf3a38f78: Status 404 returned error can't find the container with id 827b538b93bdc52828d06764360b8a85e9faf15a9f3792fadc47ee5bf3a38f78
Aug 05 16:22:24.214739 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.214715    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcef4172_5179_448e_8f63_bcca5c29b3d2.slice/crio-611c13919e787ee29f9ebdeeb768a20c83dcb1be093cbe45267dde8b317b4c83 WatchSource:0}: Error finding container 611c13919e787ee29f9ebdeeb768a20c83dcb1be093cbe45267dde8b317b4c83: Status 404 returned error can't find the container with id 611c13919e787ee29f9ebdeeb768a20c83dcb1be093cbe45267dde8b317b4c83
Aug 05 16:22:24.216882 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.216858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:24.226239 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.226217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:24.226843 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.226819    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08697cff_cf26_45c8_8ecb_22f429f3eb7b.slice/crio-9c8c5021840292f0108a6050f73627b5acd5395f032f569ae4f4c0658aee8d30 WatchSource:0}: Error finding container 9c8c5021840292f0108a6050f73627b5acd5395f032f569ae4f4c0658aee8d30: Status 404 returned error can't find the container with id 9c8c5021840292f0108a6050f73627b5acd5395f032f569ae4f4c0658aee8d30
Aug 05 16:22:24.233633 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.233611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9fqd8"
Aug 05 16:22:24.236748 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.236725    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf36976_dce4_4748_a01f_67b0df83fb95.slice/crio-aafebd10b0166e284c884c5ac5bff3de0859bfb53f52ac8430c0fbd7785a5f3c WatchSource:0}: Error finding container aafebd10b0166e284c884c5ac5bff3de0859bfb53f52ac8430c0fbd7785a5f3c: Status 404 returned error can't find the container with id aafebd10b0166e284c884c5ac5bff3de0859bfb53f52ac8430c0fbd7785a5f3c
Aug 05 16:22:24.243007 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.242988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k2qmn"
Aug 05 16:22:24.243795 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.243769    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3626657_c93e_4b61_a652_d956795599bc.slice/crio-a5d845f15bffbb595b45bc191da1f29cc34f85d470ebe4c8a38cf43d83b8243b WatchSource:0}: Error finding container a5d845f15bffbb595b45bc191da1f29cc34f85d470ebe4c8a38cf43d83b8243b: Status 404 returned error can't find the container with id a5d845f15bffbb595b45bc191da1f29cc34f85d470ebe4c8a38cf43d83b8243b
Aug 05 16:22:24.251123 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.251100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ll2k"
Aug 05 16:22:24.253567 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.253547    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14837c1d_5229_403d_9250_0b77cafea91b.slice/crio-9b97490c482835d562360efcb1c42bd310406c331ba6326a2665ba147678bffa WatchSource:0}: Error finding container 9b97490c482835d562360efcb1c42bd310406c331ba6326a2665ba147678bffa: Status 404 returned error can't find the container with id 9b97490c482835d562360efcb1c42bd310406c331ba6326a2665ba147678bffa
Aug 05 16:22:24.259223 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.259206    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zblqt"
Aug 05 16:22:24.260486 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.260464    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e15f84_cc68_4adc_b8b7_67ac3d82aba3.slice/crio-5013c5c204825042557737e547aa6ef16e664dec7f8bb6be70ec7ce9b3620ee9 WatchSource:0}: Error finding container 5013c5c204825042557737e547aa6ef16e664dec7f8bb6be70ec7ce9b3620ee9: Status 404 returned error can't find the container with id 5013c5c204825042557737e547aa6ef16e664dec7f8bb6be70ec7ce9b3620ee9
Aug 05 16:22:24.265541 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.265519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2s62"
Aug 05 16:22:24.269608 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.269569    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab866e0_b7dc_4001_adba_ed14b7139311.slice/crio-3ec540cae63958ba9365f60d55b243751a8275a66451afe44339f4ddc5735509 WatchSource:0}: Error finding container 3ec540cae63958ba9365f60d55b243751a8275a66451afe44339f4ddc5735509: Status 404 returned error can't find the container with id 3ec540cae63958ba9365f60d55b243751a8275a66451afe44339f4ddc5735509
Aug 05 16:22:24.276772 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:24.276748    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1db765_5e59_4cf4_9c04_16542851c285.slice/crio-2096b5ee021efce3e1e95106455e566d8192957848230b2df15d7dafa75d66e8 WatchSource:0}: Error finding container 2096b5ee021efce3e1e95106455e566d8192957848230b2df15d7dafa75d66e8: Status 404 returned error can't find the container with id 2096b5ee021efce3e1e95106455e566d8192957848230b2df15d7dafa75d66e8
Aug 05 16:22:24.523630 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.523530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:24.523804 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.523737    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:24.523881 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.523822    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret podName:64fe61ce-f5f6-4d9a-b957-fb2591c24cac nodeName:}" failed. No retries permitted until 2026-08-05 16:22:25.5237994 +0000 UTC m=+4.030691106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret") pod "global-pull-secret-syncer-jl6qt" (UID: "64fe61ce-f5f6-4d9a-b957-fb2591c24cac") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:24.624761 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.624717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:24.624951 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.624872    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:24.625038 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.624954    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:22:25.624933037 +0000 UTC m=+4.131824732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:24.725406 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.725368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:24.725600 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.725577    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:22:24.725670 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.725611    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:22:24.725670 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.725643    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kxmbp for pod openshift-network-diagnostics/network-check-target-295rm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:24.725769 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:24.725718    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp podName:a321fc27-4667-4129-8b3e-1d0104f93efa nodeName:}" failed. No retries permitted until 2026-08-05 16:22:25.725695168 +0000 UTC m=+4.232586879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxmbp" (UniqueName: "kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp") pod "network-check-target-295rm" (UID: "a321fc27-4667-4129-8b3e-1d0104f93efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:24.944135 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.944030    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:17:24 +0000 UTC" deadline="2028-02-16 23:09:03.512519199 +0000 UTC"
Aug 05 16:22:24.944135 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.944079    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13446h46m38.568445445s"
Aug 05 16:22:24.994828 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.994688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ll2k" event={"ID":"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3","Type":"ContainerStarted","Data":"5013c5c204825042557737e547aa6ef16e664dec7f8bb6be70ec7ce9b3620ee9"}
Aug 05 16:22:24.996659 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.996626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2qmn" event={"ID":"14837c1d-5229-403d-9250-0b77cafea91b","Type":"ContainerStarted","Data":"9b97490c482835d562360efcb1c42bd310406c331ba6326a2665ba147678bffa"}
Aug 05 16:22:24.998203 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:24.998174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tvzzl" event={"ID":"7bf36976-dce4-4748-a01f-67b0df83fb95","Type":"ContainerStarted","Data":"aafebd10b0166e284c884c5ac5bff3de0859bfb53f52ac8430c0fbd7785a5f3c"}
Aug 05 16:22:25.000359 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.000268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"9c8c5021840292f0108a6050f73627b5acd5395f032f569ae4f4c0658aee8d30"}
Aug 05 16:22:25.001816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.001737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l8f74" event={"ID":"dcef4172-5179-448e-8f63-bcca5c29b3d2","Type":"ContainerStarted","Data":"611c13919e787ee29f9ebdeeb768a20c83dcb1be093cbe45267dde8b317b4c83"}
Aug 05 16:22:25.003412 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.003351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2s62" event={"ID":"ea1db765-5e59-4cf4-9c04-16542851c285","Type":"ContainerStarted","Data":"2096b5ee021efce3e1e95106455e566d8192957848230b2df15d7dafa75d66e8"}
Aug 05 16:22:25.005280 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.005253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerStarted","Data":"3ec540cae63958ba9365f60d55b243751a8275a66451afe44339f4ddc5735509"}
Aug 05 16:22:25.006997 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.006931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9fqd8" event={"ID":"f3626657-c93e-4b61-a652-d956795599bc","Type":"ContainerStarted","Data":"a5d845f15bffbb595b45bc191da1f29cc34f85d470ebe4c8a38cf43d83b8243b"}
Aug 05 16:22:25.008597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.008543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm" event={"ID":"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19","Type":"ContainerStarted","Data":"827b538b93bdc52828d06764360b8a85e9faf15a9f3792fadc47ee5bf3a38f78"}
Aug 05 16:22:25.533317 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.533277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:25.533919 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.533894    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:25.534035 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.533989    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret podName:64fe61ce-f5f6-4d9a-b957-fb2591c24cac nodeName:}" failed. No retries permitted until 2026-08-05 16:22:27.53396777 +0000 UTC m=+6.040859477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret") pod "global-pull-secret-syncer-jl6qt" (UID: "64fe61ce-f5f6-4d9a-b957-fb2591c24cac") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:25.586335 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.586248    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:22:25.634786 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.634746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:25.634976 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.634909    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:25.635048 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.634979    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:22:27.634957328 +0000 UTC m=+6.141849048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:25.735899 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.735850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:25.736123 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.736095    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:22:25.736209 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.736127    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:22:25.736209 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.736143    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kxmbp for pod openshift-network-diagnostics/network-check-target-295rm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:25.736320 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.736217    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp podName:a321fc27-4667-4129-8b3e-1d0104f93efa nodeName:}" failed. No retries permitted until 2026-08-05 16:22:27.736196479 +0000 UTC m=+6.243088183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxmbp" (UniqueName: "kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp") pod "network-check-target-295rm" (UID: "a321fc27-4667-4129-8b3e-1d0104f93efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:25.944869 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.944770    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:17:24 +0000 UTC" deadline="2028-02-03 18:22:12.330367697 +0000 UTC"
Aug 05 16:22:25.944869 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.944836    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13129h59m46.385536276s"
Aug 05 16:22:25.986149 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.984341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:25.986149 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.984495    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:25.986149 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.984948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:25.986149 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.985047    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:25.986149 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:25.985227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:25.986149 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:25.985313    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:27.020609 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.020511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"22bdd79b929aba79a130da362ca33b19","Type":"ContainerStarted","Data":"17ef0e7340c1b047e859e968f85d9c4b65b27a77bd0914fbb6ca7f8bea63659b"}
Aug 05 16:22:27.026474 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.026043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" event={"ID":"38682c8c45872d6ae76d00eb5809d129","Type":"ContainerStarted","Data":"5a54180be60b4c18e088cdedae8ce41948704547259165b0676080a9b0294413"}
Aug 05 16:22:27.052218 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.051825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-82.ec2.internal" podStartSLOduration=4.051804726 podStartE2EDuration="4.051804726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:27.051430693 +0000 UTC m=+5.558322405" watchObservedRunningTime="2026-08-05 16:22:27.051804726 +0000 UTC m=+5.558696440"
Aug 05 16:22:27.550403 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.550372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:27.550584 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.550528    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:27.550584 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.550583    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret podName:64fe61ce-f5f6-4d9a-b957-fb2591c24cac nodeName:}" failed. No retries permitted until 2026-08-05 16:22:31.550565884 +0000 UTC m=+10.057457585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret") pod "global-pull-secret-syncer-jl6qt" (UID: "64fe61ce-f5f6-4d9a-b957-fb2591c24cac") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:27.651662 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.651123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:27.651662 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.651278    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:27.651662 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.651336    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:22:31.651317677 +0000 UTC m=+10.158209371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:27.752596 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.751971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:27.752596 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.752189    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:22:27.752596 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.752210    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:22:27.752596 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.752224    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kxmbp for pod openshift-network-diagnostics/network-check-target-295rm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:27.752596 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.752276    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp podName:a321fc27-4667-4129-8b3e-1d0104f93efa nodeName:}" failed. No retries permitted until 2026-08-05 16:22:31.752258808 +0000 UTC m=+10.259150518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxmbp" (UniqueName: "kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp") pod "network-check-target-295rm" (UID: "a321fc27-4667-4129-8b3e-1d0104f93efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:27.984515 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.984390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:27.984515 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.984412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:27.984718 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.984540    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:27.984892 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:27.984832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:27.985052 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.984937    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:27.985052 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:27.985032    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:29.984276 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:29.984203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:29.984712 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:29.984343    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:29.984790 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:29.984769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:29.984903 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:29.984856    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:29.984970 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:29.984922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:29.985048 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:29.985011    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:30.041493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:30.041457    2576 generic.go:356] "Generic (PLEG): container finished" podID="22bdd79b929aba79a130da362ca33b19" containerID="17ef0e7340c1b047e859e968f85d9c4b65b27a77bd0914fbb6ca7f8bea63659b" exitCode=0
Aug 05 16:22:30.041649 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:30.041502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"22bdd79b929aba79a130da362ca33b19","Type":"ContainerDied","Data":"17ef0e7340c1b047e859e968f85d9c4b65b27a77bd0914fbb6ca7f8bea63659b"}
Aug 05 16:22:31.585354 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:31.585224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:31.585836 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.585391    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:31.585836 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.585456    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret podName:64fe61ce-f5f6-4d9a-b957-fb2591c24cac nodeName:}" failed. No retries permitted until 2026-08-05 16:22:39.585438672 +0000 UTC m=+18.092330362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret") pod "global-pull-secret-syncer-jl6qt" (UID: "64fe61ce-f5f6-4d9a-b957-fb2591c24cac") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:31.685872 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:31.685835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:31.686048 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.685959    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:31.686048 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.686033    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:22:39.686017181 +0000 UTC m=+18.192908871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:31.787034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:31.786995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:31.787224 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.787132    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:22:31.787224 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.787161    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:22:31.787224 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.787176    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kxmbp for pod openshift-network-diagnostics/network-check-target-295rm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:31.787393 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.787243    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp podName:a321fc27-4667-4129-8b3e-1d0104f93efa nodeName:}" failed. No retries permitted until 2026-08-05 16:22:39.787224662 +0000 UTC m=+18.294116353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxmbp" (UniqueName: "kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp") pod "network-check-target-295rm" (UID: "a321fc27-4667-4129-8b3e-1d0104f93efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:31.985436 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:31.985341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:31.985600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:31.985467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:31.985600 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.985474    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:31.985600 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.985543    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:31.985600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:31.985578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:31.985776 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:31.985642    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:33.985249 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:33.984734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:33.985249 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:33.984753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:33.985249 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:33.984871    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:33.985249 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:33.984940    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:33.985249 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:33.985020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:33.985249 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:33.985148    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:35.984518 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:35.984482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:35.984518 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:35.984523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:35.985048 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:35.984484    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:35.985048 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:35.984627    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:35.985048 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:35.984701    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:35.985048 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:35.984782    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:37.984638 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:37.984592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:37.984638 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:37.984592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:37.985183 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:37.984608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:37.985183 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:37.984737    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:37.985183 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:37.984847    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:37.985183 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:37.984957    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:39.646291 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:39.646250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:39.646890 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.646399    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:39.646890 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.646461    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret podName:64fe61ce-f5f6-4d9a-b957-fb2591c24cac nodeName:}" failed. No retries permitted until 2026-08-05 16:22:55.646446513 +0000 UTC m=+34.153338207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret") pod "global-pull-secret-syncer-jl6qt" (UID: "64fe61ce-f5f6-4d9a-b957-fb2591c24cac") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:39.747640 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:39.747604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:39.747820 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.747733    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:39.747820 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.747796    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:22:55.747776871 +0000 UTC m=+34.254668562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:39.848480 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:39.848437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:39.848664 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.848584    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:22:39.848664 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.848609    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:22:39.848664 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.848623    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kxmbp for pod openshift-network-diagnostics/network-check-target-295rm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:39.848809 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.848683    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp podName:a321fc27-4667-4129-8b3e-1d0104f93efa nodeName:}" failed. No retries permitted until 2026-08-05 16:22:55.848668632 +0000 UTC m=+34.355560336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxmbp" (UniqueName: "kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp") pod "network-check-target-295rm" (UID: "a321fc27-4667-4129-8b3e-1d0104f93efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:39.984501 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:39.984411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:39.984670 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:39.984411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:39.984670 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.984528    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:39.984670 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:39.984430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:39.984670 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.984595    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:39.984900 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:39.984679    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:41.985173 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:41.985137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:41.985597 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:41.985241    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:41.985597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:41.985256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:41.985597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:41.985339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:41.985597 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:41.985446    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:41.985597 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:41.985539    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:43.072701 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.072371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm" event={"ID":"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19","Type":"ContainerStarted","Data":"ca6b264c3199f1e9af2f301ed64d675d67a8f1398ab1dd4b7e53ec690aebe57f"}
Aug 05 16:22:43.074919 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.074887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ll2k" event={"ID":"f5e15f84-cc68-4adc-b8b7-67ac3d82aba3","Type":"ContainerStarted","Data":"7f90b009a56c4a34b1957f0245dc1837d2897266fddb1e536c09128d89e0d02c"}
Aug 05 16:22:43.078917 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.078891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k2qmn" event={"ID":"14837c1d-5229-403d-9250-0b77cafea91b","Type":"ContainerStarted","Data":"0891400c32b048a2e2696bc281dfc4b48b515d308c1e63156b4c73c143106b57"}
Aug 05 16:22:43.080407 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.080387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tvzzl" event={"ID":"7bf36976-dce4-4748-a01f-67b0df83fb95","Type":"ContainerStarted","Data":"3f17f80c65534aa869d76d725aab1889c3fc8d57917ff63cb2d7de027ca1d39f"}
Aug 05 16:22:43.082275 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.082254    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"94f8a30e0404eb490a0c8ef1d4f827a90241c0358d2a634c37acf257df47760b"}
Aug 05 16:22:43.086022 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.085215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" event={"ID":"22bdd79b929aba79a130da362ca33b19","Type":"ContainerStarted","Data":"8a814c05b44ed59d17a0fcdad423b1747e6883bc2018b7ca49ab32ecf4ea7c4b"}
Aug 05 16:22:43.087891 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.087868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerStarted","Data":"33b45ca00c60907a1b22ef8efb784250ecf350d2d19e443336cbf0c1bc8b3528"}
Aug 05 16:22:43.089414 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.089367    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4ll2k" podStartSLOduration=2.540998879 podStartE2EDuration="21.089350766s" totalImagesPullingTime="18.548351887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:43.088921957 +0000 UTC m=+21.595813670" watchObservedRunningTime="2026-08-05 16:22:43.089350766 +0000 UTC m=+21.596242480"
Aug 05 16:22:43.090180 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.089930    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9fqd8" event={"ID":"f3626657-c93e-4b61-a652-d956795599bc","Type":"ContainerStarted","Data":"19920e3d77d5de8770f276cbb2acb566a6b47b0adf4c9b2e45834b48075ad138"}
Aug 05 16:22:43.103391 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.103321    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tvzzl" podStartSLOduration=2.532545485 podStartE2EDuration="21.103308771s" totalImagesPullingTime="18.570763286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:43.103158513 +0000 UTC m=+21.610050228" watchObservedRunningTime="2026-08-05 16:22:43.103308771 +0000 UTC m=+21.610200483"
Aug 05 16:22:43.117589 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.116606    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k2qmn" podStartSLOduration=2.783761643 podStartE2EDuration="21.116587356s" totalImagesPullingTime="18.332825713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:43.116262536 +0000 UTC m=+21.623154245" watchObservedRunningTime="2026-08-05 16:22:43.116587356 +0000 UTC m=+21.623479069"
Aug 05 16:22:43.172003 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.171798    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-82.ec2.internal" podStartSLOduration=20.171782262 podStartE2EDuration="20.171782262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:43.156154378 +0000 UTC m=+21.663046091" watchObservedRunningTime="2026-08-05 16:22:43.171782262 +0000 UTC m=+21.678673973"
Aug 05 16:22:43.984090 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.984056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:43.984281 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.984056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:43.984281 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:43.984180    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:43.984281 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:43.984056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:43.984281 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:43.984263    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:43.984454 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:43.984315    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:44.093001 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.092959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2s62" event={"ID":"ea1db765-5e59-4cf4-9c04-16542851c285","Type":"ContainerStarted","Data":"b9286c66258284dca08d05cdaeed7b71d92b1cec6f6c915b2b1ba3bf3f4c1087"}
Aug 05 16:22:44.094368 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.094342    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ab866e0-b7dc-4001-adba-ed14b7139311" containerID="33b45ca00c60907a1b22ef8efb784250ecf350d2d19e443336cbf0c1bc8b3528" exitCode=0
Aug 05 16:22:44.094454 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.094420    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerDied","Data":"33b45ca00c60907a1b22ef8efb784250ecf350d2d19e443336cbf0c1bc8b3528"}
Aug 05 16:22:44.102041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.102017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"a20d3ab6a27f22242212e6484bae6809c19fb88cc3b06f54bdef94b32758687b"}
Aug 05 16:22:44.102137 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.102120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"8ac57d53168ae02901f3a140ece208ea6c7eb6bccd9f12175e6f1380f8fbf8d8"}
Aug 05 16:22:44.102185 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.102171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"ca5cb3eecd08d33efe099dce0f9dfb7d9b5fac6d69bc471439a5afd214711e26"}
Aug 05 16:22:44.102230 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.102217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"a9177587da710de0128cee3cd221d736e0b57d480877c9460c775c5766b13478"}
Aug 05 16:22:44.102276 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.102265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"6bd0d7fbed5935656fc566a3e817845e8a8fd6a46acd05ddf95bd1388657a052"}
Aug 05 16:22:44.113160 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.113120    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9fqd8" podStartSLOduration=3.535272423 podStartE2EDuration="22.11310832s" totalImagesPullingTime="18.577835897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:43.171733618 +0000 UTC m=+21.678625330" watchObservedRunningTime="2026-08-05 16:22:44.11310832 +0000 UTC m=+22.620000032"
Aug 05 16:22:44.113431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.113403    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d2s62" podStartSLOduration=3.304105247 podStartE2EDuration="22.113393311s" totalImagesPullingTime="18.809288064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:44.112929644 +0000 UTC m=+22.619821356" watchObservedRunningTime="2026-08-05 16:22:44.113393311 +0000 UTC m=+22.620285023"
Aug 05 16:22:44.575259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.575237    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 16:22:44.627018 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.626971    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:44.627510 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.627495    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:44.962672 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.962551    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T16:22:44.575255819Z","UUID":"e93fe332-fa5d-4a57-b8b2-68e071fda8f9","Handler":null,"Name":"","Endpoint":""}
Aug 05 16:22:44.963997 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.963966    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 16:22:44.964110 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:44.964012    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 16:22:45.106052 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.106014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm" event={"ID":"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19","Type":"ContainerStarted","Data":"74d785fe598ddca33d703bf82b51911e2347699fc4c30ee22df572780c9d307e"}
Aug 05 16:22:45.107643 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.107589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l8f74" event={"ID":"dcef4172-5179-448e-8f63-bcca5c29b3d2","Type":"ContainerStarted","Data":"7144da6048eb819cb8f2bed5029837e2e42f93e727040e24b4d48a362477a31e"}
Aug 05 16:22:45.107945 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.107924    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:45.108447 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.108431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tvzzl"
Aug 05 16:22:45.122541 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.122499    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l8f74" podStartSLOduration=4.649344146 podStartE2EDuration="23.122485638s" totalImagesPullingTime="18.473141492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:45.122420453 +0000 UTC m=+23.629312172" watchObservedRunningTime="2026-08-05 16:22:45.122485638 +0000 UTC m=+23.629377350"
Aug 05 16:22:45.984081 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.984061    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:45.984229 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.984062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:45.984229 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:45.984193    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:45.984229 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:45.984214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:45.984382 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:45.984297    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:45.984382 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:45.984356    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:46.112051 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:46.111789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm" event={"ID":"0a8af7a2-ed4d-444c-bb9e-d88e74cb0c19","Type":"ContainerStarted","Data":"c1e34a193c1d5db8b49ceaef4c412f59491139eab1e4d5bef96e146831e2cd39"}
Aug 05 16:22:46.115605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:46.115564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"b26bc76aae1975a2a124ea0a45e266812a53187d51d3295033c12bbc831ebc9d"}
Aug 05 16:22:46.133444 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:46.133403    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlvwm" podStartSLOduration=2.986994373 podStartE2EDuration="24.133388486s" totalImagesPullingTime="21.146394113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:46.133263358 +0000 UTC m=+24.640155082" watchObservedRunningTime="2026-08-05 16:22:46.133388486 +0000 UTC m=+24.640280198"
Aug 05 16:22:47.984142 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:47.984069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:47.984142 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:47.984115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:47.984774 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:47.984069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:47.984774 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:47.984202    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:47.984774 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:47.984284    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:47.984774 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:47.984350    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:49.984772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:49.984586    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:49.985386 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:49.984586    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:49.985386 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:49.984599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:49.985386 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:49.985014    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:49.985386 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:49.984842    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:49.985386 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:49.985121    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:50.130810 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.130780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" event={"ID":"08697cff-cf26-45c8-8ecb-22f429f3eb7b","Type":"ContainerStarted","Data":"355e04a56608b61ff8d2260de9fc354c093116d405c204d975e9b906b285e7ed"}
Aug 05 16:22:50.131036 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.131018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:50.131202 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.131175    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:50.131269 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.131246    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:50.132772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.132745    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ab866e0-b7dc-4001-adba-ed14b7139311" containerID="67aaff7dafdd92ce49d7bc362d26b922269367c3435f6b59ba7453c84242841c" exitCode=0
Aug 05 16:22:50.132868 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.132789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerDied","Data":"67aaff7dafdd92ce49d7bc362d26b922269367c3435f6b59ba7453c84242841c"}
Aug 05 16:22:50.146794 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.146768    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:50.146901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.146857    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:22:50.156329 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:50.156292    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr" podStartSLOduration=9.517704448 podStartE2EDuration="28.156281224s" totalImagesPullingTime="18.638576776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:50.15610732 +0000 UTC m=+28.662999032" watchObservedRunningTime="2026-08-05 16:22:50.156281224 +0000 UTC m=+28.663172936"
Aug 05 16:22:51.121470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:51.121437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-295rm"]
Aug 05 16:22:51.121942 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:51.121550    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:51.121942 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:51.121660    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:51.127718 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:51.127693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jl6qt"]
Aug 05 16:22:51.127824 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:51.127786    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:51.127909 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:51.127890    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:51.128441 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:51.128414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-79f65"]
Aug 05 16:22:51.128546 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:51.128505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:51.128603 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:51.128583    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:52.138549 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:52.138469    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ab866e0-b7dc-4001-adba-ed14b7139311" containerID="30eecd74beb229f30c24f0b1c832d1279939ba1f077bd2a895cef079eafd4560" exitCode=0
Aug 05 16:22:52.138870 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:52.138561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerDied","Data":"30eecd74beb229f30c24f0b1c832d1279939ba1f077bd2a895cef079eafd4560"}
Aug 05 16:22:52.984045 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:52.983862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:52.984229 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:52.983862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:52.984229 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:52.984134    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:52.984229 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:52.983862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:52.984229 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:52.984197    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:52.984365 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:52.984262    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:54.145796 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:54.145757    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ab866e0-b7dc-4001-adba-ed14b7139311" containerID="b88748acea60e7f6a6362e878cabf65b87d733eae2559cc51a8a050ffdb9ad45" exitCode=0
Aug 05 16:22:54.146326 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:54.145810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerDied","Data":"b88748acea60e7f6a6362e878cabf65b87d733eae2559cc51a8a050ffdb9ad45"}
Aug 05 16:22:54.984030 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:54.984000    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:54.984216 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:54.984086    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:54.984216 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:54.984191    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl6qt" podUID="64fe61ce-f5f6-4d9a-b957-fb2591c24cac"
Aug 05 16:22:54.984216 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:54.984090    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-295rm" podUID="a321fc27-4667-4129-8b3e-1d0104f93efa"
Aug 05 16:22:54.984380 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:54.984214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:54.984380 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:54.984312    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79f65" podUID="9cb1528c-89d6-403f-9a88-772e472da6df"
Aug 05 16:22:55.668737 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.668696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:55.669196 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.668841    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:55.669196 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.668907    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret podName:64fe61ce-f5f6-4d9a-b957-fb2591c24cac nodeName:}" failed. No retries permitted until 2026-08-05 16:23:27.66888944 +0000 UTC m=+66.175781151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret") pod "global-pull-secret-syncer-jl6qt" (UID: "64fe61ce-f5f6-4d9a-b957-fb2591c24cac") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:22:55.769654 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.769582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:55.769785 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.769693    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:55.769785 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.769750    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:23:27.769733389 +0000 UTC m=+66.276625097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:22:55.785933 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.785910    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-82.ec2.internal" event="NodeReady"
Aug 05 16:22:55.786155 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.786140    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 16:22:55.819211 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.819180    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68b8c56f4f-nfr4f"]
Aug 05 16:22:55.823281 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.823258    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.826613 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.826588    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 16:22:55.826728 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.826644    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kcq9m\""
Aug 05 16:22:55.826806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.826781    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 16:22:55.827163 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.827141    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 16:22:55.832866 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.832693    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dklqq"]
Aug 05 16:22:55.832973 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.832863    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 16:22:55.836789 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.836767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b8c56f4f-nfr4f"]
Aug 05 16:22:55.836894 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.836809    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dvc7r"]
Aug 05 16:22:55.837013 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.836995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:55.840535 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.839802    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 16:22:55.840535 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.839849    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 16:22:55.840535 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.840140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w85qf\""
Aug 05 16:22:55.843063 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.843037    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:55.845166 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.845145    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 16:22:55.845265 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.845206    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-chrqx\""
Aug 05 16:22:55.845324 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.845287    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 16:22:55.845374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.845344    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 16:22:55.849815 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.849787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dklqq"]
Aug 05 16:22:55.850480 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.850458    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dvc7r"]
Aug 05 16:22:55.870657 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.870630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:55.870774 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.870748    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:22:55.870774 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.870766    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:22:55.870886 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.870778    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kxmbp for pod openshift-network-diagnostics/network-check-target-295rm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:55.870886 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:55.870836    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp podName:a321fc27-4667-4129-8b3e-1d0104f93efa nodeName:}" failed. No retries permitted until 2026-08-05 16:23:27.870821415 +0000 UTC m=+66.377713109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxmbp" (UniqueName: "kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp") pod "network-check-target-295rm" (UID: "a321fc27-4667-4129-8b3e-1d0104f93efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:22:55.971518 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-image-registry-private-configuration\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.971518 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.971743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:55.971743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-tmp-dir\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:55.971743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-trusted-ca\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.971743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gltl\" (UniqueName: \"kubernetes.io/projected/9aa21ce2-397f-46ee-a08f-074c0f91fc93-kube-api-access-8gltl\") pod \"ingress-canary-dvc7r\" (UID: \"9aa21ce2-397f-46ee-a08f-074c0f91fc93\") " pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:55.971743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-certificates\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.971743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86m6d\" (UniqueName: \"kubernetes.io/projected/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-kube-api-access-86m6d\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:55.972043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-config-volume\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:55.972043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9aa21ce2-397f-46ee-a08f-074c0f91fc93-cert\") pod \"ingress-canary-dvc7r\" (UID: \"9aa21ce2-397f-46ee-a08f-074c0f91fc93\") " pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:55.972043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-installation-pull-secrets\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.972043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dd88\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-kube-api-access-6dd88\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.972043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5fa2a6e-9383-4303-89b8-ac9da5572194-ca-trust-extracted\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:55.972043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:55.971904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-bound-sa-token\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.073222 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-image-registry-private-configuration\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.073222 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.073222 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-tmp-dir\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-trusted-ca\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gltl\" (UniqueName: \"kubernetes.io/projected/9aa21ce2-397f-46ee-a08f-074c0f91fc93-kube-api-access-8gltl\") pod \"ingress-canary-dvc7r\" (UID: \"9aa21ce2-397f-46ee-a08f-074c0f91fc93\") " pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.073310    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.073330    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b8c56f4f-nfr4f: secret "image-registry-tls" not found
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.073341    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.073390    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls podName:a5fa2a6e-9383-4303-89b8-ac9da5572194 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:56.573369149 +0000 UTC m=+35.080260852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls") pod "image-registry-68b8c56f4f-nfr4f" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194") : secret "image-registry-tls" not found
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.073408    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls podName:d6835bd1-ecd0-4a31-90f6-edccc631c8d6 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:56.573400472 +0000 UTC m=+35.080292163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls") pod "dns-default-dklqq" (UID: "d6835bd1-ecd0-4a31-90f6-edccc631c8d6") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-certificates\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86m6d\" (UniqueName: \"kubernetes.io/projected/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-kube-api-access-86m6d\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.073500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-config-volume\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.074069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9aa21ce2-397f-46ee-a08f-074c0f91fc93-cert\") pod \"ingress-canary-dvc7r\" (UID: \"9aa21ce2-397f-46ee-a08f-074c0f91fc93\") " pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:56.074069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-installation-pull-secrets\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.074069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dd88\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-kube-api-access-6dd88\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.074069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5fa2a6e-9383-4303-89b8-ac9da5572194-ca-trust-extracted\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.074069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-bound-sa-token\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.074069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.073925    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-certificates\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.074354 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.074095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-tmp-dir\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.074404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.074386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-trusted-ca\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.074404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.074389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5fa2a6e-9383-4303-89b8-ac9da5572194-ca-trust-extracted\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.074781 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.074760    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-config-volume\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.077901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.077881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-installation-pull-secrets\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.077973 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.077933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-image-registry-private-configuration\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.078039 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.077938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9aa21ce2-397f-46ee-a08f-074c0f91fc93-cert\") pod \"ingress-canary-dvc7r\" (UID: \"9aa21ce2-397f-46ee-a08f-074c0f91fc93\") " pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:56.082852 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.082796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dd88\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-kube-api-access-6dd88\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.082852 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.082804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-bound-sa-token\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.083014 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.082914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gltl\" (UniqueName: \"kubernetes.io/projected/9aa21ce2-397f-46ee-a08f-074c0f91fc93-kube-api-access-8gltl\") pod \"ingress-canary-dvc7r\" (UID: \"9aa21ce2-397f-46ee-a08f-074c0f91fc93\") " pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:56.083188 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.083169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86m6d\" (UniqueName: \"kubernetes.io/projected/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-kube-api-access-86m6d\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.156759 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.156728    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dvc7r"
Aug 05 16:22:56.299414 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.299205    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dvc7r"]
Aug 05 16:22:56.305140 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:22:56.305094    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa21ce2_397f_46ee_a08f_074c0f91fc93.slice/crio-403acbe8c751ee8e796b02f75226003e1212e171275f7c1ec1928a54b6695db0 WatchSource:0}: Error finding container 403acbe8c751ee8e796b02f75226003e1212e171275f7c1ec1928a54b6695db0: Status 404 returned error can't find the container with id 403acbe8c751ee8e796b02f75226003e1212e171275f7c1ec1928a54b6695db0
Aug 05 16:22:56.578646 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.578616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:56.578827 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.578653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:56.578827 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.578756    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:56.578827 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.578772    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b8c56f4f-nfr4f: secret "image-registry-tls" not found
Aug 05 16:22:56.578827 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.578797    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:56.578827 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.578827    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls podName:a5fa2a6e-9383-4303-89b8-ac9da5572194 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:57.578810335 +0000 UTC m=+36.085702028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls") pod "image-registry-68b8c56f4f-nfr4f" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194") : secret "image-registry-tls" not found
Aug 05 16:22:56.579031 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:56.578847    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls podName:d6835bd1-ecd0-4a31-90f6-edccc631c8d6 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:57.578832211 +0000 UTC m=+36.085723918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls") pod "dns-default-dklqq" (UID: "d6835bd1-ecd0-4a31-90f6-edccc631c8d6") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:56.984209 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.984172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:22:56.984921 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.984214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:22:56.984921 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.984214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:22:56.986767 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.986745    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:22:56.987370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.987351    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:22:56.987463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.987383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:22:56.987463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.987396    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:22:56.987463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.987419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zm8j\""
Aug 05 16:22:56.987611 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:56.987351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t7dww\""
Aug 05 16:22:57.153507 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:57.153464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dvc7r" event={"ID":"9aa21ce2-397f-46ee-a08f-074c0f91fc93","Type":"ContainerStarted","Data":"403acbe8c751ee8e796b02f75226003e1212e171275f7c1ec1928a54b6695db0"}
Aug 05 16:22:57.587902 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:57.587863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:57.588118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:57.587914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:57.588118 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:57.588049    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:57.588118 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:57.588054    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:57.588118 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:57.588078    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b8c56f4f-nfr4f: secret "image-registry-tls" not found
Aug 05 16:22:57.588118 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:57.588121    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls podName:d6835bd1-ecd0-4a31-90f6-edccc631c8d6 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:59.58810132 +0000 UTC m=+38.094993024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls") pod "dns-default-dklqq" (UID: "d6835bd1-ecd0-4a31-90f6-edccc631c8d6") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:57.588371 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:57.588140    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls podName:a5fa2a6e-9383-4303-89b8-ac9da5572194 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:59.588130985 +0000 UTC m=+38.095022681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls") pod "image-registry-68b8c56f4f-nfr4f" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194") : secret "image-registry-tls" not found
Aug 05 16:22:58.108322 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:58.108265    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:58.210412 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:58.210307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:58.288231 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:58.288180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:58.354108 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:58.354066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:58.409314 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:58.409272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:59.086539 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:59.086503    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:59.141945 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:59.141911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:59.487602 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:59.487566    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:59.589210 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:59.589180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:22:59.601789 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:59.601587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:22:59.601789 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:22:59.601640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:22:59.601789 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:59.601792    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:59.601997 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:59.601863    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls podName:d6835bd1-ecd0-4a31-90f6-edccc631c8d6 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:03.601841771 +0000 UTC m=+42.108733525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls") pod "dns-default-dklqq" (UID: "d6835bd1-ecd0-4a31-90f6-edccc631c8d6") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:59.601997 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:59.601894    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:59.601997 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:59.601913    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b8c56f4f-nfr4f: secret "image-registry-tls" not found
Aug 05 16:22:59.601997 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:22:59.601972    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls podName:a5fa2a6e-9383-4303-89b8-ac9da5572194 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:03.601952868 +0000 UTC m=+42.108844578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls") pod "image-registry-68b8c56f4f-nfr4f" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194") : secret "image-registry-tls" not found
Aug 05 16:23:00.162633 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:00.162601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dvc7r" event={"ID":"9aa21ce2-397f-46ee-a08f-074c0f91fc93","Type":"ContainerStarted","Data":"46b1d0b6d721acead2f9d5ea71224a2d6465ac39fe8ce1e529de4cd0126ee1ee"}
Aug 05 16:23:00.165534 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:00.165511    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ab866e0-b7dc-4001-adba-ed14b7139311" containerID="76dbf291481959d7a56f37e948d08aa96e0da1711137f822628555c29a1be8a4" exitCode=0
Aug 05 16:23:00.165651 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:00.165557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerDied","Data":"76dbf291481959d7a56f37e948d08aa96e0da1711137f822628555c29a1be8a4"}
Aug 05 16:23:00.176725 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:00.176685    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dvc7r" podStartSLOduration=1.987431313 podStartE2EDuration="5.176666921s" totalImagesPullingTime="3.189235608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:00.176453775 +0000 UTC m=+38.683345510" watchObservedRunningTime="2026-08-05 16:23:00.176666921 +0000 UTC m=+38.683558634"
Aug 05 16:23:00.427971 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:00.427760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:00.528835 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:00.528800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:01.170997 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:01.170955    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ab866e0-b7dc-4001-adba-ed14b7139311" containerID="f3cd4e79e2271c3167db383958c861280096738410f047878e8fae885017a107" exitCode=0
Aug 05 16:23:01.171384 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:01.171039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerDied","Data":"f3cd4e79e2271c3167db383958c861280096738410f047878e8fae885017a107"}
Aug 05 16:23:02.176838 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:02.176801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zblqt" event={"ID":"4ab866e0-b7dc-4001-adba-ed14b7139311","Type":"ContainerStarted","Data":"dab58279876b3deea4381fc051b9bf4643d25b5637828e8ea87dc02e9fd09a67"}
Aug 05 16:23:02.203912 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:02.203857    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zblqt" podStartSLOduration=8.502542334 podStartE2EDuration="40.203839507s" totalImagesPullingTime="31.701297173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:02.202499882 +0000 UTC m=+40.709391594" watchObservedRunningTime="2026-08-05 16:23:02.203839507 +0000 UTC m=+40.710731222"
Aug 05 16:23:02.322823 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:02.322788    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:02.373181 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:02.373146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:03.188594 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:03.188556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:03.289214 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:03.289176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:03.630544 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:03.630512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:23:03.630695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:03.630556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:23:03.630695 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:03.630670    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:23:03.630761 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:03.630674    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:23:03.630761 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:03.630723    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b8c56f4f-nfr4f: secret "image-registry-tls" not found
Aug 05 16:23:03.630761 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:03.630729    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls podName:d6835bd1-ecd0-4a31-90f6-edccc631c8d6 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:11.630711182 +0000 UTC m=+50.137602894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls") pod "dns-default-dklqq" (UID: "d6835bd1-ecd0-4a31-90f6-edccc631c8d6") : secret "dns-default-metrics-tls" not found
Aug 05 16:23:03.630761 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:03.630758    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls podName:a5fa2a6e-9383-4303-89b8-ac9da5572194 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:11.630747375 +0000 UTC m=+50.137639085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls") pod "image-registry-68b8c56f4f-nfr4f" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194") : secret "image-registry-tls" not found
Aug 05 16:23:10.312526 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:10.312490    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:10.412806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:10.412769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:10.472890 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:10.472857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log" limit=1024
Aug 05 16:23:11.687690 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:11.687652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:23:11.687690 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:11.687689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:23:11.688194 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:11.687814    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:23:11.688194 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:11.687831    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:23:11.688194 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:11.687859    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b8c56f4f-nfr4f: secret "image-registry-tls" not found
Aug 05 16:23:11.688194 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:11.687876    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls podName:d6835bd1-ecd0-4a31-90f6-edccc631c8d6 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:27.68786268 +0000 UTC m=+66.194754376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls") pod "dns-default-dklqq" (UID: "d6835bd1-ecd0-4a31-90f6-edccc631c8d6") : secret "dns-default-metrics-tls" not found
Aug 05 16:23:11.688194 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:11.687962    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls podName:a5fa2a6e-9383-4303-89b8-ac9da5572194 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:27.687940914 +0000 UTC m=+66.194832623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls") pod "image-registry-68b8c56f4f-nfr4f" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194") : secret "image-registry-tls" not found
Aug 05 16:23:22.149253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.149228    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8hdr"
Aug 05 16:23:22.745157 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.745122    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"]
Aug 05 16:23:22.747605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.747589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"
Aug 05 16:23:22.749777 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.749750    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"]
Aug 05 16:23:22.749915 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.749894    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.750073 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.750005    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.750073 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.750007    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tw628\""
Aug 05 16:23:22.751586 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.751572    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"]
Aug 05 16:23:22.751704 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.751688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.753359 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.753339    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-4psc6"]
Aug 05 16:23:22.753568 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.753545    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.753686 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.753621    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 05 16:23:22.754196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.754175    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 05 16:23:22.754316 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.754178    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.754316 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.754181    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.754316 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.754226    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4wmf8\""
Aug 05 16:23:22.755551 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.755113    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"]
Aug 05 16:23:22.755551 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.755255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.755953 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.755937    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.756670 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.756651    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.756779 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.756701    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 05 16:23:22.757022 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.756997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:22.758505 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.758476    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.758601 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.758557    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 05 16:23:22.758860 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.758844    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 05 16:23:22.758906 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.758891    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mmbl2\""
Aug 05 16:23:22.758964 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.758849    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.759034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.758966    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 05 16:23:22.759034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.759023    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dsts5\""
Aug 05 16:23:22.759352 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.759336    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.759430 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.759365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6p4h9\""
Aug 05 16:23:22.759430 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.759425    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.760937 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.760919    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 05 16:23:22.763339 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.763319    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"]
Aug 05 16:23:22.763686 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.763667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 05 16:23:22.769883 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.769608    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"]
Aug 05 16:23:22.770208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.770188    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-4psc6"]
Aug 05 16:23:22.780732 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.780710    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"]
Aug 05 16:23:22.790723 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.790701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"]
Aug 05 16:23:22.841265 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.841230    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"]
Aug 05 16:23:22.843146 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.843130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"
Aug 05 16:23:22.847872 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.847850    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ftk26\""
Aug 05 16:23:22.855904 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.855879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2sz2\" (UniqueName: \"kubernetes.io/projected/e4ae8600-3cda-4813-bc41-1168155bdf49-kube-api-access-r2sz2\") pod \"network-check-source-65bdbbff45-t78sc\" (UID: \"e4ae8600-3cda-4813-bc41-1168155bdf49\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"
Aug 05 16:23:22.856029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.855908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60998130-d018-493b-8caa-71e8a0dee61e-serving-cert\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.856029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.855931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.856029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.855974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60998130-d018-493b-8caa-71e8a0dee61e-config\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.856029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:22.856196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/712969e1-98cd-43d9-a3ec-8d1ca050574d-serving-cert\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.856196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4rsd\" (UniqueName: \"kubernetes.io/projected/60998130-d018-493b-8caa-71e8a0dee61e-kube-api-access-t4rsd\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.856196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60998130-d018-493b-8caa-71e8a0dee61e-trusted-ca\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.856196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ptvf\" (UniqueName: \"kubernetes.io/projected/d781f794-dbf8-496c-8884-d59e320178e5-kube-api-access-5ptvf\") pod \"volume-data-source-validator-5b8776669-rzq6x\" (UID: \"d781f794-dbf8-496c-8884-d59e320178e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"
Aug 05 16:23:22.856196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.856196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/712969e1-98cd-43d9-a3ec-8d1ca050574d-config\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.856392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdtv\" (UniqueName: \"kubernetes.io/projected/f921cbc8-defa-42e4-bb68-56028f0ab68e-kube-api-access-vbdtv\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:22.856392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7r9q\" (UniqueName: \"kubernetes.io/projected/712969e1-98cd-43d9-a3ec-8d1ca050574d-kube-api-access-p7r9q\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.856392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.856244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7sqs\" (UniqueName: \"kubernetes.io/projected/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-kube-api-access-h7sqs\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.858257 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.858233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"]
Aug 05 16:23:22.867704 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.867679    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"]
Aug 05 16:23:22.869576 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.869552    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-kn6sw"]
Aug 05 16:23:22.869674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.869663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:22.871407 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.871389    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b94f5687b-gj2pp"]
Aug 05 16:23:22.871535 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.871518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:22.872170 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.872151    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.872705 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.872686    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 05 16:23:22.872804 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.872719    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 05 16:23:22.872804 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.872763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.872911 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.872828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8gw9q\""
Aug 05 16:23:22.873216 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.873186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:22.873828 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.873808    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.873930 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.873833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.873930 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.873870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 05 16:23:22.874547 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.874532    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 05 16:23:22.876195 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876177    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6jg9j\""
Aug 05 16:23:22.876320 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876301    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Aug 05 16:23:22.876387 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876335    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Aug 05 16:23:22.876443 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876423    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.876503 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876485    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Aug 05 16:23:22.876555 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876492    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Aug 05 16:23:22.876867 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876845    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.876973 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.876907    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j2nhs\""
Aug 05 16:23:22.882175 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.882152    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 05 16:23:22.882737 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.882660    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-kn6sw"]
Aug 05 16:23:22.883866 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.883844    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"]
Aug 05 16:23:22.899964 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.899937    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b94f5687b-gj2pp"]
Aug 05 16:23:22.956625 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.956593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdtv\" (UniqueName: \"kubernetes.io/projected/f921cbc8-defa-42e4-bb68-56028f0ab68e-kube-api-access-vbdtv\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:22.956625 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.956628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-tmp\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:22.956825 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.956649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-default-certificate\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:22.956825 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.956669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7r9q\" (UniqueName: \"kubernetes.io/projected/712969e1-98cd-43d9-a3ec-8d1ca050574d-kube-api-access-p7r9q\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.956825 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.956685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7sqs\" (UniqueName: \"kubernetes.io/projected/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-kube-api-access-h7sqs\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.957008 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.956928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2sz2\" (UniqueName: \"kubernetes.io/projected/e4ae8600-3cda-4813-bc41-1168155bdf49-kube-api-access-r2sz2\") pod \"network-check-source-65bdbbff45-t78sc\" (UID: \"e4ae8600-3cda-4813-bc41-1168155bdf49\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"
Aug 05 16:23:22.957008 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.956995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60998130-d018-493b-8caa-71e8a0dee61e-serving-cert\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.957123 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.957123 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:22.957123 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60998130-d018-493b-8caa-71e8a0dee61e-config\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.957253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-trusted-ca-bundle\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:22.957253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:22.957253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:22.957374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/712969e1-98cd-43d9-a3ec-8d1ca050574d-serving-cert\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.957374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4rsd\" (UniqueName: \"kubernetes.io/projected/60998130-d018-493b-8caa-71e8a0dee61e-kube-api-access-t4rsd\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.957374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:22.957521 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:22.957375    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 16:23:22.957521 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:22.957447    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls podName:f921cbc8-defa-42e4-bb68-56028f0ab68e nodeName:}" failed. No retries permitted until 2026-08-05 16:23:23.457426793 +0000 UTC m=+61.964318501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fpltg" (UID: "f921cbc8-defa-42e4-bb68-56028f0ab68e") : secret "samples-operator-tls" not found
Aug 05 16:23:22.957521 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60998130-d018-493b-8caa-71e8a0dee61e-trusted-ca\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.957521 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-snapshots\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:22.957720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-service-ca-bundle\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:22.957720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-stats-auth\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:22.957720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrxtb\" (UniqueName: \"kubernetes.io/projected/608fee0d-7fa3-4397-88fe-c7d67b280042-kube-api-access-nrxtb\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:22.957720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ptvf\" (UniqueName: \"kubernetes.io/projected/d781f794-dbf8-496c-8884-d59e320178e5-kube-api-access-5ptvf\") pod \"volume-data-source-validator-5b8776669-rzq6x\" (UID: \"d781f794-dbf8-496c-8884-d59e320178e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"
Aug 05 16:23:22.957905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cznzg\" (UniqueName: \"kubernetes.io/projected/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-kube-api-access-cznzg\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:22.957905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/608fee0d-7fa3-4397-88fe-c7d67b280042-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:22.957905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xw92\" (UniqueName: \"kubernetes.io/projected/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-kube-api-access-6xw92\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:22.957905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/60998130-d018-493b-8caa-71e8a0dee61e-config\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.957905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.957905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/712969e1-98cd-43d9-a3ec-8d1ca050574d-config\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.957905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.957872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-serving-cert\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:22.958405 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.958385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/712969e1-98cd-43d9-a3ec-8d1ca050574d-config\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.958547 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.958527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60998130-d018-493b-8caa-71e8a0dee61e-trusted-ca\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.959029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.959009    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.960846 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.960826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.960935 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.960842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60998130-d018-493b-8caa-71e8a0dee61e-serving-cert\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.960935 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.960844    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/712969e1-98cd-43d9-a3ec-8d1ca050574d-serving-cert\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.965871 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.965679    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:23:22.966468 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.966413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7sqs\" (UniqueName: \"kubernetes.io/projected/f9f3aacc-e968-4225-9bbd-8c78937ae8d5-kube-api-access-h7sqs\") pod \"kube-storage-version-migrator-operator-7878f4b88c-7cxzq\" (UID: \"f9f3aacc-e968-4225-9bbd-8c78937ae8d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:22.966886 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.966866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdtv\" (UniqueName: \"kubernetes.io/projected/f921cbc8-defa-42e4-bb68-56028f0ab68e-kube-api-access-vbdtv\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:22.967197 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.967168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4rsd\" (UniqueName: \"kubernetes.io/projected/60998130-d018-493b-8caa-71e8a0dee61e-kube-api-access-t4rsd\") pod \"console-operator-5ccd6b445f-4psc6\" (UID: \"60998130-d018-493b-8caa-71e8a0dee61e\") " pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:22.967306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.967223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7r9q\" (UniqueName: \"kubernetes.io/projected/712969e1-98cd-43d9-a3ec-8d1ca050574d-kube-api-access-p7r9q\") pod \"service-ca-operator-784f97bcf6-gqlpb\" (UID: \"712969e1-98cd-43d9-a3ec-8d1ca050574d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:22.968321 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.968293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ptvf\" (UniqueName: \"kubernetes.io/projected/d781f794-dbf8-496c-8884-d59e320178e5-kube-api-access-5ptvf\") pod \"volume-data-source-validator-5b8776669-rzq6x\" (UID: \"d781f794-dbf8-496c-8884-d59e320178e5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"
Aug 05 16:23:22.976141 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.976119    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:23:22.986975 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:22.986955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2sz2\" (UniqueName: \"kubernetes.io/projected/e4ae8600-3cda-4813-bc41-1168155bdf49-kube-api-access-r2sz2\") pod \"network-check-source-65bdbbff45-t78sc\" (UID: \"e4ae8600-3cda-4813-bc41-1168155bdf49\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"
Aug 05 16:23:23.059069 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.058972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"
Aug 05 16:23:23.059221 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-snapshots\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.059221 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-service-ca-bundle\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.059221 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-stats-auth\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.059221 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxtb\" (UniqueName: \"kubernetes.io/projected/608fee0d-7fa3-4397-88fe-c7d67b280042-kube-api-access-nrxtb\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:23.059221 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cznzg\" (UniqueName: \"kubernetes.io/projected/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-kube-api-access-cznzg\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.059451 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/608fee0d-7fa3-4397-88fe-c7d67b280042-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:23.059451 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xw92\" (UniqueName: \"kubernetes.io/projected/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-kube-api-access-6xw92\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.059451 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-serving-cert\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.059663 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-tmp\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.059663 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-default-certificate\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.059756 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.059798 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-trusted-ca-bundle\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.059848 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.059901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:23.059901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-snapshots\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.060018 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.059955    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:23.060018 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.059964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-tmp\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.060122 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.060030    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:23.560009073 +0000 UTC m=+62.066900778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : configmap references non-existent config key: service-ca.crt
Aug 05 16:23:23.060122 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.060084    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:23:23.060291 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.060132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/608fee0d-7fa3-4397-88fe-c7d67b280042-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:23.060291 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.060083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-service-ca-bundle\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.060291 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.060140    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:23.560124198 +0000 UTC m=+62.067015906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : secret "router-metrics-certs-default" not found
Aug 05 16:23:23.060291 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.060181    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls podName:608fee0d-7fa3-4397-88fe-c7d67b280042 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:23.560169132 +0000 UTC m=+62.067060839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-w6dkv" (UID: "608fee0d-7fa3-4397-88fe-c7d67b280042") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:23.060787 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.060771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-trusted-ca-bundle\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.062463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.062445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-default-certificate\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.062553 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.062533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-serving-cert\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.062603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.062589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-stats-auth\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.065238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.065219    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"
Aug 05 16:23:23.067143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.067114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xw92\" (UniqueName: \"kubernetes.io/projected/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-kube-api-access-6xw92\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.067226 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.067211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cznzg\" (UniqueName: \"kubernetes.io/projected/9dc97b96-a1b3-4d7c-9b86-643f7541c35d-kube-api-access-cznzg\") pod \"insights-operator-77696685b-kn6sw\" (UID: \"9dc97b96-a1b3-4d7c-9b86-643f7541c35d\") " pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.067619 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.067568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrxtb\" (UniqueName: \"kubernetes.io/projected/608fee0d-7fa3-4397-88fe-c7d67b280042-kube-api-access-nrxtb\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:23.073392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.073358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"
Aug 05 16:23:23.081659 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.081481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:23.154166 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.154125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"
Aug 05 16:23:23.186779 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.186696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-kn6sw"
Aug 05 16:23:23.221059 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.220968    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq"]
Aug 05 16:23:23.229596 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:23.229527    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f3aacc_e968_4225_9bbd_8c78937ae8d5.slice/crio-f1bcacfe5337e6d18e42f75ab246c5b68739c6349edd100f60e6199eaaae6cd1 WatchSource:0}: Error finding container f1bcacfe5337e6d18e42f75ab246c5b68739c6349edd100f60e6199eaaae6cd1: Status 404 returned error can't find the container with id f1bcacfe5337e6d18e42f75ab246c5b68739c6349edd100f60e6199eaaae6cd1
Aug 05 16:23:23.311143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.311119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc"]
Aug 05 16:23:23.313371 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:23.313349    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ae8600_3cda_4813_bc41_1168155bdf49.slice/crio-c90a3d567a484e27266376b8bf3a1037da31284b85f82d695a75d7b889af0ea9 WatchSource:0}: Error finding container c90a3d567a484e27266376b8bf3a1037da31284b85f82d695a75d7b889af0ea9: Status 404 returned error can't find the container with id c90a3d567a484e27266376b8bf3a1037da31284b85f82d695a75d7b889af0ea9
Aug 05 16:23:23.326910 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.326886    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-kn6sw"]
Aug 05 16:23:23.329711 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:23.329686    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc97b96_a1b3_4d7c_9b86_643f7541c35d.slice/crio-b9a04a2af3dd24f2cce4b08d8953065a3c199ca7f98beb0c72082b2b1b09337a WatchSource:0}: Error finding container b9a04a2af3dd24f2cce4b08d8953065a3c199ca7f98beb0c72082b2b1b09337a: Status 404 returned error can't find the container with id b9a04a2af3dd24f2cce4b08d8953065a3c199ca7f98beb0c72082b2b1b09337a
Aug 05 16:23:23.439758 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.439723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb"]
Aug 05 16:23:23.443861 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:23.443829    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712969e1_98cd_43d9_a3ec_8d1ca050574d.slice/crio-de0acd46d87a293664999546000114674043e75ac0d176c3f533157761105280 WatchSource:0}: Error finding container de0acd46d87a293664999546000114674043e75ac0d176c3f533157761105280: Status 404 returned error can't find the container with id de0acd46d87a293664999546000114674043e75ac0d176c3f533157761105280
Aug 05 16:23:23.443970 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.443862    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-4psc6"]
Aug 05 16:23:23.444878 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.444853    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x"]
Aug 05 16:23:23.446260 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:23.446239    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd781f794_dbf8_496c_8884_d59e320178e5.slice/crio-a556c6a1802b7ad39bb69f6cff7cd3a41fb71512809ed345d4fc1abe907dff4e WatchSource:0}: Error finding container a556c6a1802b7ad39bb69f6cff7cd3a41fb71512809ed345d4fc1abe907dff4e: Status 404 returned error can't find the container with id a556c6a1802b7ad39bb69f6cff7cd3a41fb71512809ed345d4fc1abe907dff4e
Aug 05 16:23:23.447133 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:23.447110    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60998130_d018_493b_8caa_71e8a0dee61e.slice/crio-b8cef429d997e983b881ada838885e0897760c2f82d5c5978c52cac8b3409ec4 WatchSource:0}: Error finding container b8cef429d997e983b881ada838885e0897760c2f82d5c5978c52cac8b3409ec4: Status 404 returned error can't find the container with id b8cef429d997e983b881ada838885e0897760c2f82d5c5978c52cac8b3409ec4
Aug 05 16:23:23.463153 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.463126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:23.463290 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.463250    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 16:23:23.463331 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.463300    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls podName:f921cbc8-defa-42e4-bb68-56028f0ab68e nodeName:}" failed. No retries permitted until 2026-08-05 16:23:24.463287301 +0000 UTC m=+62.970178992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fpltg" (UID: "f921cbc8-defa-42e4-bb68-56028f0ab68e") : secret "samples-operator-tls" not found
Aug 05 16:23:23.563808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.563720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.563808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.563759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:23.563808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:23.563801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:23.564051 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.563885    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:24.563866333 +0000 UTC m=+63.070758026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : configmap references non-existent config key: service-ca.crt
Aug 05 16:23:23.564051 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.563934    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:23.564051 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.563934    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:23:23.564051 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.563993    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls podName:608fee0d-7fa3-4397-88fe-c7d67b280042 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:24.563966898 +0000 UTC m=+63.070858589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-w6dkv" (UID: "608fee0d-7fa3-4397-88fe-c7d67b280042") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:23.564196 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:23.564054    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:24.564040418 +0000 UTC m=+63.070932112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : secret "router-metrics-certs-default" not found
Aug 05 16:23:24.231867 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.231783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kn6sw" event={"ID":"9dc97b96-a1b3-4d7c-9b86-643f7541c35d","Type":"ContainerStarted","Data":"b9a04a2af3dd24f2cce4b08d8953065a3c199ca7f98beb0c72082b2b1b09337a"}
Aug 05 16:23:24.235021 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.234885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc" event={"ID":"e4ae8600-3cda-4813-bc41-1168155bdf49","Type":"ContainerStarted","Data":"c90a3d567a484e27266376b8bf3a1037da31284b85f82d695a75d7b889af0ea9"}
Aug 05 16:23:24.237548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.237498    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq" event={"ID":"f9f3aacc-e968-4225-9bbd-8c78937ae8d5","Type":"ContainerStarted","Data":"f1bcacfe5337e6d18e42f75ab246c5b68739c6349edd100f60e6199eaaae6cd1"}
Aug 05 16:23:24.239341 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.239270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x" event={"ID":"d781f794-dbf8-496c-8884-d59e320178e5","Type":"ContainerStarted","Data":"a556c6a1802b7ad39bb69f6cff7cd3a41fb71512809ed345d4fc1abe907dff4e"}
Aug 05 16:23:24.240898 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.240834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" event={"ID":"60998130-d018-493b-8caa-71e8a0dee61e","Type":"ContainerStarted","Data":"b8cef429d997e983b881ada838885e0897760c2f82d5c5978c52cac8b3409ec4"}
Aug 05 16:23:24.243585 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.243520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb" event={"ID":"712969e1-98cd-43d9-a3ec-8d1ca050574d","Type":"ContainerStarted","Data":"de0acd46d87a293664999546000114674043e75ac0d176c3f533157761105280"}
Aug 05 16:23:24.472260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.471526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:24.472260 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:24.471783    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 16:23:24.472260 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:24.471869    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls podName:f921cbc8-defa-42e4-bb68-56028f0ab68e nodeName:}" failed. No retries permitted until 2026-08-05 16:23:26.471849591 +0000 UTC m=+64.978741288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fpltg" (UID: "f921cbc8-defa-42e4-bb68-56028f0ab68e") : secret "samples-operator-tls" not found
Aug 05 16:23:24.572902 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.572726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:24.572902 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.572776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:24.573139 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:24.572944    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:26.572919273 +0000 UTC m=+65.079810983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : configmap references non-existent config key: service-ca.crt
Aug 05 16:23:24.573139 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:24.573038    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:23:24.573139 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:24.573086    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:26.573072528 +0000 UTC m=+65.079964238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : secret "router-metrics-certs-default" not found
Aug 05 16:23:24.573139 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:24.573132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:24.573365 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:24.573236    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:24.573365 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:24.573274    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls podName:608fee0d-7fa3-4397-88fe-c7d67b280042 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:26.57326134 +0000 UTC m=+65.080153035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-w6dkv" (UID: "608fee0d-7fa3-4397-88fe-c7d67b280042") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:26.496382 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:26.496346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:26.496947 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:26.496489    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 16:23:26.496947 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:26.496543    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls podName:f921cbc8-defa-42e4-bb68-56028f0ab68e nodeName:}" failed. No retries permitted until 2026-08-05 16:23:30.496530357 +0000 UTC m=+69.003422053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fpltg" (UID: "f921cbc8-defa-42e4-bb68-56028f0ab68e") : secret "samples-operator-tls" not found
Aug 05 16:23:26.597778 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:26.597746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:26.597778 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:26.597786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:26.598030 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:26.597851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:26.598030 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:26.597948    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:30.597921267 +0000 UTC m=+69.104812959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : configmap references non-existent config key: service-ca.crt
Aug 05 16:23:26.598030 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:26.598000    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:26.598030 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:26.598010    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:23:26.598235 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:26.598066    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls podName:608fee0d-7fa3-4397-88fe-c7d67b280042 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:30.598044733 +0000 UTC m=+69.104936424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-w6dkv" (UID: "608fee0d-7fa3-4397-88fe-c7d67b280042") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:26.598235 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:26.598083    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:30.598076253 +0000 UTC m=+69.104967943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : secret "router-metrics-certs-default" not found
Aug 05 16:23:27.708119 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.708084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:23:27.708591 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.708156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:23:27.708591 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.708217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:23:27.708591 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:27.708259    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:23:27.708591 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:27.708266    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:23:27.708591 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:27.708290    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b8c56f4f-nfr4f: secret "image-registry-tls" not found
Aug 05 16:23:27.708591 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:27.708330    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls podName:d6835bd1-ecd0-4a31-90f6-edccc631c8d6 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:59.708313708 +0000 UTC m=+98.215205399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls") pod "dns-default-dklqq" (UID: "d6835bd1-ecd0-4a31-90f6-edccc631c8d6") : secret "dns-default-metrics-tls" not found
Aug 05 16:23:27.708591 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:27.708345    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls podName:a5fa2a6e-9383-4303-89b8-ac9da5572194 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:59.708339291 +0000 UTC m=+98.215230981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls") pod "image-registry-68b8c56f4f-nfr4f" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194") : secret "image-registry-tls" not found
Aug 05 16:23:27.710992 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.710961    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:23:27.720698 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.720675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64fe61ce-f5f6-4d9a-b957-fb2591c24cac-original-pull-secret\") pod \"global-pull-secret-syncer-jl6qt\" (UID: \"64fe61ce-f5f6-4d9a-b957-fb2591c24cac\") " pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:23:27.809306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.809267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:23:27.811342 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.811311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:23:27.819612 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:27.819589    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 05 16:23:27.819734 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:27.819663    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs podName:9cb1528c-89d6-403f-9a88-772e472da6df nodeName:}" failed. No retries permitted until 2026-08-05 16:24:31.819642249 +0000 UTC m=+130.326533950 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs") pod "network-metrics-daemon-79f65" (UID: "9cb1528c-89d6-403f-9a88-772e472da6df") : secret "metrics-daemon-secret" not found
Aug 05 16:23:27.897443 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.897402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl6qt"
Aug 05 16:23:27.910575 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.910551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:23:27.913073 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:27.913053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxmbp\" (UniqueName: \"kubernetes.io/projected/a321fc27-4667-4129-8b3e-1d0104f93efa-kube-api-access-kxmbp\") pod \"network-check-target-295rm\" (UID: \"a321fc27-4667-4129-8b3e-1d0104f93efa\") " pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:23:28.212414 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:28.212388    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t7dww\""
Aug 05 16:23:28.221325 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:28.221124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:23:28.349218 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:28.349103    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jl6qt"]
Aug 05 16:23:28.352219 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:28.352158    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fe61ce_f5f6_4d9a_b957_fb2591c24cac.slice/crio-e8dc96c70bbec0c062971f39525203d7729bac9dd748c4efe78973088ee7cb34 WatchSource:0}: Error finding container e8dc96c70bbec0c062971f39525203d7729bac9dd748c4efe78973088ee7cb34: Status 404 returned error can't find the container with id e8dc96c70bbec0c062971f39525203d7729bac9dd748c4efe78973088ee7cb34
Aug 05 16:23:28.435905 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:28.435777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-295rm"]
Aug 05 16:23:28.451192 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:28.451159    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda321fc27_4667_4129_8b3e_1d0104f93efa.slice/crio-e1afc796f4a46e862f3a53f4223490b07fe2c35cd66631bbeaa8fd602a5f3234 WatchSource:0}: Error finding container e1afc796f4a46e862f3a53f4223490b07fe2c35cd66631bbeaa8fd602a5f3234: Status 404 returned error can't find the container with id e1afc796f4a46e862f3a53f4223490b07fe2c35cd66631bbeaa8fd602a5f3234
Aug 05 16:23:29.140775 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.140268    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zm2dr"]
Aug 05 16:23:29.143770 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.143749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.147108 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.146898    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 16:23:29.149695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.149674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-422vm\""
Aug 05 16:23:29.149911 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.149891    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 16:23:29.174693 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.174670    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zm2dr"]
Aug 05 16:23:29.223944 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.223912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2522728c-8d34-4b05-9070-5dc1021bb091-data-volume\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.223944 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.223951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2522728c-8d34-4b05-9070-5dc1021bb091-crio-socket\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.224177 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.223975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsq59\" (UniqueName: \"kubernetes.io/projected/2522728c-8d34-4b05-9070-5dc1021bb091-kube-api-access-tsq59\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.224177 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.224126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.224177 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.224156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.264224 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.264185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc" event={"ID":"e4ae8600-3cda-4813-bc41-1168155bdf49","Type":"ContainerStarted","Data":"7bc53ee4cafbde8b651f48d8687a2e40e94dcc6e876bc254f7c0775e631b4bdc"}
Aug 05 16:23:29.269603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.266552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq" event={"ID":"f9f3aacc-e968-4225-9bbd-8c78937ae8d5","Type":"ContainerStarted","Data":"a6588854065c4666b4ba4e9b187582d5fe07f17d9e7877183f79281233c82f77"}
Aug 05 16:23:29.271997 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.271958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x" event={"ID":"d781f794-dbf8-496c-8884-d59e320178e5","Type":"ContainerStarted","Data":"a296ffa3cc459f6acbae0fff62098072e8e496b651b10935f02a8cbd7d1a5304"}
Aug 05 16:23:29.275350 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.274931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-295rm" event={"ID":"a321fc27-4667-4129-8b3e-1d0104f93efa","Type":"ContainerStarted","Data":"b24b747d7d6f1a0999bc1feb27aeb5299814324088baaa62e5079e6b2ac30a93"}
Aug 05 16:23:29.275350 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.274999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-295rm" event={"ID":"a321fc27-4667-4129-8b3e-1d0104f93efa","Type":"ContainerStarted","Data":"e1afc796f4a46e862f3a53f4223490b07fe2c35cd66631bbeaa8fd602a5f3234"}
Aug 05 16:23:29.275350 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.275030    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:23:29.277537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.277519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/0.log"
Aug 05 16:23:29.277642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.277558    2576 generic.go:356] "Generic (PLEG): container finished" podID="60998130-d018-493b-8caa-71e8a0dee61e" containerID="c177cb10290a5e19bfac52a3f84526a26a06cb5df9e774c6a98c9760409df374" exitCode=255
Aug 05 16:23:29.277642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.277624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" event={"ID":"60998130-d018-493b-8caa-71e8a0dee61e","Type":"ContainerDied","Data":"c177cb10290a5e19bfac52a3f84526a26a06cb5df9e774c6a98c9760409df374"}
Aug 05 16:23:29.277856 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.277821    2576 scope.go:117] "RemoveContainer" containerID="c177cb10290a5e19bfac52a3f84526a26a06cb5df9e774c6a98c9760409df374"
Aug 05 16:23:29.284027 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.283968    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-t78sc" podStartSLOduration=2.353696192 podStartE2EDuration="7.283956286s" totalImagesPullingTime="4.930260094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:29.283303884 +0000 UTC m=+67.790195596" watchObservedRunningTime="2026-08-05 16:23:29.283956286 +0000 UTC m=+67.790848035"
Aug 05 16:23:29.285401 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.285375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jl6qt" event={"ID":"64fe61ce-f5f6-4d9a-b957-fb2591c24cac","Type":"ContainerStarted","Data":"e8dc96c70bbec0c062971f39525203d7729bac9dd748c4efe78973088ee7cb34"}
Aug 05 16:23:29.288440 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.288399    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb" event={"ID":"712969e1-98cd-43d9-a3ec-8d1ca050574d","Type":"ContainerStarted","Data":"fd9941299a123b3a9e9cc867a37a50c29560f617225556737aec6227da9ed2bc"}
Aug 05 16:23:29.290592 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.290567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kn6sw" event={"ID":"9dc97b96-a1b3-4d7c-9b86-643f7541c35d","Type":"ContainerStarted","Data":"e3e938c604affa98eacbe51db1da0aa6dc3648aa6b5655b96cb1e4f15282d690"}
Aug 05 16:23:29.303752 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.300621    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-295rm" podStartSLOduration=67.300606986 podStartE2EDuration="1m7.300606986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:29.299783752 +0000 UTC m=+67.806675464" watchObservedRunningTime="2026-08-05 16:23:29.300606986 +0000 UTC m=+67.807498700"
Aug 05 16:23:29.317614 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.317443    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rzq6x" podStartSLOduration=2.578306546 podStartE2EDuration="7.317428119s" totalImagesPullingTime="4.739121573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:29.315609698 +0000 UTC m=+67.822501409" watchObservedRunningTime="2026-08-05 16:23:29.317428119 +0000 UTC m=+67.824319834"
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.325370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2522728c-8d34-4b05-9070-5dc1021bb091-data-volume\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.325473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2522728c-8d34-4b05-9070-5dc1021bb091-crio-socket\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.325540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsq59\" (UniqueName: \"kubernetes.io/projected/2522728c-8d34-4b05-9070-5dc1021bb091-kube-api-access-tsq59\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.325709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2522728c-8d34-4b05-9070-5dc1021bb091-data-volume\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.325776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.325816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.327007    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:29.327228 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.327064    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:29.82704636 +0000 UTC m=+68.333938063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:29.327722 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.327288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2522728c-8d34-4b05-9070-5dc1021bb091-crio-socket\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.328073 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.327868    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:23:29.328073 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.327918    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:29.82790207 +0000 UTC m=+68.334793781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : configmap "kube-rbac-proxy" not found
Aug 05 16:23:29.338310 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.338291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsq59\" (UniqueName: \"kubernetes.io/projected/2522728c-8d34-4b05-9070-5dc1021bb091-kube-api-access-tsq59\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.354772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.354729    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq" podStartSLOduration=2.399201109 podStartE2EDuration="7.354711903s" totalImagesPullingTime="4.955510794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:29.354166127 +0000 UTC m=+67.861057840" watchObservedRunningTime="2026-08-05 16:23:29.354711903 +0000 UTC m=+67.861603615"
Aug 05 16:23:29.404383 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.403905    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb" podStartSLOduration=2.65723176 podStartE2EDuration="7.403877553s" totalImagesPullingTime="4.746645793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:29.370529067 +0000 UTC m=+67.877420780" watchObservedRunningTime="2026-08-05 16:23:29.403877553 +0000 UTC m=+67.910769266"
Aug 05 16:23:29.404383 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.404126    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-kn6sw" podStartSLOduration=2.548152743 podStartE2EDuration="7.404107052s" totalImagesPullingTime="4.855954309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:29.395137002 +0000 UTC m=+67.902028715" watchObservedRunningTime="2026-08-05 16:23:29.404107052 +0000 UTC m=+67.910998767"
Aug 05 16:23:29.833938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.833627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.833938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:29.833683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:29.833938 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.833800    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:23:29.833938 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.833815    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:29.833938 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.833866    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:30.833847553 +0000 UTC m=+69.340739249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : configmap "kube-rbac-proxy" not found
Aug 05 16:23:29.833938 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:29.833885    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:30.833875167 +0000 UTC m=+69.340766863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:30.295502 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.295475    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/1.log"
Aug 05 16:23:30.295927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.295892    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/0.log"
Aug 05 16:23:30.296004 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.295932    2576 generic.go:356] "Generic (PLEG): container finished" podID="60998130-d018-493b-8caa-71e8a0dee61e" containerID="85b7f1061ad9959c3f3615ba9d300574bd575f138d38134c50b7c6ef3fde64c0" exitCode=255
Aug 05 16:23:30.296077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.296032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" event={"ID":"60998130-d018-493b-8caa-71e8a0dee61e","Type":"ContainerDied","Data":"85b7f1061ad9959c3f3615ba9d300574bd575f138d38134c50b7c6ef3fde64c0"}
Aug 05 16:23:30.296133 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.296094    2576 scope.go:117] "RemoveContainer" containerID="c177cb10290a5e19bfac52a3f84526a26a06cb5df9e774c6a98c9760409df374"
Aug 05 16:23:30.296247 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.296228    2576 scope.go:117] "RemoveContainer" containerID="85b7f1061ad9959c3f3615ba9d300574bd575f138d38134c50b7c6ef3fde64c0"
Aug 05 16:23:30.296433 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.296408    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-4psc6_openshift-console-operator(60998130-d018-493b-8caa-71e8a0dee61e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" podUID="60998130-d018-493b-8caa-71e8a0dee61e"
Aug 05 16:23:30.541380 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.541337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:30.541558 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.541509    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 16:23:30.541634 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.541590    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls podName:f921cbc8-defa-42e4-bb68-56028f0ab68e nodeName:}" failed. No retries permitted until 2026-08-05 16:23:38.541567319 +0000 UTC m=+77.048459029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-fpltg" (UID: "f921cbc8-defa-42e4-bb68-56028f0ab68e") : secret "samples-operator-tls" not found
Aug 05 16:23:30.642657 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.642609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:30.642858 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.642669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:30.642858 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.642793    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:23:30.643079 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.642863    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:38.642843913 +0000 UTC m=+77.149735611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : secret "router-metrics-certs-default" not found
Aug 05 16:23:30.643079 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.642905    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:38.642876769 +0000 UTC m=+77.149768476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : configmap references non-existent config key: service-ca.crt
Aug 05 16:23:30.643079 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.642967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:30.643299 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.643085    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:30.643299 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.643165    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls podName:608fee0d-7fa3-4397-88fe-c7d67b280042 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:38.643147362 +0000 UTC m=+77.150039069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-w6dkv" (UID: "608fee0d-7fa3-4397-88fe-c7d67b280042") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:30.708706 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.708678    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2qmn_14837c1d-5229-403d-9250-0b77cafea91b/dns-node-resolver/0.log"
Aug 05 16:23:30.845289 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.845254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:30.845289 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:30.845292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:30.845575 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.845400    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:23:30.845575 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.845419    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:30.845575 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.845471    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:32.845452029 +0000 UTC m=+71.352343721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : configmap "kube-rbac-proxy" not found
Aug 05 16:23:30.845575 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:30.845490    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:32.845480087 +0000 UTC m=+71.352371783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:31.302231 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:31.302203    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/1.log"
Aug 05 16:23:31.302679 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:31.302569    2576 scope.go:117] "RemoveContainer" containerID="85b7f1061ad9959c3f3615ba9d300574bd575f138d38134c50b7c6ef3fde64c0"
Aug 05 16:23:31.302751 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:31.302727    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-4psc6_openshift-console-operator(60998130-d018-493b-8caa-71e8a0dee61e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" podUID="60998130-d018-493b-8caa-71e8a0dee61e"
Aug 05 16:23:31.508184 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:31.508156    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ll2k_f5e15f84-cc68-4adc-b8b7-67ac3d82aba3/node-ca/0.log"
Aug 05 16:23:32.308067 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:32.308029    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dvc7r_9aa21ce2-397f-46ee-a08f-074c0f91fc93/serve-healthcheck-canary/0.log"
Aug 05 16:23:32.866275 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:32.866229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:32.866471 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:32.866283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:32.866471 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:32.866420    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:23:32.866572 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:32.866486    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:36.866470159 +0000 UTC m=+75.373361850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : configmap "kube-rbac-proxy" not found
Aug 05 16:23:32.866572 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:32.866425    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:32.866572 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:32.866518    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:36.866512462 +0000 UTC m=+75.373404151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:33.082772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:33.082680    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:33.082772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:33.082762    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:33.083140 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:33.083127    2576 scope.go:117] "RemoveContainer" containerID="85b7f1061ad9959c3f3615ba9d300574bd575f138d38134c50b7c6ef3fde64c0"
Aug 05 16:23:33.083285 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:33.083268    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-4psc6_openshift-console-operator(60998130-d018-493b-8caa-71e8a0dee61e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" podUID="60998130-d018-493b-8caa-71e8a0dee61e"
Aug 05 16:23:33.309949 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:33.309908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jl6qt" event={"ID":"64fe61ce-f5f6-4d9a-b957-fb2591c24cac","Type":"ContainerStarted","Data":"c7bd07965813cba41004b40ad4c0e85a6af081012d90bbf103eb0e3341117a9d"}
Aug 05 16:23:33.327907 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:33.327857    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jl6qt" podStartSLOduration=66.96450014 podStartE2EDuration="1m11.327841992s" totalImagesPullingTime="4.363341852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:33.327314998 +0000 UTC m=+71.834206710" watchObservedRunningTime="2026-08-05 16:23:33.327841992 +0000 UTC m=+71.834733704"
Aug 05 16:23:36.901477 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:36.901433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:36.901477 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:36.901476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:36.901898 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:36.901564    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:23:36.901898 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:36.901593    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:36.901898 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:36.901617    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:44.901602487 +0000 UTC m=+83.408494195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : configmap "kube-rbac-proxy" not found
Aug 05 16:23:36.901898 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:36.901678    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:44.901658535 +0000 UTC m=+83.408550240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:38.617794 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:38.617747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:38.620203 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:38.620175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f921cbc8-defa-42e4-bb68-56028f0ab68e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-fpltg\" (UID: \"f921cbc8-defa-42e4-bb68-56028f0ab68e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:38.685919 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:38.685894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"
Aug 05 16:23:38.718623 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:38.718589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:38.718778 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:38.718641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:38.718778 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:38.718683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:38.718778 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:38.718748    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:54.718729863 +0000 UTC m=+93.225621552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : configmap references non-existent config key: service-ca.crt
Aug 05 16:23:38.718934 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:38.718813    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:38.718934 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:38.718815    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Aug 05 16:23:38.718934 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:38.718863    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls podName:608fee0d-7fa3-4397-88fe-c7d67b280042 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:54.718848001 +0000 UTC m=+93.225739694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-w6dkv" (UID: "608fee0d-7fa3-4397-88fe-c7d67b280042") : secret "cluster-monitoring-operator-tls" not found
Aug 05 16:23:38.718934 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:38.718882    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs podName:3858c9d9-3eb0-4d72-81dc-22c6923d59c9 nodeName:}" failed. No retries permitted until 2026-08-05 16:23:54.718871016 +0000 UTC m=+93.225762712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs") pod "router-default-5b94f5687b-gj2pp" (UID: "3858c9d9-3eb0-4d72-81dc-22c6923d59c9") : secret "router-metrics-certs-default" not found
Aug 05 16:23:38.806000 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:38.805827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg"]
Aug 05 16:23:39.329645 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:39.329607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg" event={"ID":"f921cbc8-defa-42e4-bb68-56028f0ab68e","Type":"ContainerStarted","Data":"573fd85296cc31cdc85c671323de9d7496ce3fbfd7006291dc29bd31aaf67d04"}
Aug 05 16:23:41.338280 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:41.338243    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg" event={"ID":"f921cbc8-defa-42e4-bb68-56028f0ab68e","Type":"ContainerStarted","Data":"ebdeb7d6b0de2a719e91f1f14f578a651df5c1fe9a2d54a207e2ca69afa5955f"}
Aug 05 16:23:41.338745 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:41.338298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg" event={"ID":"f921cbc8-defa-42e4-bb68-56028f0ab68e","Type":"ContainerStarted","Data":"1347c6339f3321cf0dea785a4b67bb5fda0f18526e87dd5ee500ed9b77a66a6a"}
Aug 05 16:23:41.356343 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:41.356299    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-fpltg" podStartSLOduration=17.695777221 podStartE2EDuration="19.356284289s" totalImagesPullingTime="1.660507068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:41.355465223 +0000 UTC m=+79.862356935" watchObservedRunningTime="2026-08-05 16:23:41.356284289 +0000 UTC m=+79.863176000"
Aug 05 16:23:44.975086 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:44.974928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:44.975086 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:44.975078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:44.975086 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:44.975083    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:44.975562 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:44.975158    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls podName:2522728c-8d34-4b05-9070-5dc1021bb091 nodeName:}" failed. No retries permitted until 2026-08-05 16:24:00.975139147 +0000 UTC m=+99.482030836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zm2dr" (UID: "2522728c-8d34-4b05-9070-5dc1021bb091") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:23:44.975607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:44.975562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2522728c-8d34-4b05-9070-5dc1021bb091-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:23:45.984244 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:45.984216    2576 scope.go:117] "RemoveContainer" containerID="85b7f1061ad9959c3f3615ba9d300574bd575f138d38134c50b7c6ef3fde64c0"
Aug 05 16:23:46.355249 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:46.355181    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:23:46.355585 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:46.355569    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/1.log"
Aug 05 16:23:46.355641 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:46.355603    2576 generic.go:356] "Generic (PLEG): container finished" podID="60998130-d018-493b-8caa-71e8a0dee61e" containerID="6db660702832d2bffc9f769df8a203ea1b0395bdd261351d310377e5304cdecf" exitCode=255
Aug 05 16:23:46.355683 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:46.355647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" event={"ID":"60998130-d018-493b-8caa-71e8a0dee61e","Type":"ContainerDied","Data":"6db660702832d2bffc9f769df8a203ea1b0395bdd261351d310377e5304cdecf"}
Aug 05 16:23:46.355738 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:46.355693    2576 scope.go:117] "RemoveContainer" containerID="85b7f1061ad9959c3f3615ba9d300574bd575f138d38134c50b7c6ef3fde64c0"
Aug 05 16:23:46.356063 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:46.356043    2576 scope.go:117] "RemoveContainer" containerID="6db660702832d2bffc9f769df8a203ea1b0395bdd261351d310377e5304cdecf"
Aug 05 16:23:46.356267 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:46.356243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-4psc6_openshift-console-operator(60998130-d018-493b-8caa-71e8a0dee61e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" podUID="60998130-d018-493b-8caa-71e8a0dee61e"
Aug 05 16:23:47.360315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:47.360289    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:23:53.082475 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:53.082436    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:53.083040 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:53.082497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:23:53.083040 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:53.082922    2576 scope.go:117] "RemoveContainer" containerID="6db660702832d2bffc9f769df8a203ea1b0395bdd261351d310377e5304cdecf"
Aug 05 16:23:53.083195 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:23:53.083168    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-4psc6_openshift-console-operator(60998130-d018-493b-8caa-71e8a0dee61e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" podUID="60998130-d018-493b-8caa-71e8a0dee61e"
Aug 05 16:23:54.760435 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.760384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:54.760435 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.760437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:54.760851 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.760463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:54.761133 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.761110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-service-ca-bundle\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:54.762767 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.762737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3858c9d9-3eb0-4d72-81dc-22c6923d59c9-metrics-certs\") pod \"router-default-5b94f5687b-gj2pp\" (UID: \"3858c9d9-3eb0-4d72-81dc-22c6923d59c9\") " pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:54.762866 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.762768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/608fee0d-7fa3-4397-88fe-c7d67b280042-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-w6dkv\" (UID: \"608fee0d-7fa3-4397-88fe-c7d67b280042\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:54.980635 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.980601    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"
Aug 05 16:23:54.992853 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:54.992820    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:55.125312 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.125283    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv"]
Aug 05 16:23:55.127259 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:55.127230    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608fee0d_7fa3_4397_88fe_c7d67b280042.slice/crio-00ac95d31975de577fd054bdf2e625d7fc7acf29d716a089d47a678e996bc6b0 WatchSource:0}: Error finding container 00ac95d31975de577fd054bdf2e625d7fc7acf29d716a089d47a678e996bc6b0: Status 404 returned error can't find the container with id 00ac95d31975de577fd054bdf2e625d7fc7acf29d716a089d47a678e996bc6b0
Aug 05 16:23:55.145931 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.145906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b94f5687b-gj2pp"]
Aug 05 16:23:55.147834 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:23:55.147806    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3858c9d9_3eb0_4d72_81dc_22c6923d59c9.slice/crio-5ff5199cad6b67755bdab2a24fc93e83a378c2d17636c8d01cfdd9d74daa86c2 WatchSource:0}: Error finding container 5ff5199cad6b67755bdab2a24fc93e83a378c2d17636c8d01cfdd9d74daa86c2: Status 404 returned error can't find the container with id 5ff5199cad6b67755bdab2a24fc93e83a378c2d17636c8d01cfdd9d74daa86c2
Aug 05 16:23:55.386150 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.386115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b94f5687b-gj2pp" event={"ID":"3858c9d9-3eb0-4d72-81dc-22c6923d59c9","Type":"ContainerStarted","Data":"b1a5be2447fb4ffd5e2068b24e5a523b1f35929ea92884f5d17286691713d236"}
Aug 05 16:23:55.386318 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.386176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b94f5687b-gj2pp" event={"ID":"3858c9d9-3eb0-4d72-81dc-22c6923d59c9","Type":"ContainerStarted","Data":"5ff5199cad6b67755bdab2a24fc93e83a378c2d17636c8d01cfdd9d74daa86c2"}
Aug 05 16:23:55.387293 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.387264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv" event={"ID":"608fee0d-7fa3-4397-88fe-c7d67b280042","Type":"ContainerStarted","Data":"00ac95d31975de577fd054bdf2e625d7fc7acf29d716a089d47a678e996bc6b0"}
Aug 05 16:23:55.404267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.404228    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b94f5687b-gj2pp" podStartSLOduration=33.404215144 podStartE2EDuration="33.404215144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:55.402769775 +0000 UTC m=+93.909661487" watchObservedRunningTime="2026-08-05 16:23:55.404215144 +0000 UTC m=+93.911106834"
Aug 05 16:23:55.993242 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.993212    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:55.996833 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:55.996807    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:56.391443 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:56.391411    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:56.392863 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:56.392836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b94f5687b-gj2pp"
Aug 05 16:23:57.396011 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:57.395906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv" event={"ID":"608fee0d-7fa3-4397-88fe-c7d67b280042","Type":"ContainerStarted","Data":"7a742f9c5eefee11e8010cf460b781586d9418220ee2e14dcea3aca3ef4b6758"}
Aug 05 16:23:57.413290 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:57.413238    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-w6dkv" podStartSLOduration=33.400071975 podStartE2EDuration="35.413220364s" totalImagesPullingTime="2.013148389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:23:57.412386752 +0000 UTC m=+95.919278476" watchObservedRunningTime="2026-08-05 16:23:57.413220364 +0000 UTC m=+95.920112076"
Aug 05 16:23:59.803294 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:59.803247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:23:59.803743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:59.803343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:23:59.805578 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:59.805554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6835bd1-ecd0-4a31-90f6-edccc631c8d6-metrics-tls\") pod \"dns-default-dklqq\" (UID: \"d6835bd1-ecd0-4a31-90f6-edccc631c8d6\") " pod="openshift-dns/dns-default-dklqq"
Aug 05 16:23:59.805578 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:23:59.805565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"image-registry-68b8c56f4f-nfr4f\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") " pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:24:00.038314 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.038276    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kcq9m\""
Aug 05 16:24:00.046869 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.046844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:24:00.050861 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.050839    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w85qf\""
Aug 05 16:24:00.060020 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.059948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dklqq"
Aug 05 16:24:00.222514 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.222484    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b8c56f4f-nfr4f"]
Aug 05 16:24:00.225417 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:00.225395    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fa2a6e_9383_4303_89b8_ac9da5572194.slice/crio-68a356d24002c0c10a7d8287795904ae8623034fb4bc07394e3247bb7db63e37 WatchSource:0}: Error finding container 68a356d24002c0c10a7d8287795904ae8623034fb4bc07394e3247bb7db63e37: Status 404 returned error can't find the container with id 68a356d24002c0c10a7d8287795904ae8623034fb4bc07394e3247bb7db63e37
Aug 05 16:24:00.236561 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.236537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dklqq"]
Aug 05 16:24:00.239070 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:00.239050    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6835bd1_ecd0_4a31_90f6_edccc631c8d6.slice/crio-1b17a6b67b0507e81eb93ef75fdaa7ec5e7c053abc05e487f444cac29dac670d WatchSource:0}: Error finding container 1b17a6b67b0507e81eb93ef75fdaa7ec5e7c053abc05e487f444cac29dac670d: Status 404 returned error can't find the container with id 1b17a6b67b0507e81eb93ef75fdaa7ec5e7c053abc05e487f444cac29dac670d
Aug 05 16:24:00.298916 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.298895    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-295rm"
Aug 05 16:24:00.405975 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.405943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dklqq" event={"ID":"d6835bd1-ecd0-4a31-90f6-edccc631c8d6","Type":"ContainerStarted","Data":"1b17a6b67b0507e81eb93ef75fdaa7ec5e7c053abc05e487f444cac29dac670d"}
Aug 05 16:24:00.407483 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.407457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f" event={"ID":"a5fa2a6e-9383-4303-89b8-ac9da5572194","Type":"ContainerStarted","Data":"28800589a4eca47dd770b4111fc33cf05ae8c4b1129daf4dea6f947fdc7eaca5"}
Aug 05 16:24:00.407605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.407502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f" event={"ID":"a5fa2a6e-9383-4303-89b8-ac9da5572194","Type":"ContainerStarted","Data":"68a356d24002c0c10a7d8287795904ae8623034fb4bc07394e3247bb7db63e37"}
Aug 05 16:24:00.407605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.407584    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:24:00.425616 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:00.425571    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f" podStartSLOduration=98.425556141 podStartE2EDuration="1m38.425556141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:00.425538886 +0000 UTC m=+98.932430601" watchObservedRunningTime="2026-08-05 16:24:00.425556141 +0000 UTC m=+98.932447853"
Aug 05 16:24:01.012696 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:01.012609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:24:01.015452 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:01.015429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2522728c-8d34-4b05-9070-5dc1021bb091-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zm2dr\" (UID: \"2522728c-8d34-4b05-9070-5dc1021bb091\") " pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:24:01.257808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:01.257772    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zm2dr"
Aug 05 16:24:01.400674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:01.400640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zm2dr"]
Aug 05 16:24:01.808330 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:01.808294    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2522728c_8d34_4b05_9070_5dc1021bb091.slice/crio-6d4e2b99e16de7de10ed65acab2dbd4149245392eb8910b2ba4aba2b8d8e191e WatchSource:0}: Error finding container 6d4e2b99e16de7de10ed65acab2dbd4149245392eb8910b2ba4aba2b8d8e191e: Status 404 returned error can't find the container with id 6d4e2b99e16de7de10ed65acab2dbd4149245392eb8910b2ba4aba2b8d8e191e
Aug 05 16:24:02.416133 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:02.416094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zm2dr" event={"ID":"2522728c-8d34-4b05-9070-5dc1021bb091","Type":"ContainerStarted","Data":"a8eb8568d689b7b45614dcd646997f4b36704e81323b723927a00914e7f3cf45"}
Aug 05 16:24:02.416555 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:02.416194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zm2dr" event={"ID":"2522728c-8d34-4b05-9070-5dc1021bb091","Type":"ContainerStarted","Data":"6d4e2b99e16de7de10ed65acab2dbd4149245392eb8910b2ba4aba2b8d8e191e"}
Aug 05 16:24:02.417825 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:02.417799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dklqq" event={"ID":"d6835bd1-ecd0-4a31-90f6-edccc631c8d6","Type":"ContainerStarted","Data":"497528eb19c36243e8146b7e040bd069b1f66b2a459346f4f9b4112e932c541a"}
Aug 05 16:24:02.417945 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:02.417847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dklqq" event={"ID":"d6835bd1-ecd0-4a31-90f6-edccc631c8d6","Type":"ContainerStarted","Data":"5c954f177af02d7d54d137eef3e883d9c3753fff5133c2c935bcf5090b3f3a6e"}
Aug 05 16:24:02.418034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:02.417971    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dklqq"
Aug 05 16:24:02.435317 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:02.435266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dklqq" podStartSLOduration=65.829923147 podStartE2EDuration="1m7.435250371s" totalImagesPullingTime="1.605327224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:02.434418609 +0000 UTC m=+100.941310322" watchObservedRunningTime="2026-08-05 16:24:02.435250371 +0000 UTC m=+100.942142086"
Aug 05 16:24:03.424296 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:03.424260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zm2dr" event={"ID":"2522728c-8d34-4b05-9070-5dc1021bb091","Type":"ContainerStarted","Data":"b13c16a11cf04d18881cf133ef2e9df0f3fabd3ba495230bd98968de3af000ce"}
Aug 05 16:24:04.431047 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:04.431015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zm2dr" event={"ID":"2522728c-8d34-4b05-9070-5dc1021bb091","Type":"ContainerStarted","Data":"24db35e5beee0211c78542f41672f3a03a04b2bccde0fa290e52ff09dffc4cda"}
Aug 05 16:24:04.449153 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:04.449108    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zm2dr" podStartSLOduration=33.413006832 podStartE2EDuration="35.449093473s" totalImagesPullingTime="2.036086641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:23:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:04.448160762 +0000 UTC m=+102.955052473" watchObservedRunningTime="2026-08-05 16:24:04.449093473 +0000 UTC m=+102.955985184"
Aug 05 16:24:05.984273 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:05.984242    2576 scope.go:117] "RemoveContainer" containerID="6db660702832d2bffc9f769df8a203ea1b0395bdd261351d310377e5304cdecf"
Aug 05 16:24:05.984672 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:24:05.984392    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-4psc6_openshift-console-operator(60998130-d018-493b-8caa-71e8a0dee61e)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" podUID="60998130-d018-493b-8caa-71e8a0dee61e"
Aug 05 16:24:06.117657 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.117620    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"]
Aug 05 16:24:06.122385 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.122365    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.124663 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.124635    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jvjdb\""
Aug 05 16:24:06.124663 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.124623    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 05 16:24:06.124808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.124725    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 05 16:24:06.125323 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.125308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 16:24:06.131932 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.131907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"]
Aug 05 16:24:06.147494 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.147449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhld9\" (UniqueName: \"kubernetes.io/projected/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-kube-api-access-bhld9\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.147664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.147498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.147664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.147574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.147664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.147625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.148877 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.148856    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9k8rg"]
Aug 05 16:24:06.152462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.152444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.154559 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.154539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pxz2s\""
Aug 05 16:24:06.154778 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.154763    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 16:24:06.154896 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.154879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 16:24:06.155077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.155057    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 16:24:06.248872 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.248777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-wtmp\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.248872 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.248828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-sys\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.248872 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.248863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5g6p\" (UniqueName: \"kubernetes.io/projected/8dfad0db-3a6e-48e6-868c-dd7293b64314-kube-api-access-x5g6p\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.249115 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.248952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhld9\" (UniqueName: \"kubernetes.io/projected/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-kube-api-access-bhld9\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.249115 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-tls\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.249115 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.249115 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.249246 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.249246 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfad0db-3a6e-48e6-868c-dd7293b64314-metrics-client-ca\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.249246 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.249246 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.249379 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-root\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.249379 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:24:06.249260    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Aug 05 16:24:06.249379 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:24:06.249313    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-tls podName:1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51 nodeName:}" failed. No retries permitted until 2026-08-05 16:24:06.749294879 +0000 UTC m=+105.256186572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-wf58c" (UID: "1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51") : secret "openshift-state-metrics-tls" not found
Aug 05 16:24:06.249379 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-textfile\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.249712 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.249680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.251446 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.251429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.258156 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.258135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhld9\" (UniqueName: \"kubernetes.io/projected/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-kube-api-access-bhld9\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.350230 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-tls\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350230 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfad0db-3a6e-48e6-868c-dd7293b64314-metrics-client-ca\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-root\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350431 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:24:06.350347    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 05 16:24:06.350431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-root\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350673 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:24:06.350425    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-tls podName:8dfad0db-3a6e-48e6-868c-dd7293b64314 nodeName:}" failed. No retries permitted until 2026-08-05 16:24:06.850404502 +0000 UTC m=+105.357296207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-tls") pod "node-exporter-9k8rg" (UID: "8dfad0db-3a6e-48e6-868c-dd7293b64314") : secret "node-exporter-tls" not found
Aug 05 16:24:06.350673 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-textfile\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350673 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-wtmp\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350673 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-sys\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350673 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5g6p\" (UniqueName: \"kubernetes.io/projected/8dfad0db-3a6e-48e6-868c-dd7293b64314-kube-api-access-x5g6p\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350907 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350683    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-sys\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350907 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-wtmp\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.350907 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.350727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-textfile\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.351061 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.351006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.351061 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.351038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dfad0db-3a6e-48e6-868c-dd7293b64314-metrics-client-ca\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.352539 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.352516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.358715 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.358698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5g6p\" (UniqueName: \"kubernetes.io/projected/8dfad0db-3a6e-48e6-868c-dd7293b64314-kube-api-access-x5g6p\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.754773 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.754745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.757104 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.757075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-wf58c\" (UID: \"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:06.855621 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.855593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-tls\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:06.857943 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:06.857922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8dfad0db-3a6e-48e6-868c-dd7293b64314-node-exporter-tls\") pod \"node-exporter-9k8rg\" (UID: \"8dfad0db-3a6e-48e6-868c-dd7293b64314\") " pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:07.031144 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:07.031055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"
Aug 05 16:24:07.061612 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:07.061591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k8rg"
Aug 05 16:24:07.092787 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:07.092760    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dfad0db_3a6e_48e6_868c_dd7293b64314.slice/crio-4e733722f4c4930bb81a9284bfdf0a14d2c04c00fb45f9621646b52b063e331e WatchSource:0}: Error finding container 4e733722f4c4930bb81a9284bfdf0a14d2c04c00fb45f9621646b52b063e331e: Status 404 returned error can't find the container with id 4e733722f4c4930bb81a9284bfdf0a14d2c04c00fb45f9621646b52b063e331e
Aug 05 16:24:07.186274 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:07.186198    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c"]
Aug 05 16:24:07.188383 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:07.188356    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc4c9cd_bec7_4e30_9ea8_b22020ba2d51.slice/crio-2d1879460852ac33e4d9543a0fca7227d156127d27c9240ec834c97d950e79ea WatchSource:0}: Error finding container 2d1879460852ac33e4d9543a0fca7227d156127d27c9240ec834c97d950e79ea: Status 404 returned error can't find the container with id 2d1879460852ac33e4d9543a0fca7227d156127d27c9240ec834c97d950e79ea
Aug 05 16:24:07.442822 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:07.442793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k8rg" event={"ID":"8dfad0db-3a6e-48e6-868c-dd7293b64314","Type":"ContainerStarted","Data":"4e733722f4c4930bb81a9284bfdf0a14d2c04c00fb45f9621646b52b063e331e"}
Aug 05 16:24:07.444647 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:07.444614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c" event={"ID":"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51","Type":"ContainerStarted","Data":"3a5afca63681e6042861c0c83c16266bee4c7961d68795fab77b11ad04355be0"}
Aug 05 16:24:07.444757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:07.444665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c" event={"ID":"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51","Type":"ContainerStarted","Data":"f8d9ac78b21a4e3780b1cd41a9ae74cdcee5c41331be95c290f8c162939d4efd"}
Aug 05 16:24:07.444757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:07.444684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c" event={"ID":"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51","Type":"ContainerStarted","Data":"2d1879460852ac33e4d9543a0fca7227d156127d27c9240ec834c97d950e79ea"}
Aug 05 16:24:08.450616 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:08.450572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k8rg" event={"ID":"8dfad0db-3a6e-48e6-868c-dd7293b64314","Type":"ContainerStarted","Data":"3c097cca4bef85fd73855717a586517d72eae91cb256491f8f675e56937ffd8e"}
Aug 05 16:24:09.455802 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:09.455767    2576 generic.go:356] "Generic (PLEG): container finished" podID="8dfad0db-3a6e-48e6-868c-dd7293b64314" containerID="3c097cca4bef85fd73855717a586517d72eae91cb256491f8f675e56937ffd8e" exitCode=0
Aug 05 16:24:09.456241 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:09.455849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k8rg" event={"ID":"8dfad0db-3a6e-48e6-868c-dd7293b64314","Type":"ContainerDied","Data":"3c097cca4bef85fd73855717a586517d72eae91cb256491f8f675e56937ffd8e"}
Aug 05 16:24:09.457916 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:09.457886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c" event={"ID":"1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51","Type":"ContainerStarted","Data":"326a8724adc2f04fe6014a96ec0943b1f7b758d2846c8d64004127bb531450f3"}
Aug 05 16:24:09.488822 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:09.488781    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-wf58c" podStartSLOduration=2.356756908 podStartE2EDuration="3.488766514s" totalImagesPullingTime="1.132009606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:09.487969477 +0000 UTC m=+107.994861202" watchObservedRunningTime="2026-08-05 16:24:09.488766514 +0000 UTC m=+107.995658226"
Aug 05 16:24:10.463457 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.463405    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k8rg" event={"ID":"8dfad0db-3a6e-48e6-868c-dd7293b64314","Type":"ContainerStarted","Data":"e54b61610052f68fe00b4b5f1f8024e74369f6da82e13d07b321ed11a6830a52"}
Aug 05 16:24:10.463941 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.463470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k8rg" event={"ID":"8dfad0db-3a6e-48e6-868c-dd7293b64314","Type":"ContainerStarted","Data":"38b03394e23fcd45c442c6a32e53fffa81326621338e0ee64d68ba572efeead4"}
Aug 05 16:24:10.484512 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.484458    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9k8rg" podStartSLOduration=3.245022907 podStartE2EDuration="4.48444255s" totalImagesPullingTime="1.170642565s" totalInitContainerRuntime="68.777078ms" isStatefulPod=true podCreationTimestamp="2026-08-05 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:10.483325144 +0000 UTC m=+108.990216856" watchObservedRunningTime="2026-08-05 16:24:10.48444255 +0000 UTC m=+108.991334261"
Aug 05 16:24:10.508477 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.508447    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"]
Aug 05 16:24:10.511113 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.511085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.513335 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.513301    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 05 16:24:10.513456 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.513305    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 05 16:24:10.513456 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.513372    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 05 16:24:10.513456 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.513379    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z9bss\""
Aug 05 16:24:10.513607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.513472    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a7ijjrnhuls25\""
Aug 05 16:24:10.513607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.513500    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 05 16:24:10.521613 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.521593    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"]
Aug 05 16:24:10.586109 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.586075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-metrics-server-audit-profiles\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.586263 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.586116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.586263 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.586158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-client-ca-bundle\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.586263 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.586177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-audit-log\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.586263 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.586216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-secret-metrics-server-tls\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.586413 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.586278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-secret-metrics-server-client-certs\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.586413 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.586322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65jjs\" (UniqueName: \"kubernetes.io/projected/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-kube-api-access-65jjs\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687485 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-client-ca-bundle\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-audit-log\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-secret-metrics-server-tls\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-secret-metrics-server-client-certs\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687788 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65jjs\" (UniqueName: \"kubernetes.io/projected/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-kube-api-access-65jjs\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687788 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-metrics-server-audit-profiles\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.687996 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.687955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-audit-log\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.688291 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.688272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.688653 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.688634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-metrics-server-audit-profiles\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.690129 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.690109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-client-ca-bundle\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.690207 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.690124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-secret-metrics-server-client-certs\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.690207 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.690150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-secret-metrics-server-tls\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.695084 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.695066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65jjs\" (UniqueName: \"kubernetes.io/projected/c4ac68a1-f28b-40ca-927f-349a0b23f3a8-kube-api-access-65jjs\") pod \"metrics-server-5b44ff65bb-j9kt2\" (UID: \"c4ac68a1-f28b-40ca-927f-349a0b23f3a8\") " pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.819897 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.819815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:10.870120 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.870090    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"]
Aug 05 16:24:10.874752 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.874732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:10.877149 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.877120    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 05 16:24:10.877262 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.877162    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-djcb7\""
Aug 05 16:24:10.880940 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.880572    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"]
Aug 05 16:24:10.953676 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.953651    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"]
Aug 05 16:24:10.956142 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:10.956116    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ac68a1_f28b_40ca_927f_349a0b23f3a8.slice/crio-893adb2fc8fa95a7122ead042dd9e4fd16b8726dd5d16ce0d6919715db36446f WatchSource:0}: Error finding container 893adb2fc8fa95a7122ead042dd9e4fd16b8726dd5d16ce0d6919715db36446f: Status 404 returned error can't find the container with id 893adb2fc8fa95a7122ead042dd9e4fd16b8726dd5d16ce0d6919715db36446f
Aug 05 16:24:10.989831 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.989793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b835cda7-c356-4e0c-882e-8297835168bd-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-rcpjr\" (UID: \"b835cda7-c356-4e0c-882e-8297835168bd\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:10.990029 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:10.989853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqpnj\" (UniqueName: \"kubernetes.io/projected/b835cda7-c356-4e0c-882e-8297835168bd-kube-api-access-nqpnj\") pod \"monitoring-plugin-6dffbbd67-rcpjr\" (UID: \"b835cda7-c356-4e0c-882e-8297835168bd\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:11.090918 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.090827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqpnj\" (UniqueName: \"kubernetes.io/projected/b835cda7-c356-4e0c-882e-8297835168bd-kube-api-access-nqpnj\") pod \"monitoring-plugin-6dffbbd67-rcpjr\" (UID: \"b835cda7-c356-4e0c-882e-8297835168bd\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:11.090918 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.090893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b835cda7-c356-4e0c-882e-8297835168bd-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-rcpjr\" (UID: \"b835cda7-c356-4e0c-882e-8297835168bd\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:11.093204 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.093184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b835cda7-c356-4e0c-882e-8297835168bd-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-rcpjr\" (UID: \"b835cda7-c356-4e0c-882e-8297835168bd\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:11.099294 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.099271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqpnj\" (UniqueName: \"kubernetes.io/projected/b835cda7-c356-4e0c-882e-8297835168bd-kube-api-access-nqpnj\") pod \"monitoring-plugin-6dffbbd67-rcpjr\" (UID: \"b835cda7-c356-4e0c-882e-8297835168bd\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:11.188446 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.188414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:11.314096 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.314075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"]
Aug 05 16:24:11.316028 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:11.315999    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb835cda7_c356_4e0c_882e_8297835168bd.slice/crio-faa909834b158eb3b2c2a7928014f415f6865d18a58d05789dce92954dc9bd18 WatchSource:0}: Error finding container faa909834b158eb3b2c2a7928014f415f6865d18a58d05789dce92954dc9bd18: Status 404 returned error can't find the container with id faa909834b158eb3b2c2a7928014f415f6865d18a58d05789dce92954dc9bd18
Aug 05 16:24:11.469163 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.469126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2" event={"ID":"c4ac68a1-f28b-40ca-927f-349a0b23f3a8","Type":"ContainerStarted","Data":"893adb2fc8fa95a7122ead042dd9e4fd16b8726dd5d16ce0d6919715db36446f"}
Aug 05 16:24:11.470265 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:11.470239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr" event={"ID":"b835cda7-c356-4e0c-882e-8297835168bd","Type":"ContainerStarted","Data":"faa909834b158eb3b2c2a7928014f415f6865d18a58d05789dce92954dc9bd18"}
Aug 05 16:24:12.300285 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.300246    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:12.303814 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.303792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.306070 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306047    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 05 16:24:12.306172 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306102    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 05 16:24:12.306325 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306309    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 05 16:24:12.306425 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306349    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 05 16:24:12.306425 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306349    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 05 16:24:12.306425 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306407    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 05 16:24:12.306604 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306531    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 05 16:24:12.306719 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306702    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c7l2c\""
Aug 05 16:24:12.306802 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 05 16:24:12.306802 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306773    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 05 16:24:12.306907 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306774    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 05 16:24:12.306907 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.306899    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 05 16:24:12.307044 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.307032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 05 16:24:12.307100 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.307069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-80b31n2ushjjf\""
Aug 05 16:24:12.307275 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.307253    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 05 16:24:12.309748 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.309731    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 05 16:24:12.322737 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.322713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:12.400922 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.400894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.400942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.400994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401176 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401176 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401176 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401155    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401176 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401442 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401442 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401442 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401442 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401557 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401557 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5dzc\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-kube-api-access-m5dzc\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401614 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.401648 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.401616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.427298 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.427270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dklqq"
Aug 05 16:24:12.478474 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.478375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2" event={"ID":"c4ac68a1-f28b-40ca-927f-349a0b23f3a8","Type":"ContainerStarted","Data":"36903e78329a9bda859757e440956d37f0b5f18d1626771470ac6e1f76dcf05e"}
Aug 05 16:24:12.499208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.499156    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2" podStartSLOduration=1.113843508 podStartE2EDuration="2.499135983s" totalImagesPullingTime="1.385292475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:12.498208561 +0000 UTC m=+111.005100272" watchObservedRunningTime="2026-08-05 16:24:12.499135983 +0000 UTC m=+111.006027696"
Aug 05 16:24:12.502914 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.502885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503063 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.502946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503063 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.502963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503063 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.502999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503063 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503345 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503345 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503345 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503345 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503345 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503345 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503641 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503641 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.503757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.503736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.504485 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.504458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.504823 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.504798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.505061 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.505038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.505147 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.505079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.505539 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.505515    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.505616 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.505591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.505677 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.505631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.505677 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.505659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5dzc\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-kube-api-access-m5dzc\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.506054 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.506031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.507473 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.507450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.507931 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.507636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.507931 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.507859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.508705 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.508535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.509169 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.509144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config-out\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.509414 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.509370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.509536 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.509516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.509632 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.509608    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.509697 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.509650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.509754 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.509737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.510903 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.510878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-web-config\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.511126 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.511077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.511458 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.511435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.515788 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.515767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5dzc\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-kube-api-access-m5dzc\") pod \"prometheus-k8s-0\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:12.614820 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:12.614742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:13.090521 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:13.090495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:24:13.092294 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:13.092270    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69801e41_4d74_4a8e_848a_fb1a8d330fbc.slice/crio-7add298a9a36e40ce63200598ce35228fd0f130ed080846894524258b20397e5 WatchSource:0}: Error finding container 7add298a9a36e40ce63200598ce35228fd0f130ed080846894524258b20397e5: Status 404 returned error can't find the container with id 7add298a9a36e40ce63200598ce35228fd0f130ed080846894524258b20397e5
Aug 05 16:24:13.483275 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:13.483243    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerStarted","Data":"7add298a9a36e40ce63200598ce35228fd0f130ed080846894524258b20397e5"}
Aug 05 16:24:13.484743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:13.484715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr" event={"ID":"b835cda7-c356-4e0c-882e-8297835168bd","Type":"ContainerStarted","Data":"e8b7fbf3f98b99d7c1d6f1845f54dbac30086d48f8e778c08447d5df2c29f84c"}
Aug 05 16:24:13.485016 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:13.484974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:13.489698 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:13.489673    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr"
Aug 05 16:24:13.501056 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:13.501012    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-rcpjr" podStartSLOduration=1.813217035 podStartE2EDuration="3.501000023s" totalImagesPullingTime="1.687782988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:13.500531286 +0000 UTC m=+112.007423001" watchObservedRunningTime="2026-08-05 16:24:13.501000023 +0000 UTC m=+112.007891729"
Aug 05 16:24:14.410382 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:14.410343    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b8c56f4f-nfr4f"]
Aug 05 16:24:14.489884 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:14.489847    2576 generic.go:356] "Generic (PLEG): container finished" podID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerID="728fe8eb2f020287aa4e626e2a46c1fb2cc2009c0060502b9154a7d0531ce06a" exitCode=0
Aug 05 16:24:14.490299 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:14.489935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"728fe8eb2f020287aa4e626e2a46c1fb2cc2009c0060502b9154a7d0531ce06a"}
Aug 05 16:24:17.990404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:17.990336    2576 scope.go:117] "RemoveContainer" containerID="6db660702832d2bffc9f769df8a203ea1b0395bdd261351d310377e5304cdecf"
Aug 05 16:24:18.508679 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:18.508648    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:24:18.508844 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:18.508736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" event={"ID":"60998130-d018-493b-8caa-71e8a0dee61e","Type":"ContainerStarted","Data":"67da672cfc29b844471011b3ae801f36cc2db104d2481fa5db12ed0daa1f2776"}
Aug 05 16:24:18.509289 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:18.509266    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:24:18.513090 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:18.513054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerStarted","Data":"e176558b231891cfa156937866e62320a60cd80dc20117145feb29eb10907573"}
Aug 05 16:24:18.513204 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:18.513139    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerStarted","Data":"14e8347f84508d7175d3a32dc2be19013c2936d7bc15fd47a8ea16d154b5d6ad"}
Aug 05 16:24:18.532961 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:18.532916    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6" podStartSLOduration=51.79392744 podStartE2EDuration="56.532902404s" totalImagesPullingTime="4.738974964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:18.531766645 +0000 UTC m=+117.038658362" watchObservedRunningTime="2026-08-05 16:24:18.532902404 +0000 UTC m=+117.039794117"
Aug 05 16:24:18.817424 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:18.817353    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-4psc6"
Aug 05 16:24:20.523787 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:20.523749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerStarted","Data":"8051f9891efdeaa1f20fcf50e6265e52ae57151a90b8ff430c0d45301e2d81ed"}
Aug 05 16:24:20.524181 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:20.523819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerStarted","Data":"2b7c05a4473f58ec247cfde1302f6b7dc4d59f13010bf831117261c3f0610763"}
Aug 05 16:24:20.524181 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:20.523854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerStarted","Data":"59e86e60e0bbe6f05c0a4a77319de52180858d8a2caefe820e9c31d578336760"}
Aug 05 16:24:20.524181 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:20.523882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerStarted","Data":"4eb409f7d5b481aecd539bf549b9220fbb4de57271b64fdbe5ecc3b9b708ac05"}
Aug 05 16:24:20.561126 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:20.561077    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.507368417 podStartE2EDuration="8.561061438s" totalImagesPullingTime="6.03436912s" totalInitContainerRuntime="19.323901ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:20.558225906 +0000 UTC m=+119.065117770" watchObservedRunningTime="2026-08-05 16:24:20.561061438 +0000 UTC m=+119.067953149"
Aug 05 16:24:22.615443 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:22.615404    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:24:24.416256 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:24.416227    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:24:30.820693 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:30.820658    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:30.821239 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:30.820738    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:31.890771 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:31.890730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:24:31.893022 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:31.892999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cb1528c-89d6-403f-9a88-772e472da6df-metrics-certs\") pod \"network-metrics-daemon-79f65\" (UID: \"9cb1528c-89d6-403f-9a88-772e472da6df\") " pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:24:32.106262 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:32.106236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zm8j\""
Aug 05 16:24:32.113961 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:32.113937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79f65"
Aug 05 16:24:32.238730 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:32.238678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-79f65"]
Aug 05 16:24:32.240991 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:24:32.240953    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb1528c_89d6_403f_9a88_772e472da6df.slice/crio-862a2cec74612315c3c9922969bffe8551ff3e2f5215fb9f268a73026d62b30d WatchSource:0}: Error finding container 862a2cec74612315c3c9922969bffe8551ff3e2f5215fb9f268a73026d62b30d: Status 404 returned error can't find the container with id 862a2cec74612315c3c9922969bffe8551ff3e2f5215fb9f268a73026d62b30d
Aug 05 16:24:32.570256 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:32.570173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79f65" event={"ID":"9cb1528c-89d6-403f-9a88-772e472da6df","Type":"ContainerStarted","Data":"862a2cec74612315c3c9922969bffe8551ff3e2f5215fb9f268a73026d62b30d"}
Aug 05 16:24:34.580808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:34.580769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79f65" event={"ID":"9cb1528c-89d6-403f-9a88-772e472da6df","Type":"ContainerStarted","Data":"efae84b7ca0f29c9f09ac205df469e34edf34803b4c58f2dcda0a947d99353c6"}
Aug 05 16:24:34.581286 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:34.580821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79f65" event={"ID":"9cb1528c-89d6-403f-9a88-772e472da6df","Type":"ContainerStarted","Data":"11036b84c7aec94e2d5a17d58822b96d9b973d39e9c9ae82b32c7aa426270c09"}
Aug 05 16:24:34.597511 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:34.597452    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-79f65" podStartSLOduration=131.296628867 podStartE2EDuration="2m12.597438444s" totalImagesPullingTime="1.300809577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:34.595991556 +0000 UTC m=+133.102883260" watchObservedRunningTime="2026-08-05 16:24:34.597438444 +0000 UTC m=+133.104330155"
Aug 05 16:24:39.429131 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.429085    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f" podUID="a5fa2a6e-9383-4303-89b8-ac9da5572194" containerName="registry" containerID="cri-o://28800589a4eca47dd770b4111fc33cf05ae8c4b1129daf4dea6f947fdc7eaca5" gracePeriod=30
Aug 05 16:24:39.604732 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.604696    2576 generic.go:356] "Generic (PLEG): container finished" podID="712969e1-98cd-43d9-a3ec-8d1ca050574d" containerID="fd9941299a123b3a9e9cc867a37a50c29560f617225556737aec6227da9ed2bc" exitCode=0
Aug 05 16:24:39.604878 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.604820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb" event={"ID":"712969e1-98cd-43d9-a3ec-8d1ca050574d","Type":"ContainerDied","Data":"fd9941299a123b3a9e9cc867a37a50c29560f617225556737aec6227da9ed2bc"}
Aug 05 16:24:39.605212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.605190    2576 scope.go:117] "RemoveContainer" containerID="fd9941299a123b3a9e9cc867a37a50c29560f617225556737aec6227da9ed2bc"
Aug 05 16:24:39.607389 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.607356    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5fa2a6e-9383-4303-89b8-ac9da5572194" containerID="28800589a4eca47dd770b4111fc33cf05ae8c4b1129daf4dea6f947fdc7eaca5" exitCode=0
Aug 05 16:24:39.607589 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.607505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f" event={"ID":"a5fa2a6e-9383-4303-89b8-ac9da5572194","Type":"ContainerDied","Data":"28800589a4eca47dd770b4111fc33cf05ae8c4b1129daf4dea6f947fdc7eaca5"}
Aug 05 16:24:39.610127 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.610104    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9f3aacc-e968-4225-9bbd-8c78937ae8d5" containerID="a6588854065c4666b4ba4e9b187582d5fe07f17d9e7877183f79281233c82f77" exitCode=0
Aug 05 16:24:39.610219 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.610157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq" event={"ID":"f9f3aacc-e968-4225-9bbd-8c78937ae8d5","Type":"ContainerDied","Data":"a6588854065c4666b4ba4e9b187582d5fe07f17d9e7877183f79281233c82f77"}
Aug 05 16:24:39.610497 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.610480    2576 scope.go:117] "RemoveContainer" containerID="a6588854065c4666b4ba4e9b187582d5fe07f17d9e7877183f79281233c82f77"
Aug 05 16:24:39.669598 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.669571    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:24:39.859863 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.859829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-certificates\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860082 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.859885    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-image-registry-private-configuration\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860082 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.859914    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-installation-pull-secrets\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860082 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.859946    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dd88\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-kube-api-access-6dd88\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860082 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.860040    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5fa2a6e-9383-4303-89b8-ac9da5572194-ca-trust-extracted\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860082 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.860079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-trusted-ca\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860338 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.860107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-bound-sa-token\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860338 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.860175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") pod \"a5fa2a6e-9383-4303-89b8-ac9da5572194\" (UID: \"a5fa2a6e-9383-4303-89b8-ac9da5572194\") "
Aug 05 16:24:39.860338 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.860288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:39.860476 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.860450    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-certificates\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:39.860962 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.860918    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:39.863186 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.863133    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:39.863280 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.863236    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:39.863338 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.863275    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:39.863338 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.863284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-kube-api-access-6dd88" (OuterVolumeSpecName: "kube-api-access-6dd88") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "kube-api-access-6dd88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:39.863715 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.863690    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:39.871093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.871068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5fa2a6e-9383-4303-89b8-ac9da5572194-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a5fa2a6e-9383-4303-89b8-ac9da5572194" (UID: "a5fa2a6e-9383-4303-89b8-ac9da5572194"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:24:39.961261 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.961231    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-registry-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:39.961399 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.961264    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-image-registry-private-configuration\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:39.961399 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.961279    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a5fa2a6e-9383-4303-89b8-ac9da5572194-installation-pull-secrets\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:39.961399 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.961292    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dd88\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-kube-api-access-6dd88\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:39.961399 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.961305    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a5fa2a6e-9383-4303-89b8-ac9da5572194-ca-trust-extracted\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:39.961399 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.961317    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa2a6e-9383-4303-89b8-ac9da5572194-trusted-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:39.961399 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:39.961329    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fa2a6e-9383-4303-89b8-ac9da5572194-bound-sa-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:24:40.615726 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:40.615685    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gqlpb" event={"ID":"712969e1-98cd-43d9-a3ec-8d1ca050574d","Type":"ContainerStarted","Data":"35d099e959874fcb2e4c9e14801e1449ae7692ea0a5d88c180b0f72a5f5705b8"}
Aug 05 16:24:40.617099 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:40.617076    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f"
Aug 05 16:24:40.617238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:40.617083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b8c56f4f-nfr4f" event={"ID":"a5fa2a6e-9383-4303-89b8-ac9da5572194","Type":"ContainerDied","Data":"68a356d24002c0c10a7d8287795904ae8623034fb4bc07394e3247bb7db63e37"}
Aug 05 16:24:40.617238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:40.617207    2576 scope.go:117] "RemoveContainer" containerID="28800589a4eca47dd770b4111fc33cf05ae8c4b1129daf4dea6f947fdc7eaca5"
Aug 05 16:24:40.619238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:40.619214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-7cxzq" event={"ID":"f9f3aacc-e968-4225-9bbd-8c78937ae8d5","Type":"ContainerStarted","Data":"03ae681ec07cce7e1b659e2ca62c5aa5b99f6488f6288419a1d3fa586ccfe846"}
Aug 05 16:24:40.646647 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:40.646616    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b8c56f4f-nfr4f"]
Aug 05 16:24:40.651690 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:40.651662    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68b8c56f4f-nfr4f"]
Aug 05 16:24:41.989533 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:41.989492    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5fa2a6e-9383-4303-89b8-ac9da5572194" path="/var/lib/kubelet/pods/a5fa2a6e-9383-4303-89b8-ac9da5572194/volumes"
Aug 05 16:24:44.639392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:44.639353    2576 generic.go:356] "Generic (PLEG): container finished" podID="9dc97b96-a1b3-4d7c-9b86-643f7541c35d" containerID="e3e938c604affa98eacbe51db1da0aa6dc3648aa6b5655b96cb1e4f15282d690" exitCode=0
Aug 05 16:24:44.639797 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:44.639450    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kn6sw" event={"ID":"9dc97b96-a1b3-4d7c-9b86-643f7541c35d","Type":"ContainerDied","Data":"e3e938c604affa98eacbe51db1da0aa6dc3648aa6b5655b96cb1e4f15282d690"}
Aug 05 16:24:44.639840 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:44.639798    2576 scope.go:117] "RemoveContainer" containerID="e3e938c604affa98eacbe51db1da0aa6dc3648aa6b5655b96cb1e4f15282d690"
Aug 05 16:24:45.644890 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:45.644856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kn6sw" event={"ID":"9dc97b96-a1b3-4d7c-9b86-643f7541c35d","Type":"ContainerStarted","Data":"7ae402cc56a94ef28474f14e69811740dc94f5af64b04753868e5b1177276a0b"}
Aug 05 16:24:50.825405 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:50.825373    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:24:50.829202 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:24:50.829179    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b44ff65bb-j9kt2"
Aug 05 16:25:12.615755 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:12.615703    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:12.635885 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:12.631946    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:12.783360 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:12.783332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:30.708302 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.708267    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:25:30.709114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.708580    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="prometheus" containerID="cri-o://14e8347f84508d7175d3a32dc2be19013c2936d7bc15fd47a8ea16d154b5d6ad" gracePeriod=600
Aug 05 16:25:30.709114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.708624    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy" containerID="cri-o://2b7c05a4473f58ec247cfde1302f6b7dc4d59f13010bf831117261c3f0610763" gracePeriod=600
Aug 05 16:25:30.709114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.708644    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="thanos-sidecar" containerID="cri-o://4eb409f7d5b481aecd539bf549b9220fbb4de57271b64fdbe5ecc3b9b708ac05" gracePeriod=600
Aug 05 16:25:30.709114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.708757    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="config-reloader" containerID="cri-o://e176558b231891cfa156937866e62320a60cd80dc20117145feb29eb10907573" gracePeriod=600
Aug 05 16:25:30.709114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.708774    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8051f9891efdeaa1f20fcf50e6265e52ae57151a90b8ff430c0d45301e2d81ed" gracePeriod=600
Aug 05 16:25:30.709114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.708776    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-web" containerID="cri-o://59e86e60e0bbe6f05c0a4a77319de52180858d8a2caefe820e9c31d578336760" gracePeriod=600
Aug 05 16:25:30.841041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841007    2576 generic.go:356] "Generic (PLEG): container finished" podID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerID="8051f9891efdeaa1f20fcf50e6265e52ae57151a90b8ff430c0d45301e2d81ed" exitCode=0
Aug 05 16:25:30.841041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"8051f9891efdeaa1f20fcf50e6265e52ae57151a90b8ff430c0d45301e2d81ed"}
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"2b7c05a4473f58ec247cfde1302f6b7dc4d59f13010bf831117261c3f0610763"}
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841033    2576 generic.go:356] "Generic (PLEG): container finished" podID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerID="2b7c05a4473f58ec247cfde1302f6b7dc4d59f13010bf831117261c3f0610763" exitCode=0
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841122    2576 generic.go:356] "Generic (PLEG): container finished" podID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerID="59e86e60e0bbe6f05c0a4a77319de52180858d8a2caefe820e9c31d578336760" exitCode=0
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"59e86e60e0bbe6f05c0a4a77319de52180858d8a2caefe820e9c31d578336760"}
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841130    2576 generic.go:356] "Generic (PLEG): container finished" podID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerID="4eb409f7d5b481aecd539bf549b9220fbb4de57271b64fdbe5ecc3b9b708ac05" exitCode=0
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841136    2576 generic.go:356] "Generic (PLEG): container finished" podID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerID="e176558b231891cfa156937866e62320a60cd80dc20117145feb29eb10907573" exitCode=0
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841141    2576 generic.go:356] "Generic (PLEG): container finished" podID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerID="14e8347f84508d7175d3a32dc2be19013c2936d7bc15fd47a8ea16d154b5d6ad" exitCode=0
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"4eb409f7d5b481aecd539bf549b9220fbb4de57271b64fdbe5ecc3b9b708ac05"}
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"e176558b231891cfa156937866e62320a60cd80dc20117145feb29eb10907573"}
Aug 05 16:25:30.841238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.841201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"14e8347f84508d7175d3a32dc2be19013c2936d7bc15fd47a8ea16d154b5d6ad"}
Aug 05 16:25:30.954347 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:30.954322    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:31.088707 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088612    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-tls\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.088707 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-metrics-client-ca\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.088707 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088688    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-trusted-ca-bundle\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089013 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088718    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-0\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089013 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088812    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-1\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089013 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089013 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088898    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-thanos-prometheus-http-client-file\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089013 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089013 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.088972    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-serving-certs-ca-bundle\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089025    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-metrics-client-certs\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089078    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-kubelet-serving-ca-bundle\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089152    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-2\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089182    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-grpc-tls\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089182    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089207    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-kube-rbac-proxy\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089219    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089249    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-db\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089256    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:31.089303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089280    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config-out\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-web-config\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089340    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-tls-assets\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089366    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5dzc\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-kube-api-access-m5dzc\") pod \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\" (UID: \"69801e41-4d74-4a8e-848a-fb1a8d330fbc\") "
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089578    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089704    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089723    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-metrics-client-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089737    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.089811 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.089752    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.090256 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.090138    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:31.091508 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.091475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:31.091745 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.091691    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:25:31.092209 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.092184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.092604 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.092575    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.092900 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.092864    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.093441 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.093410    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.093532 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.093471    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.093805 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.093773    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config" (OuterVolumeSpecName: "config") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.093898 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.093863    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.094000 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.093966    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config-out" (OuterVolumeSpecName: "config-out") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:25:31.094268 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.094247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-kube-api-access-m5dzc" (OuterVolumeSpecName: "kube-api-access-m5dzc") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "kube-api-access-m5dzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:25:31.094342 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.094302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.094466 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.094448    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:25:31.103399 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.103378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-web-config" (OuterVolumeSpecName: "web-config") pod "69801e41-4d74-4a8e-848a-fb1a8d330fbc" (UID: "69801e41-4d74-4a8e-848a-fb1a8d330fbc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:31.190734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190692    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.190734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190727    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.190734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190740    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-grpc-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190750    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-kube-rbac-proxy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190759    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-db\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190769    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config-out\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190778    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-web-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190787    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-tls-assets\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190799    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5dzc\" (UniqueName: \"kubernetes.io/projected/69801e41-4d74-4a8e-848a-fb1a8d330fbc-kube-api-access-m5dzc\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190807    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190815    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190823    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190832    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190840    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-config\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190848    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69801e41-4d74-4a8e-848a-fb1a8d330fbc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.191041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.190857    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/69801e41-4d74-4a8e-848a-fb1a8d330fbc-secret-metrics-client-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:25:31.848487 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.848453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"69801e41-4d74-4a8e-848a-fb1a8d330fbc","Type":"ContainerDied","Data":"7add298a9a36e40ce63200598ce35228fd0f130ed080846894524258b20397e5"}
Aug 05 16:25:31.848847 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.848494    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:31.848847 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.848554    2576 scope.go:117] "RemoveContainer" containerID="8051f9891efdeaa1f20fcf50e6265e52ae57151a90b8ff430c0d45301e2d81ed"
Aug 05 16:25:31.856712 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.856693    2576 scope.go:117] "RemoveContainer" containerID="2b7c05a4473f58ec247cfde1302f6b7dc4d59f13010bf831117261c3f0610763"
Aug 05 16:25:31.865716 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.864970    2576 scope.go:117] "RemoveContainer" containerID="59e86e60e0bbe6f05c0a4a77319de52180858d8a2caefe820e9c31d578336760"
Aug 05 16:25:31.872834 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.872815    2576 scope.go:117] "RemoveContainer" containerID="4eb409f7d5b481aecd539bf549b9220fbb4de57271b64fdbe5ecc3b9b708ac05"
Aug 05 16:25:31.878101 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.878080    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:25:31.879869 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.879850    2576 scope.go:117] "RemoveContainer" containerID="e176558b231891cfa156937866e62320a60cd80dc20117145feb29eb10907573"
Aug 05 16:25:31.884633 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.884558    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:25:31.888527 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.888500    2576 scope.go:117] "RemoveContainer" containerID="14e8347f84508d7175d3a32dc2be19013c2936d7bc15fd47a8ea16d154b5d6ad"
Aug 05 16:25:31.895511 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.895495    2576 scope.go:117] "RemoveContainer" containerID="728fe8eb2f020287aa4e626e2a46c1fb2cc2009c0060502b9154a7d0531ce06a"
Aug 05 16:25:31.912026 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912002    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:25:31.912354 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912339    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="prometheus"
Aug 05 16:25:31.912421 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912357    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="prometheus"
Aug 05 16:25:31.912421 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912369    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="config-reloader"
Aug 05 16:25:31.912421 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912378    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="config-reloader"
Aug 05 16:25:31.912421 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912393    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-thanos"
Aug 05 16:25:31.912421 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912401    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-thanos"
Aug 05 16:25:31.912421 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912416    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="thanos-sidecar"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912424    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="thanos-sidecar"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912435    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="init-config-reloader"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912443    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="init-config-reloader"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912455    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-web"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912463    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-web"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912476    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5fa2a6e-9383-4303-89b8-ac9da5572194" containerName="registry"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912484    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5fa2a6e-9383-4303-89b8-ac9da5572194" containerName="registry"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912502    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912510    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912584    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-web"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912599    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="thanos-sidecar"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912608    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="config-reloader"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912617    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="prometheus"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912625    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912634    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" containerName="kube-rbac-proxy-thanos"
Aug 05 16:25:31.912709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.912643    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5fa2a6e-9383-4303-89b8-ac9da5572194" containerName="registry"
Aug 05 16:25:31.917461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.917443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:31.919822 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.919800    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 05 16:25:31.919922 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.919803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 05 16:25:31.919999 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.919948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 05 16:25:31.920051 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920000    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c7l2c\""
Aug 05 16:25:31.920222 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920206    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 05 16:25:31.920295 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920271    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 05 16:25:31.920422 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920371    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 05 16:25:31.920422 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920404    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-80b31n2ushjjf\""
Aug 05 16:25:31.920422 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920406    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 05 16:25:31.920568 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920482    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 05 16:25:31.920734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920713    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 05 16:25:31.920853 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920720    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 05 16:25:31.920853 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.920789    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 05 16:25:31.921256 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.921240    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 05 16:25:31.923614 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.923594    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 05 16:25:31.926626 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.926607    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 05 16:25:31.935176 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.935155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:25:31.988352 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:31.988270    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69801e41-4d74-4a8e-848a-fb1a8d330fbc" path="/var/lib/kubelet/pods/69801e41-4d74-4a8e-848a-fb1a8d330fbc/volumes"
Aug 05 16:25:32.096812 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.096758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.096812 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.096815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.096873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.096893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-config\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.096938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj5lv\" (UniqueName: \"kubernetes.io/projected/a6aea029-dca6-4c6c-9907-969420170c4f-kube-api-access-rj5lv\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.096975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6aea029-dca6-4c6c-9907-969420170c4f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6aea029-dca6-4c6c-9907-969420170c4f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097602 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097602 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097602 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.097602 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.097415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198481 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198481 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198908 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198908 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198908 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.198908 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.198955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-config\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj5lv\" (UniqueName: \"kubernetes.io/projected/a6aea029-dca6-4c6c-9907-969420170c4f-kube-api-access-rj5lv\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6aea029-dca6-4c6c-9907-969420170c4f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6aea029-dca6-4c6c-9907-969420170c4f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.199867 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.199840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.200703 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.200677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.201366 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.201341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.202118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.201706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.202118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.201766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.202118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.201884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.202118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.202022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.202118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.202064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6aea029-dca6-4c6c-9907-969420170c4f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.202428 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.202396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.202887 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.202826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.203148 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.203124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.203238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.203220    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-config\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.204264 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.204226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.204466 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.204448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6aea029-dca6-4c6c-9907-969420170c4f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.204584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.204562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.204839 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.204819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6aea029-dca6-4c6c-9907-969420170c4f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.205047 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.205029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6aea029-dca6-4c6c-9907-969420170c4f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.207070 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.207053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj5lv\" (UniqueName: \"kubernetes.io/projected/a6aea029-dca6-4c6c-9907-969420170c4f-kube-api-access-rj5lv\") pod \"prometheus-k8s-0\" (UID: \"a6aea029-dca6-4c6c-9907-969420170c4f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.227637 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.227614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:25:32.367277 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.367244    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 05 16:25:32.370629 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:25:32.370606    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6aea029_dca6_4c6c_9907_969420170c4f.slice/crio-438c45de07528bd9a8d52dcc617b5d22fa54614b5d6af0e39fbcb9900338fcdd WatchSource:0}: Error finding container 438c45de07528bd9a8d52dcc617b5d22fa54614b5d6af0e39fbcb9900338fcdd: Status 404 returned error can't find the container with id 438c45de07528bd9a8d52dcc617b5d22fa54614b5d6af0e39fbcb9900338fcdd
Aug 05 16:25:32.854239 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.854194    2576 generic.go:356] "Generic (PLEG): container finished" podID="a6aea029-dca6-4c6c-9907-969420170c4f" containerID="6c527dcfbaeed4daabe53d5da9b3ce97da82a30e5b87e4bac7841ceca6adb257" exitCode=0
Aug 05 16:25:32.854702 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.854272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerDied","Data":"6c527dcfbaeed4daabe53d5da9b3ce97da82a30e5b87e4bac7841ceca6adb257"}
Aug 05 16:25:32.854702 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:32.854346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerStarted","Data":"438c45de07528bd9a8d52dcc617b5d22fa54614b5d6af0e39fbcb9900338fcdd"}
Aug 05 16:25:33.862190 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:33.862157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerStarted","Data":"90872758f3fa2043b841920cc1384c879d5bdaf1b168be8edca6235819f6a043"}
Aug 05 16:25:33.862548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:33.862249    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerStarted","Data":"e7f922743f8aa688faefc4231a41c76f94bf238edc80b08d4ffdfc785356c28e"}
Aug 05 16:25:33.862548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:33.862276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerStarted","Data":"cc18f9085573c87c1c9b2e1f46e79aa346131856329ce53762052502bfcb923f"}
Aug 05 16:25:33.862548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:33.862303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerStarted","Data":"8de3c29ffbc4971f3d24887d7f0fbc31a94199b63c9993bea12750b2c4bf478c"}
Aug 05 16:25:33.862548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:33.862328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerStarted","Data":"858fe38a42d37f205429bac95a01c96e249a79985271a884e295bb61e464387c"}
Aug 05 16:25:33.862548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:33.862351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6aea029-dca6-4c6c-9907-969420170c4f","Type":"ContainerStarted","Data":"b495819c83c1cf7b94b1ec14de55044866d155a4475c9d675d5acee957c58a8e"}
Aug 05 16:25:33.893354 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:33.893292    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8733782850000003 podStartE2EDuration="2.893272855s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.89457ms" isStatefulPod=false podCreationTimestamp="2026-08-05 16:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:25:33.891827239 +0000 UTC m=+192.398718980" watchObservedRunningTime="2026-08-05 16:25:33.893272855 +0000 UTC m=+192.400164568"
Aug 05 16:25:37.228060 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:25:37.228022    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:26:32.228605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:26:32.228565    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:26:32.244037 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:26:32.244012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:26:33.100419 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:26:33.100394    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 05 16:27:21.905140 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:27:21.905110    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:27:21.911453 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:27:21.911429    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:27:21.916180 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:27:21.916149    2576 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 16:29:31.612999 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.612944    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"]
Aug 05 16:29:31.616411 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.616393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.618609 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.618588    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sjz7k\""
Aug 05 16:29:31.618714 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.618629    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 16:29:31.619111 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.619095    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 16:29:31.619260 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.619241    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 16:29:31.619381 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.619365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 16:29:31.631016 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.630993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"]
Aug 05 16:29:31.645766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.645742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f8020f8a-3144-4c24-8034-1bcd5b46bb44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.645891 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.645780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck4jt\" (UniqueName: \"kubernetes.io/projected/f8020f8a-3144-4c24-8034-1bcd5b46bb44-kube-api-access-ck4jt\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.645891 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.645849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8020f8a-3144-4c24-8034-1bcd5b46bb44-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.646028 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.645943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f8020f8a-3144-4c24-8034-1bcd5b46bb44-manifests\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.646028 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.646000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8020f8a-3144-4c24-8034-1bcd5b46bb44-tmp\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.747055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.747011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f8020f8a-3144-4c24-8034-1bcd5b46bb44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.747055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.747050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck4jt\" (UniqueName: \"kubernetes.io/projected/f8020f8a-3144-4c24-8034-1bcd5b46bb44-kube-api-access-ck4jt\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.747308 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.747081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8020f8a-3144-4c24-8034-1bcd5b46bb44-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.747308 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.747112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f8020f8a-3144-4c24-8034-1bcd5b46bb44-manifests\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.747308 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.747132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8020f8a-3144-4c24-8034-1bcd5b46bb44-tmp\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.747610 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.747586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f8020f8a-3144-4c24-8034-1bcd5b46bb44-manifests\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.749388 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.749363    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8020f8a-3144-4c24-8034-1bcd5b46bb44-tmp\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.749573 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.749553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8020f8a-3144-4c24-8034-1bcd5b46bb44-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.749618 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.749571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f8020f8a-3144-4c24-8034-1bcd5b46bb44-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.757940 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.757916    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck4jt\" (UniqueName: \"kubernetes.io/projected/f8020f8a-3144-4c24-8034-1bcd5b46bb44-kube-api-access-ck4jt\") pod \"opendatahub-operator-controller-manager-5cfc779b6-m9fbk\" (UID: \"f8020f8a-3144-4c24-8034-1bcd5b46bb44\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:31.926093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:31.926056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:32.065935 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:32.065913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"]
Aug 05 16:29:32.068085 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:29:32.068060    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8020f8a_3144_4c24_8034_1bcd5b46bb44.slice/crio-0683b5bbc9935a2283411caa0446512c80cf35da1c68683f6eb3f1b87ff53467 WatchSource:0}: Error finding container 0683b5bbc9935a2283411caa0446512c80cf35da1c68683f6eb3f1b87ff53467: Status 404 returned error can't find the container with id 0683b5bbc9935a2283411caa0446512c80cf35da1c68683f6eb3f1b87ff53467
Aug 05 16:29:32.069778 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:32.069762    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:29:32.770706 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:32.770672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk" event={"ID":"f8020f8a-3144-4c24-8034-1bcd5b46bb44","Type":"ContainerStarted","Data":"0683b5bbc9935a2283411caa0446512c80cf35da1c68683f6eb3f1b87ff53467"}
Aug 05 16:29:35.786110 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:35.786074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk" event={"ID":"f8020f8a-3144-4c24-8034-1bcd5b46bb44","Type":"ContainerStarted","Data":"d461adbf875892f23f985ca965a185cda5c1085f9dfa71ab1078d1209038e43c"}
Aug 05 16:29:36.791509 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:36.791471    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8020f8a-3144-4c24-8034-1bcd5b46bb44" containerID="d461adbf875892f23f985ca965a185cda5c1085f9dfa71ab1078d1209038e43c" exitCode=0
Aug 05 16:29:36.791881 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:36.791557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk" event={"ID":"f8020f8a-3144-4c24-8034-1bcd5b46bb44","Type":"ContainerDied","Data":"d461adbf875892f23f985ca965a185cda5c1085f9dfa71ab1078d1209038e43c"}
Aug 05 16:29:37.797949 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:37.797869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk" event={"ID":"f8020f8a-3144-4c24-8034-1bcd5b46bb44","Type":"ContainerStarted","Data":"0dca0b3d7b452b88cd25acc7885c763fff49b80aef2913d6e0f5c7a0a64dd8f3"}
Aug 05 16:29:37.798318 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:37.798021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:37.821026 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:37.820959    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk" podStartSLOduration=2.212934556 podStartE2EDuration="6.820944715s" totalImagesPullingTime="3.560211388s" totalInitContainerRuntime="1.047798771s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:29:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:29:37.819392084 +0000 UTC m=+436.326283797" watchObservedRunningTime="2026-08-05 16:29:37.820944715 +0000 UTC m=+436.327836427"
Aug 05 16:29:48.805177 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:48.805106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cfc779b6-m9fbk"
Aug 05 16:29:51.057961 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.057933    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"]
Aug 05 16:29:51.067451 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.067428    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.070490 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.070357    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-db945\""
Aug 05 16:29:51.071582 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.071558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 05 16:29:51.071686 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.071586    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 05 16:29:51.071882 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.071860    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"]
Aug 05 16:29:51.216108 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.216071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-tmp\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.216295 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.216141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-tls-certs\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.216295 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.216202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssgx\" (UniqueName: \"kubernetes.io/projected/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-kube-api-access-jssgx\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.317025 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.316936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-tls-certs\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.317025 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.316998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jssgx\" (UniqueName: \"kubernetes.io/projected/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-kube-api-access-jssgx\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.317219 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.317045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-tmp\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.319186 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.319167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-tmp\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.319505 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.319485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-tls-certs\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.324447 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.324425    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssgx\" (UniqueName: \"kubernetes.io/projected/7dcb32ce-e6e4-4150-a0f3-41407ee4fd29-kube-api-access-jssgx\") pod \"kube-auth-proxy-65879f568d-mb5rv\" (UID: \"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29\") " pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.378131 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.378100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"
Aug 05 16:29:51.508097 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.508077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65879f568d-mb5rv"]
Aug 05 16:29:51.510528 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:29:51.510503    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcb32ce_e6e4_4150_a0f3_41407ee4fd29.slice/crio-b6f5627016259455f789454b1fae252d083f782e9e07645c9aca33a8fb363a1d WatchSource:0}: Error finding container b6f5627016259455f789454b1fae252d083f782e9e07645c9aca33a8fb363a1d: Status 404 returned error can't find the container with id b6f5627016259455f789454b1fae252d083f782e9e07645c9aca33a8fb363a1d
Aug 05 16:29:51.858900 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:51.858859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv" event={"ID":"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29","Type":"ContainerStarted","Data":"b6f5627016259455f789454b1fae252d083f782e9e07645c9aca33a8fb363a1d"}
Aug 05 16:29:52.471599 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.471569    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"]
Aug 05 16:29:52.475534 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.475515    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.478974 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.478950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 05 16:29:52.479088 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.479009    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 05 16:29:52.479088 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.479010    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 05 16:29:52.479175 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.479015    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gjzpv\""
Aug 05 16:29:52.479320 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.479303    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 16:29:52.501767 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.501743    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"]
Aug 05 16:29:52.627647 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.627605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.627838 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.627681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.627838 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.627711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.627838 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.627735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/100cde20-02fb-4902-a1fb-d6fda36cdc74-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.627838 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.627791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.628071 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.627841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rd7d\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-kube-api-access-9rd7d\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.628071 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.627878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729210 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729210 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729437 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729437 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/100cde20-02fb-4902-a1fb-d6fda36cdc74-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729437 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729437 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rd7d\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-kube-api-access-9rd7d\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729437 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.729972 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.729793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.732643 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.732595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.733019 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.732969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/100cde20-02fb-4902-a1fb-d6fda36cdc74-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.733019 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.733010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.733190 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.733038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.739441 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.739416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.740630 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.740606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rd7d\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-kube-api-access-9rd7d\") pod \"istiod-openshift-gateway-7b7995d5cd-fc55k\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.785212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.785169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:52.955570 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:52.955496    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"]
Aug 05 16:29:53.875631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:53.875587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k" event={"ID":"100cde20-02fb-4902-a1fb-d6fda36cdc74","Type":"ContainerStarted","Data":"e2b19ab9bd00a99050e4ed751cbf62e45b5fcd9c9355d936d2fb949c3e9c0e88"}
Aug 05 16:29:55.887647 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:55.887611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv" event={"ID":"7dcb32ce-e6e4-4150-a0f3-41407ee4fd29","Type":"ContainerStarted","Data":"5a30a3d7fba039ccc65e37c5be66c3ab3ec1af071f5b15a51fc963283ced885e"}
Aug 05 16:29:55.903319 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:55.903266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65879f568d-mb5rv" podStartSLOduration=1.55795144 podStartE2EDuration="4.903250427s" totalImagesPullingTime="3.345298987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:29:55.902438935 +0000 UTC m=+454.409330649" watchObservedRunningTime="2026-08-05 16:29:55.903250427 +0000 UTC m=+454.410142138"
Aug 05 16:29:56.635738 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:56.635691    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:29:56.635832 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:56.635773    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:29:56.893776 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:56.893690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k" event={"ID":"100cde20-02fb-4902-a1fb-d6fda36cdc74","Type":"ContainerStarted","Data":"c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f"}
Aug 05 16:29:56.915209 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:56.915166    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k" podStartSLOduration=1.241814154 podStartE2EDuration="4.915149664s" totalImagesPullingTime="3.67333551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:29:56.912890079 +0000 UTC m=+455.419781794" watchObservedRunningTime="2026-08-05 16:29:56.915149664 +0000 UTC m=+455.422041376"
Aug 05 16:29:57.898293 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:57.898255    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:29:57.900067 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:29:57.900043    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:30:01.973459 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.973426    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"]
Aug 05 16:30:01.977024 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.977004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:01.979630 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.979604    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 05 16:30:01.979774 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.979610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2lkq5\""
Aug 05 16:30:01.989162 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.989138    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"]
Aug 05 16:30:01.992392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.992369    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:01.993747 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.993724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"]
Aug 05 16:30:01.994593 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.994570    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 05 16:30:01.994675 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.994575    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tb29l\""
Aug 05 16:30:01.999235 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:01.999212    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"]
Aug 05 16:30:02.121158 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.121119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37ff8c29-1e2a-4da0-892a-1c99c684c552-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jggqf\" (UID: \"37ff8c29-1e2a-4da0-892a-1c99c684c552\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:02.121355 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.121213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89st5\" (UniqueName: \"kubernetes.io/projected/37ff8c29-1e2a-4da0-892a-1c99c684c552-kube-api-access-89st5\") pod \"llmisvc-controller-manager-777c6bd7d5-jggqf\" (UID: \"37ff8c29-1e2a-4da0-892a-1c99c684c552\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:02.121355 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.121244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ntv\" (UniqueName: \"kubernetes.io/projected/57cb29a0-cb0a-4ecd-9287-287eb2edbc7a-kube-api-access-98ntv\") pod \"kserve-controller-manager-d6f4b65b8-pmbs6\" (UID: \"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:02.121355 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.121316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57cb29a0-cb0a-4ecd-9287-287eb2edbc7a-cert\") pod \"kserve-controller-manager-d6f4b65b8-pmbs6\" (UID: \"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:02.222757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.222715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89st5\" (UniqueName: \"kubernetes.io/projected/37ff8c29-1e2a-4da0-892a-1c99c684c552-kube-api-access-89st5\") pod \"llmisvc-controller-manager-777c6bd7d5-jggqf\" (UID: \"37ff8c29-1e2a-4da0-892a-1c99c684c552\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:02.222757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.222765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ntv\" (UniqueName: \"kubernetes.io/projected/57cb29a0-cb0a-4ecd-9287-287eb2edbc7a-kube-api-access-98ntv\") pod \"kserve-controller-manager-d6f4b65b8-pmbs6\" (UID: \"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:02.223085 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.222827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57cb29a0-cb0a-4ecd-9287-287eb2edbc7a-cert\") pod \"kserve-controller-manager-d6f4b65b8-pmbs6\" (UID: \"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:02.223085 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.222866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37ff8c29-1e2a-4da0-892a-1c99c684c552-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jggqf\" (UID: \"37ff8c29-1e2a-4da0-892a-1c99c684c552\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:02.225631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.225566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57cb29a0-cb0a-4ecd-9287-287eb2edbc7a-cert\") pod \"kserve-controller-manager-d6f4b65b8-pmbs6\" (UID: \"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:02.225631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.225567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37ff8c29-1e2a-4da0-892a-1c99c684c552-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jggqf\" (UID: \"37ff8c29-1e2a-4da0-892a-1c99c684c552\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:02.234739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.234706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89st5\" (UniqueName: \"kubernetes.io/projected/37ff8c29-1e2a-4da0-892a-1c99c684c552-kube-api-access-89st5\") pod \"llmisvc-controller-manager-777c6bd7d5-jggqf\" (UID: \"37ff8c29-1e2a-4da0-892a-1c99c684c552\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:02.234929 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.234906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ntv\" (UniqueName: \"kubernetes.io/projected/57cb29a0-cb0a-4ecd-9287-287eb2edbc7a-kube-api-access-98ntv\") pod \"kserve-controller-manager-d6f4b65b8-pmbs6\" (UID: \"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:02.287083 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.287041    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:02.305087 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.305058    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:02.441026 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.440918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"]
Aug 05 16:30:02.445269 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:30:02.445240    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cb29a0_cb0a_4ecd_9287_287eb2edbc7a.slice/crio-df1ac90659b9085c6b9118120b13fd3dbf4748d3c408e739404c2f975ce9fc0c WatchSource:0}: Error finding container df1ac90659b9085c6b9118120b13fd3dbf4748d3c408e739404c2f975ce9fc0c: Status 404 returned error can't find the container with id df1ac90659b9085c6b9118120b13fd3dbf4748d3c408e739404c2f975ce9fc0c
Aug 05 16:30:02.466257 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.466231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"]
Aug 05 16:30:02.469086 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:30:02.469050    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod37ff8c29_1e2a_4da0_892a_1c99c684c552.slice/crio-24471eb2afda0b7c7c73c4a6a3b435282614bc0ab55f16c1c99d57e5fcf77507 WatchSource:0}: Error finding container 24471eb2afda0b7c7c73c4a6a3b435282614bc0ab55f16c1c99d57e5fcf77507: Status 404 returned error can't find the container with id 24471eb2afda0b7c7c73c4a6a3b435282614bc0ab55f16c1c99d57e5fcf77507
Aug 05 16:30:02.920778 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.920739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf" event={"ID":"37ff8c29-1e2a-4da0-892a-1c99c684c552","Type":"ContainerStarted","Data":"24471eb2afda0b7c7c73c4a6a3b435282614bc0ab55f16c1c99d57e5fcf77507"}
Aug 05 16:30:02.921895 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:02.921868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6" event={"ID":"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a","Type":"ContainerStarted","Data":"df1ac90659b9085c6b9118120b13fd3dbf4748d3c408e739404c2f975ce9fc0c"}
Aug 05 16:30:05.770829 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:05.770797    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"]
Aug 05 16:30:05.771292 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:05.771019    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k" podUID="100cde20-02fb-4902-a1fb-d6fda36cdc74" containerName="discovery" containerID="cri-o://c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f" gracePeriod=30
Aug 05 16:30:05.940671 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:05.940629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6" event={"ID":"57cb29a0-cb0a-4ecd-9287-287eb2edbc7a","Type":"ContainerStarted","Data":"e91777c1d63265a88f876f977ae75a9b6c5d6a8be8ea978d88b26c65c81692bd"}
Aug 05 16:30:05.940862 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:05.940715    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:05.961590 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:05.961530    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6" podStartSLOduration=2.199285755 podStartE2EDuration="4.961510488s" totalImagesPullingTime="2.762224733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:30:05.959756741 +0000 UTC m=+464.466648456" watchObservedRunningTime="2026-08-05 16:30:05.961510488 +0000 UTC m=+464.468402203"
Aug 05 16:30:06.214224 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.214198    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:30:06.261273 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261236    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-token\") pod \"100cde20-02fb-4902-a1fb-d6fda36cdc74\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") "
Aug 05 16:30:06.261426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-ca-configmap\") pod \"100cde20-02fb-4902-a1fb-d6fda36cdc74\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") "
Aug 05 16:30:06.261426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261413    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-dns-cert\") pod \"100cde20-02fb-4902-a1fb-d6fda36cdc74\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") "
Aug 05 16:30:06.261522 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261443    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-cacerts\") pod \"100cde20-02fb-4902-a1fb-d6fda36cdc74\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") "
Aug 05 16:30:06.261522 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rd7d\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-kube-api-access-9rd7d\") pod \"100cde20-02fb-4902-a1fb-d6fda36cdc74\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") "
Aug 05 16:30:06.261522 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261492    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-kubeconfig\") pod \"100cde20-02fb-4902-a1fb-d6fda36cdc74\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") "
Aug 05 16:30:06.261667 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261520    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/100cde20-02fb-4902-a1fb-d6fda36cdc74-local-certs\") pod \"100cde20-02fb-4902-a1fb-d6fda36cdc74\" (UID: \"100cde20-02fb-4902-a1fb-d6fda36cdc74\") "
Aug 05 16:30:06.261826 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.261769    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "100cde20-02fb-4902-a1fb-d6fda36cdc74" (UID: "100cde20-02fb-4902-a1fb-d6fda36cdc74"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:30:06.263897 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.263871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-cacerts" (OuterVolumeSpecName: "cacerts") pod "100cde20-02fb-4902-a1fb-d6fda36cdc74" (UID: "100cde20-02fb-4902-a1fb-d6fda36cdc74"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:30:06.264087 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.264061    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-kube-api-access-9rd7d" (OuterVolumeSpecName: "kube-api-access-9rd7d") pod "100cde20-02fb-4902-a1fb-d6fda36cdc74" (UID: "100cde20-02fb-4902-a1fb-d6fda36cdc74"). InnerVolumeSpecName "kube-api-access-9rd7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:30:06.264147 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.264089    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-token" (OuterVolumeSpecName: "istio-token") pod "100cde20-02fb-4902-a1fb-d6fda36cdc74" (UID: "100cde20-02fb-4902-a1fb-d6fda36cdc74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:30:06.264147 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.264101    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "100cde20-02fb-4902-a1fb-d6fda36cdc74" (UID: "100cde20-02fb-4902-a1fb-d6fda36cdc74"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:30:06.264239 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.264223    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100cde20-02fb-4902-a1fb-d6fda36cdc74-local-certs" (OuterVolumeSpecName: "local-certs") pod "100cde20-02fb-4902-a1fb-d6fda36cdc74" (UID: "100cde20-02fb-4902-a1fb-d6fda36cdc74"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:30:06.265265 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.265245    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "100cde20-02fb-4902-a1fb-d6fda36cdc74" (UID: "100cde20-02fb-4902-a1fb-d6fda36cdc74"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:30:06.363201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.363106    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-ca-configmap\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:30:06.363201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.363143    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-csr-dns-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:30:06.363201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.363156    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-cacerts\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:30:06.363201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.363168    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rd7d\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-kube-api-access-9rd7d\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:30:06.363201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.363182    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-kubeconfig\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:30:06.363201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.363193    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/100cde20-02fb-4902-a1fb-d6fda36cdc74-local-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:30:06.363201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.363203    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100cde20-02fb-4902-a1fb-d6fda36cdc74-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:30:06.947320 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.947275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf" event={"ID":"37ff8c29-1e2a-4da0-892a-1c99c684c552","Type":"ContainerStarted","Data":"b2821e01e6a48d626be992c84f670cb17e5bd9c51849052d88e00c433c7fb179"}
Aug 05 16:30:06.947863 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.947385    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:30:06.948663 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.948640    2576 generic.go:356] "Generic (PLEG): container finished" podID="100cde20-02fb-4902-a1fb-d6fda36cdc74" containerID="c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f" exitCode=0
Aug 05 16:30:06.948775 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.948684    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"
Aug 05 16:30:06.948775 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.948716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k" event={"ID":"100cde20-02fb-4902-a1fb-d6fda36cdc74","Type":"ContainerDied","Data":"c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f"}
Aug 05 16:30:06.948775 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.948754    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k" event={"ID":"100cde20-02fb-4902-a1fb-d6fda36cdc74","Type":"ContainerDied","Data":"e2b19ab9bd00a99050e4ed751cbf62e45b5fcd9c9355d936d2fb949c3e9c0e88"}
Aug 05 16:30:06.948775 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.948775    2576 scope.go:117] "RemoveContainer" containerID="c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f"
Aug 05 16:30:06.957321 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.957304    2576 scope.go:117] "RemoveContainer" containerID="c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f"
Aug 05 16:30:06.957595 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:30:06.957573    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f\": container with ID starting with c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f not found: ID does not exist" containerID="c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f"
Aug 05 16:30:06.957664 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.957602    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f"} err="failed to get container status \"c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f\": rpc error: code = NotFound desc = could not find container \"c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f\": container with ID starting with c2ec8d17cb4a89a848562bbc5f67a26b292b74c6fcc7e17d89551cfa7b65090f not found: ID does not exist"
Aug 05 16:30:06.963901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.963863    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf" podStartSLOduration=2.302664701 podStartE2EDuration="5.96385074s" totalImagesPullingTime="3.661186039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:30:06.963230526 +0000 UTC m=+465.470122272" watchObservedRunningTime="2026-08-05 16:30:06.96385074 +0000 UTC m=+465.470742453"
Aug 05 16:30:06.979340 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.979311    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"]
Aug 05 16:30:06.981504 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:06.981481    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fc55k"]
Aug 05 16:30:07.989759 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:07.989722    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="100cde20-02fb-4902-a1fb-d6fda36cdc74" path="/var/lib/kubelet/pods/100cde20-02fb-4902-a1fb-d6fda36cdc74/volumes"
Aug 05 16:30:36.954734 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:36.954701    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pmbs6"
Aug 05 16:30:37.957121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:30:37.957090    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jggqf"
Aug 05 16:31:07.453789 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.453755    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-g72bj"]
Aug 05 16:31:07.454245 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.454093    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100cde20-02fb-4902-a1fb-d6fda36cdc74" containerName="discovery"
Aug 05 16:31:07.454245 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.454105    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="100cde20-02fb-4902-a1fb-d6fda36cdc74" containerName="discovery"
Aug 05 16:31:07.454245 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.454166    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="100cde20-02fb-4902-a1fb-d6fda36cdc74" containerName="discovery"
Aug 05 16:31:07.456871 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.456853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-g72bj"
Aug 05 16:31:07.459480 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.459458    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2nmxq\""
Aug 05 16:31:07.460054 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.460035    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 16:31:07.460471 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.460457    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 16:31:07.471463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.471444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-g72bj"]
Aug 05 16:31:07.478476 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.478454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fflt5\" (UniqueName: \"kubernetes.io/projected/4b615823-dcef-4a57-a65b-42b434f83046-kube-api-access-fflt5\") pod \"authorino-operator-68d88948d8-g72bj\" (UID: \"4b615823-dcef-4a57-a65b-42b434f83046\") " pod="kuadrant-system/authorino-operator-68d88948d8-g72bj"
Aug 05 16:31:07.579567 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.579535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fflt5\" (UniqueName: \"kubernetes.io/projected/4b615823-dcef-4a57-a65b-42b434f83046-kube-api-access-fflt5\") pod \"authorino-operator-68d88948d8-g72bj\" (UID: \"4b615823-dcef-4a57-a65b-42b434f83046\") " pod="kuadrant-system/authorino-operator-68d88948d8-g72bj"
Aug 05 16:31:07.599654 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.599627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fflt5\" (UniqueName: \"kubernetes.io/projected/4b615823-dcef-4a57-a65b-42b434f83046-kube-api-access-fflt5\") pod \"authorino-operator-68d88948d8-g72bj\" (UID: \"4b615823-dcef-4a57-a65b-42b434f83046\") " pod="kuadrant-system/authorino-operator-68d88948d8-g72bj"
Aug 05 16:31:07.767146 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.767067    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-g72bj"
Aug 05 16:31:07.901272 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:07.901241    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-g72bj"]
Aug 05 16:31:07.903589 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:07.903559    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b615823_dcef_4a57_a65b_42b434f83046.slice/crio-06a1631f4d733e5b5825e495ceadbcb6d5e631265a0bb90a5b3e76fffa34c10f WatchSource:0}: Error finding container 06a1631f4d733e5b5825e495ceadbcb6d5e631265a0bb90a5b3e76fffa34c10f: Status 404 returned error can't find the container with id 06a1631f4d733e5b5825e495ceadbcb6d5e631265a0bb90a5b3e76fffa34c10f
Aug 05 16:31:08.215917 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:08.215883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-g72bj" event={"ID":"4b615823-dcef-4a57-a65b-42b434f83046","Type":"ContainerStarted","Data":"06a1631f4d733e5b5825e495ceadbcb6d5e631265a0bb90a5b3e76fffa34c10f"}
Aug 05 16:31:09.644946 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.644916    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"]
Aug 05 16:31:09.649916 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.649849    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:09.652407 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.652192    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sq92t\""
Aug 05 16:31:09.659893 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.659872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"]
Aug 05 16:31:09.700488 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.700438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6b9w\" (UniqueName: \"kubernetes.io/projected/d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d-kube-api-access-g6b9w\") pod \"limitador-operator-controller-manager-6c549b6d85-kcp82\" (UID: \"d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:09.801908 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.801870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6b9w\" (UniqueName: \"kubernetes.io/projected/d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d-kube-api-access-g6b9w\") pod \"limitador-operator-controller-manager-6c549b6d85-kcp82\" (UID: \"d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:09.815762 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.815735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6b9w\" (UniqueName: \"kubernetes.io/projected/d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d-kube-api-access-g6b9w\") pod \"limitador-operator-controller-manager-6c549b6d85-kcp82\" (UID: \"d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:09.962731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:09.962641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:10.701845 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:10.701819    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"]
Aug 05 16:31:10.703030 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:10.702997    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5df3f90_c312_45ea_b0c9_32b7b8dc2d6d.slice/crio-760d2dce9f75bf0839f7acbab04c12d6587d5120459d611b80dbf8333fee20df WatchSource:0}: Error finding container 760d2dce9f75bf0839f7acbab04c12d6587d5120459d611b80dbf8333fee20df: Status 404 returned error can't find the container with id 760d2dce9f75bf0839f7acbab04c12d6587d5120459d611b80dbf8333fee20df
Aug 05 16:31:11.232246 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:11.232207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82" event={"ID":"d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d","Type":"ContainerStarted","Data":"760d2dce9f75bf0839f7acbab04c12d6587d5120459d611b80dbf8333fee20df"}
Aug 05 16:31:11.233708 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:11.233683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-g72bj" event={"ID":"4b615823-dcef-4a57-a65b-42b434f83046","Type":"ContainerStarted","Data":"c3fb5b2c5265bfea4910fc889d8ae20c836703e540afbf60ef0e886f8f4e9890"}
Aug 05 16:31:11.233835 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:11.233813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-g72bj"
Aug 05 16:31:11.299098 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:11.299051    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-g72bj" podStartSLOduration=1.570789762 podStartE2EDuration="4.299034432s" totalImagesPullingTime="2.72824467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:11.298726663 +0000 UTC m=+529.805618384" watchObservedRunningTime="2026-08-05 16:31:11.299034432 +0000 UTC m=+529.805926145"
Aug 05 16:31:13.244926 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:13.244890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82" event={"ID":"d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d","Type":"ContainerStarted","Data":"0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f"}
Aug 05 16:31:13.245313 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:13.244958    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:13.263090 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:13.263037    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82" podStartSLOduration=2.271721811 podStartE2EDuration="4.263023322s" totalImagesPullingTime="1.991301511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:13.261623753 +0000 UTC m=+531.768515464" watchObservedRunningTime="2026-08-05 16:31:13.263023322 +0000 UTC m=+531.769915034"
Aug 05 16:31:14.029182 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.029145    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"]
Aug 05 16:31:14.032637 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.032614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.035209 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.035189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5c7kl\""
Aug 05 16:31:14.053060 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.053034    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"]
Aug 05 16:31:14.141588 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.141508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbx5f\" (UniqueName: \"kubernetes.io/projected/88e2a391-375e-4a6b-ab26-06584690efb5-kube-api-access-hbx5f\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.141588 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.141558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88e2a391-375e-4a6b-ab26-06584690efb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.242769 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.242734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbx5f\" (UniqueName: \"kubernetes.io/projected/88e2a391-375e-4a6b-ab26-06584690efb5-kube-api-access-hbx5f\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.242939 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.242781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88e2a391-375e-4a6b-ab26-06584690efb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.243227 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.243201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88e2a391-375e-4a6b-ab26-06584690efb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.252808 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.252777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbx5f\" (UniqueName: \"kubernetes.io/projected/88e2a391-375e-4a6b-ab26-06584690efb5-kube-api-access-hbx5f\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.342951 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.342857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:14.473500 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:14.473466    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"]
Aug 05 16:31:14.477002 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:14.476967    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e2a391_375e_4a6b_ab26_06584690efb5.slice/crio-393e33207a277a844c6ac8acc8740f2c2607e6dee555570b93909fda8fea0813 WatchSource:0}: Error finding container 393e33207a277a844c6ac8acc8740f2c2607e6dee555570b93909fda8fea0813: Status 404 returned error can't find the container with id 393e33207a277a844c6ac8acc8740f2c2607e6dee555570b93909fda8fea0813
Aug 05 16:31:15.254995 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:15.254958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz" event={"ID":"88e2a391-375e-4a6b-ab26-06584690efb5","Type":"ContainerStarted","Data":"393e33207a277a844c6ac8acc8740f2c2607e6dee555570b93909fda8fea0813"}
Aug 05 16:31:16.068751 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.068719    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"]
Aug 05 16:31:16.074868 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.074846    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"
Aug 05 16:31:16.077528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.077511    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4hdts\""
Aug 05 16:31:16.077617 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.077514    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 05 16:31:16.090578 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.090531    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"]
Aug 05 16:31:16.160916 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.160873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2t4x\" (UniqueName: \"kubernetes.io/projected/a7416d14-acd6-4cc1-a0a6-0eb325c9da27-kube-api-access-m2t4x\") pod \"dns-operator-controller-manager-5985564776-pbk8f\" (UID: \"a7416d14-acd6-4cc1-a0a6-0eb325c9da27\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"
Aug 05 16:31:16.261518 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.261481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2t4x\" (UniqueName: \"kubernetes.io/projected/a7416d14-acd6-4cc1-a0a6-0eb325c9da27-kube-api-access-m2t4x\") pod \"dns-operator-controller-manager-5985564776-pbk8f\" (UID: \"a7416d14-acd6-4cc1-a0a6-0eb325c9da27\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"
Aug 05 16:31:16.280625 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.280588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2t4x\" (UniqueName: \"kubernetes.io/projected/a7416d14-acd6-4cc1-a0a6-0eb325c9da27-kube-api-access-m2t4x\") pod \"dns-operator-controller-manager-5985564776-pbk8f\" (UID: \"a7416d14-acd6-4cc1-a0a6-0eb325c9da27\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"
Aug 05 16:31:16.389698 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.389665    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"
Aug 05 16:31:16.537390 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:16.537350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"]
Aug 05 16:31:16.541177 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:16.541136    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7416d14_acd6_4cc1_a0a6_0eb325c9da27.slice/crio-eac6dc0b2a3a95f64874ac88fbb3ec944458b264b883e5d2bc404d192915d26a WatchSource:0}: Error finding container eac6dc0b2a3a95f64874ac88fbb3ec944458b264b883e5d2bc404d192915d26a: Status 404 returned error can't find the container with id eac6dc0b2a3a95f64874ac88fbb3ec944458b264b883e5d2bc404d192915d26a
Aug 05 16:31:17.271732 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:17.271693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f" event={"ID":"a7416d14-acd6-4cc1-a0a6-0eb325c9da27","Type":"ContainerStarted","Data":"eac6dc0b2a3a95f64874ac88fbb3ec944458b264b883e5d2bc404d192915d26a"}
Aug 05 16:31:19.283815 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:19.283786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz" event={"ID":"88e2a391-375e-4a6b-ab26-06584690efb5","Type":"ContainerStarted","Data":"22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3"}
Aug 05 16:31:19.284118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:19.283938    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:19.308684 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:19.308640    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz" podStartSLOduration=2.400795089 podStartE2EDuration="6.308622147s" totalImagesPullingTime="3.907827058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:19.306545195 +0000 UTC m=+537.813436919" watchObservedRunningTime="2026-08-05 16:31:19.308622147 +0000 UTC m=+537.815513858"
Aug 05 16:31:20.291252 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:20.291214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f" event={"ID":"a7416d14-acd6-4cc1-a0a6-0eb325c9da27","Type":"ContainerStarted","Data":"4a4969bc4e34843fe791392f4fa7c3fa3526b755561fc3a76065f5454eac31f2"}
Aug 05 16:31:20.291639 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:20.291286    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"
Aug 05 16:31:20.313414 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:20.313367    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f" podStartSLOduration=1.614714936 podStartE2EDuration="4.313352193s" totalImagesPullingTime="2.698637257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:20.311449836 +0000 UTC m=+538.818341548" watchObservedRunningTime="2026-08-05 16:31:20.313352193 +0000 UTC m=+538.820243907"
Aug 05 16:31:21.158155 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.158121    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"]
Aug 05 16:31:21.161601 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.161581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.163679 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.163649    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 05 16:31:21.163679 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.163674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 05 16:31:21.163809 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.163706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fxgch\""
Aug 05 16:31:21.167325 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.167304    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"]
Aug 05 16:31:21.307110 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.307078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.307110 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.307115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.307495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.307152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95vdq\" (UniqueName: \"kubernetes.io/projected/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-kube-api-access-95vdq\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.408526 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.408434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.408526 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.408504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95vdq\" (UniqueName: \"kubernetes.io/projected/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-kube-api-access-95vdq\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.408760 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.408636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.409166 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.409140    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.410975 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.410955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.416488 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.416465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95vdq\" (UniqueName: \"kubernetes.io/projected/f301ba05-a7bf-4397-9c18-c8f8d0787cb0-kube-api-access-95vdq\") pod \"kuadrant-console-plugin-598f86468b-jrhc7\" (UID: \"f301ba05-a7bf-4397-9c18-c8f8d0787cb0\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.483126 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.483090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"
Aug 05 16:31:21.614481 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:21.614459    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7"]
Aug 05 16:31:21.616640 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:21.616611    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf301ba05_a7bf_4397_9c18_c8f8d0787cb0.slice/crio-57aef7ce19d1df1fa2dfeb8b8e3980e9a8f584eeb63c6be77985da39b44cc990 WatchSource:0}: Error finding container 57aef7ce19d1df1fa2dfeb8b8e3980e9a8f584eeb63c6be77985da39b44cc990: Status 404 returned error can't find the container with id 57aef7ce19d1df1fa2dfeb8b8e3980e9a8f584eeb63c6be77985da39b44cc990
Aug 05 16:31:22.241059 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:22.241030    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-g72bj"
Aug 05 16:31:22.301830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:22.301790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7" event={"ID":"f301ba05-a7bf-4397-9c18-c8f8d0787cb0","Type":"ContainerStarted","Data":"57aef7ce19d1df1fa2dfeb8b8e3980e9a8f584eeb63c6be77985da39b44cc990"}
Aug 05 16:31:24.252616 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:24.252583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:28.335164 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:28.335122    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7" event={"ID":"f301ba05-a7bf-4397-9c18-c8f8d0787cb0","Type":"ContainerStarted","Data":"66e502bc0c1f6787a5805f0e2cca3bacb0c08abf41cab5dce7f1ee8b98c68279"}
Aug 05 16:31:28.349504 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:28.349459    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jrhc7" podStartSLOduration=0.846581987 podStartE2EDuration="7.349445836s" totalImagesPullingTime="6.502863849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:28.349413026 +0000 UTC m=+546.856304737" watchObservedRunningTime="2026-08-05 16:31:28.349445836 +0000 UTC m=+546.856337547"
Aug 05 16:31:30.293411 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:30.293380    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:31.298552 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.298518    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-pbk8f"
Aug 05 16:31:31.342786 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.342748    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"]
Aug 05 16:31:31.346473 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.346452    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.362155 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.362123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"]
Aug 05 16:31:31.501378 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.501341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9p89\" (UniqueName: \"kubernetes.io/projected/40ba558a-fc0b-4e1b-aee3-d4a258367915-kube-api-access-m9p89\") pod \"kuadrant-operator-controller-manager-96db98c47-mb46j\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.501554 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.501387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ba558a-fc0b-4e1b-aee3-d4a258367915-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-mb46j\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.602746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.602652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9p89\" (UniqueName: \"kubernetes.io/projected/40ba558a-fc0b-4e1b-aee3-d4a258367915-kube-api-access-m9p89\") pod \"kuadrant-operator-controller-manager-96db98c47-mb46j\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.602746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.602714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ba558a-fc0b-4e1b-aee3-d4a258367915-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-mb46j\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.603127 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.603110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ba558a-fc0b-4e1b-aee3-d4a258367915-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-mb46j\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.617712 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.617682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9p89\" (UniqueName: \"kubernetes.io/projected/40ba558a-fc0b-4e1b-aee3-d4a258367915-kube-api-access-m9p89\") pod \"kuadrant-operator-controller-manager-96db98c47-mb46j\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.657368 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.657337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:31.797120 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.797088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"]
Aug 05 16:31:31.798965 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:31.798931    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ba558a_fc0b_4e1b_aee3_d4a258367915.slice/crio-ab2eceecc1ca296c7f7f45c3cd243807dda0816f4d0b8cf22d005c7db3d7f7e2 WatchSource:0}: Error finding container ab2eceecc1ca296c7f7f45c3cd243807dda0816f4d0b8cf22d005c7db3d7f7e2: Status 404 returned error can't find the container with id ab2eceecc1ca296c7f7f45c3cd243807dda0816f4d0b8cf22d005c7db3d7f7e2
Aug 05 16:31:31.995353 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.995323    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"]
Aug 05 16:31:31.995568 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:31.995544    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" containerName="manager" containerID="cri-o://22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3" gracePeriod=2
Aug 05 16:31:32.005455 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.005427    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"]
Aug 05 16:31:32.015601 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.015565    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"88e2a391-375e-4a6b-ab26-06584690efb5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-dwlrz\": pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.018849 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.018821    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"]
Aug 05 16:31:32.023830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.023803    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"]
Aug 05 16:31:32.024258 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.024238    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" containerName="manager"
Aug 05 16:31:32.024347 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.024261    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" containerName="manager"
Aug 05 16:31:32.024402 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.024367    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" containerName="manager"
Aug 05 16:31:32.027616 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.027597    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.029800 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.029767    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.043009 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.042958    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"]
Aug 05 16:31:32.044962 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.044939    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"]
Aug 05 16:31:32.052597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.052573    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"]
Aug 05 16:31:32.052937 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.052925    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" containerName="manager"
Aug 05 16:31:32.052996 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.052939    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" containerName="manager"
Aug 05 16:31:32.053037 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.053026    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" containerName="manager"
Aug 05 16:31:32.056273 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.056254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.056505 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.056479    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"]
Aug 05 16:31:32.056710 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.056683    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" containerName="manager" containerID="cri-o://0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f" gracePeriod=2
Aug 05 16:31:32.068342 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.067881    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"]
Aug 05 16:31:32.073819 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.073794    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"]
Aug 05 16:31:32.087617 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.087595    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"]
Aug 05 16:31:32.087762 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.087642    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.088159 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.088140    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" containerName="manager"
Aug 05 16:31:32.088159 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.088161    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" containerName="manager"
Aug 05 16:31:32.088308 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.088283    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" containerName="manager"
Aug 05 16:31:32.089509 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.089482    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.091777 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.091759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"
Aug 05 16:31:32.093732 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.093704    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.095452 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.095425    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.104786 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.104759    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"]
Aug 05 16:31:32.106597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.106399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac08d5a1-7554-4f9a-aa02-5bdab719a753-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5bxjf\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.107084 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.107057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk9wn\" (UniqueName: \"kubernetes.io/projected/ac08d5a1-7554-4f9a-aa02-5bdab719a753-kube-api-access-rk9wn\") pod \"kuadrant-operator-controller-manager-58fc56757c-5bxjf\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.208039 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.207968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n58rq\" (UniqueName: \"kubernetes.io/projected/add611f9-3ee9-44b1-a831-34c751e0d0a5-kube-api-access-n58rq\") pod \"kuadrant-operator-controller-manager-96db98c47-9k6hp\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.208212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.208085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/add611f9-3ee9-44b1-a831-34c751e0d0a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-9k6hp\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.208212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.208135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk9wn\" (UniqueName: \"kubernetes.io/projected/ac08d5a1-7554-4f9a-aa02-5bdab719a753-kube-api-access-rk9wn\") pod \"kuadrant-operator-controller-manager-58fc56757c-5bxjf\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.208212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.208188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw66h\" (UniqueName: \"kubernetes.io/projected/1a89dd82-d12b-4d06-9eba-46c44cbd3759-kube-api-access-zw66h\") pod \"limitador-operator-controller-manager-6c549b6d85-td74n\" (UID: \"1a89dd82-d12b-4d06-9eba-46c44cbd3759\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"
Aug 05 16:31:32.208403 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.208219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac08d5a1-7554-4f9a-aa02-5bdab719a753-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5bxjf\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.208593 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.208573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac08d5a1-7554-4f9a-aa02-5bdab719a753-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-5bxjf\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.218737 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.218709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk9wn\" (UniqueName: \"kubernetes.io/projected/ac08d5a1-7554-4f9a-aa02-5bdab719a753-kube-api-access-rk9wn\") pod \"kuadrant-operator-controller-manager-58fc56757c-5bxjf\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.283097 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.283072    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.285482 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.285455    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.287254 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.287226    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.297671 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.297654    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.299510 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.299482    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.301043 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.301023    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.308773 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.308750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw66h\" (UniqueName: \"kubernetes.io/projected/1a89dd82-d12b-4d06-9eba-46c44cbd3759-kube-api-access-zw66h\") pod \"limitador-operator-controller-manager-6c549b6d85-td74n\" (UID: \"1a89dd82-d12b-4d06-9eba-46c44cbd3759\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"
Aug 05 16:31:32.308879 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.308825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n58rq\" (UniqueName: \"kubernetes.io/projected/add611f9-3ee9-44b1-a831-34c751e0d0a5-kube-api-access-n58rq\") pod \"kuadrant-operator-controller-manager-96db98c47-9k6hp\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.308879 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.308856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/add611f9-3ee9-44b1-a831-34c751e0d0a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-9k6hp\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.309188 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.309173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/add611f9-3ee9-44b1-a831-34c751e0d0a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-9k6hp\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.321415 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.321395    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n58rq\" (UniqueName: \"kubernetes.io/projected/add611f9-3ee9-44b1-a831-34c751e0d0a5-kube-api-access-n58rq\") pod \"kuadrant-operator-controller-manager-96db98c47-9k6hp\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.321485 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.321432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw66h\" (UniqueName: \"kubernetes.io/projected/1a89dd82-d12b-4d06-9eba-46c44cbd3759-kube-api-access-zw66h\") pod \"limitador-operator-controller-manager-6c549b6d85-td74n\" (UID: \"1a89dd82-d12b-4d06-9eba-46c44cbd3759\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"
Aug 05 16:31:32.358104 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.358071    2576 generic.go:356] "Generic (PLEG): container finished" podID="88e2a391-375e-4a6b-ab26-06584690efb5" containerID="22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3" exitCode=0
Aug 05 16:31:32.358207 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.358119    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.358207 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.358172    2576 scope.go:117] "RemoveContainer" containerID="22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3"
Aug 05 16:31:32.359505 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.359485    2576 generic.go:356] "Generic (PLEG): container finished" podID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" containerID="0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f" exitCode=0
Aug 05 16:31:32.359600 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.359522    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.359886 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.359858    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.361203 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.361185    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j" container="manager"
Aug 05 16:31:32.361496 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.361470    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.363503 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.363450    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-mb46j\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:32.365041 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.365012    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.366626 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.366602    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.366927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.366901    2576 scope.go:117] "RemoveContainer" containerID="22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3"
Aug 05 16:31:32.367290 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.367271    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3\": container with ID starting with 22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3 not found: ID does not exist" containerID="22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3"
Aug 05 16:31:32.367341 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.367298    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3"} err="failed to get container status \"22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3\": rpc error: code = NotFound desc = could not find container \"22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3\": container with ID starting with 22d92f1d90d11c586946d7b0d6165d17afc6ce8a5550861ac42bbeb340c498b3 not found: ID does not exist"
Aug 05 16:31:32.367341 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.367319    2576 scope.go:117] "RemoveContainer" containerID="0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f"
Aug 05 16:31:32.375053 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.375035    2576 scope.go:117] "RemoveContainer" containerID="0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f"
Aug 05 16:31:32.375311 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.375293    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f\": container with ID starting with 0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f not found: ID does not exist" containerID="0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f"
Aug 05 16:31:32.375357 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.375318    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f"} err="failed to get container status \"0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f\": rpc error: code = NotFound desc = could not find container \"0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f\": container with ID starting with 0eaf0d9be7496edc11268ac232f9b49bcd885e175f4c862e02c60ac057c50c5f not found: ID does not exist"
Aug 05 16:31:32.408378 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.408353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:32.409513 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.409493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbx5f\" (UniqueName: \"kubernetes.io/projected/88e2a391-375e-4a6b-ab26-06584690efb5-kube-api-access-hbx5f\") pod \"88e2a391-375e-4a6b-ab26-06584690efb5\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") "
Aug 05 16:31:32.409604 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.409592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6b9w\" (UniqueName: \"kubernetes.io/projected/d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d-kube-api-access-g6b9w\") pod \"d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d\" (UID: \"d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d\") "
Aug 05 16:31:32.409661 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.409642    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88e2a391-375e-4a6b-ab26-06584690efb5-extensions-socket-volume\") pod \"88e2a391-375e-4a6b-ab26-06584690efb5\" (UID: \"88e2a391-375e-4a6b-ab26-06584690efb5\") "
Aug 05 16:31:32.410059 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.410037    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88e2a391-375e-4a6b-ab26-06584690efb5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "88e2a391-375e-4a6b-ab26-06584690efb5" (UID: "88e2a391-375e-4a6b-ab26-06584690efb5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:31:32.411723 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.411698    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d-kube-api-access-g6b9w" (OuterVolumeSpecName: "kube-api-access-g6b9w") pod "d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" (UID: "d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d"). InnerVolumeSpecName "kube-api-access-g6b9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:31:32.411784 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.411736    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e2a391-375e-4a6b-ab26-06584690efb5-kube-api-access-hbx5f" (OuterVolumeSpecName: "kube-api-access-hbx5f") pod "88e2a391-375e-4a6b-ab26-06584690efb5" (UID: "88e2a391-375e-4a6b-ab26-06584690efb5"). InnerVolumeSpecName "kube-api-access-hbx5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:31:32.417717 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.417690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:32.423785 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.423764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"
Aug 05 16:31:32.510628 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.510536    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88e2a391-375e-4a6b-ab26-06584690efb5-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:32.510628 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.510568    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbx5f\" (UniqueName: \"kubernetes.io/projected/88e2a391-375e-4a6b-ab26-06584690efb5-kube-api-access-hbx5f\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:32.510628 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.510584    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6b9w\" (UniqueName: \"kubernetes.io/projected/d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d-kube-api-access-g6b9w\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:32.564423 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.564375    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"]
Aug 05 16:31:32.571470 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:32.571336    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac08d5a1_7554_4f9a_aa02_5bdab719a753.slice/crio-179699027f67ec7442b2382c91f380a881861d7a47d4286dd32be2c700588aea WatchSource:0}: Error finding container 179699027f67ec7442b2382c91f380a881861d7a47d4286dd32be2c700588aea: Status 404 returned error can't find the container with id 179699027f67ec7442b2382c91f380a881861d7a47d4286dd32be2c700588aea
Aug 05 16:31:32.670872 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.670840    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-mb46j\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:32.672426 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.672401    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.673956 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.673936    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.675608 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.675584    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:32.677163 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.677134    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:32.678679 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:32.678662    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-mb46j\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:32.806619 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.806584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"]
Aug 05 16:31:32.808547 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:32.808523    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"]
Aug 05 16:31:32.809930 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:32.809887    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a89dd82_d12b_4d06_9eba_46c44cbd3759.slice/crio-1fefa02237d75ad6fc115b28ee9081df6ebf804173178de224aeddcce08f66f3 WatchSource:0}: Error finding container 1fefa02237d75ad6fc115b28ee9081df6ebf804173178de224aeddcce08f66f3: Status 404 returned error can't find the container with id 1fefa02237d75ad6fc115b28ee9081df6ebf804173178de224aeddcce08f66f3
Aug 05 16:31:32.811064 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:32.810882    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd611f9_3ee9_44b1_a831_34c751e0d0a5.slice/crio-4509a458cd4da7231e8773344a33812d19c25a592bdd24c12d75b94f3955c263 WatchSource:0}: Error finding container 4509a458cd4da7231e8773344a33812d19c25a592bdd24c12d75b94f3955c263: Status 404 returned error can't find the container with id 4509a458cd4da7231e8773344a33812d19c25a592bdd24c12d75b94f3955c263
Aug 05 16:31:33.367504 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.367467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n" event={"ID":"1a89dd82-d12b-4d06-9eba-46c44cbd3759","Type":"ContainerStarted","Data":"3bb15269d63deae1ad8d20a0320f735623bf6427bcb777cc83df59cab8df5761"}
Aug 05 16:31:33.368034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.367526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n" event={"ID":"1a89dd82-d12b-4d06-9eba-46c44cbd3759","Type":"ContainerStarted","Data":"1fefa02237d75ad6fc115b28ee9081df6ebf804173178de224aeddcce08f66f3"}
Aug 05 16:31:33.368034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.367576    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"
Aug 05 16:31:33.370001 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.369944    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:33.370169 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.370140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf" event={"ID":"ac08d5a1-7554-4f9a-aa02-5bdab719a753","Type":"ContainerStarted","Data":"2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879"}
Aug 05 16:31:33.370291 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.370190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf" event={"ID":"ac08d5a1-7554-4f9a-aa02-5bdab719a753","Type":"ContainerStarted","Data":"179699027f67ec7442b2382c91f380a881861d7a47d4286dd32be2c700588aea"}
Aug 05 16:31:33.370291 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.370222    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:33.372020 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.371957    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" containerName="manager" containerID="cri-o://51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b" gracePeriod=2
Aug 05 16:31:33.372020 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.372006    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:33.373937 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.373906    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-mb46j\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:33.374733 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.374711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp" event={"ID":"add611f9-3ee9-44b1-a831-34c751e0d0a5","Type":"ContainerStarted","Data":"6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c"}
Aug 05 16:31:33.374822 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.374752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp" event={"ID":"add611f9-3ee9-44b1-a831-34c751e0d0a5","Type":"ContainerStarted","Data":"4509a458cd4da7231e8773344a33812d19c25a592bdd24c12d75b94f3955c263"}
Aug 05 16:31:33.374904 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.374882    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:33.410005 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.409937    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n" podStartSLOduration=1.409919985 podStartE2EDuration="1.409919985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:33.408917251 +0000 UTC m=+551.915808964" watchObservedRunningTime="2026-08-05 16:31:33.409919985 +0000 UTC m=+551.916811697"
Aug 05 16:31:33.438254 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.438196    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp" podStartSLOduration=1.438175753 podStartE2EDuration="1.438175753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:33.437175607 +0000 UTC m=+551.944067321" watchObservedRunningTime="2026-08-05 16:31:33.438175753 +0000 UTC m=+551.945067470"
Aug 05 16:31:33.439098 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.439074    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:33.440739 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.440717    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:33.470252 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.470199    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf" podStartSLOduration=1.470182051 podStartE2EDuration="1.470182051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:33.469038256 +0000 UTC m=+551.975929990" watchObservedRunningTime="2026-08-05 16:31:33.470182051 +0000 UTC m=+551.977073762"
Aug 05 16:31:33.471706 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.471674    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-mb46j\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:33.609051 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.609027    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:33.611041 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.611011    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-kcp82\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kcp82"
Aug 05 16:31:33.612756 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.612732    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwlrz\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwlrz"
Aug 05 16:31:33.614286 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:33.614264    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-mb46j\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:33.720553 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.720518    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9p89\" (UniqueName: \"kubernetes.io/projected/40ba558a-fc0b-4e1b-aee3-d4a258367915-kube-api-access-m9p89\") pod \"40ba558a-fc0b-4e1b-aee3-d4a258367915\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") "
Aug 05 16:31:33.720709 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.720607    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ba558a-fc0b-4e1b-aee3-d4a258367915-extensions-socket-volume\") pod \"40ba558a-fc0b-4e1b-aee3-d4a258367915\" (UID: \"40ba558a-fc0b-4e1b-aee3-d4a258367915\") "
Aug 05 16:31:33.720793 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.720769    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ba558a-fc0b-4e1b-aee3-d4a258367915-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "40ba558a-fc0b-4e1b-aee3-d4a258367915" (UID: "40ba558a-fc0b-4e1b-aee3-d4a258367915"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:31:33.722506 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.722485    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ba558a-fc0b-4e1b-aee3-d4a258367915-kube-api-access-m9p89" (OuterVolumeSpecName: "kube-api-access-m9p89") pod "40ba558a-fc0b-4e1b-aee3-d4a258367915" (UID: "40ba558a-fc0b-4e1b-aee3-d4a258367915"). InnerVolumeSpecName "kube-api-access-m9p89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:31:33.822128 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.822095    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9p89\" (UniqueName: \"kubernetes.io/projected/40ba558a-fc0b-4e1b-aee3-d4a258367915-kube-api-access-m9p89\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:33.822128 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.822125    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ba558a-fc0b-4e1b-aee3-d4a258367915-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:33.992227 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.992196    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" path="/var/lib/kubelet/pods/40ba558a-fc0b-4e1b-aee3-d4a258367915/volumes"
Aug 05 16:31:33.992562 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.992550    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e2a391-375e-4a6b-ab26-06584690efb5" path="/var/lib/kubelet/pods/88e2a391-375e-4a6b-ab26-06584690efb5/volumes"
Aug 05 16:31:33.992909 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:33.992895    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d" path="/var/lib/kubelet/pods/d5df3f90-c312-45ea-b0c9-32b7b8dc2d6d/volumes"
Aug 05 16:31:34.381463 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:34.381434    2576 generic.go:356] "Generic (PLEG): container finished" podID="40ba558a-fc0b-4e1b-aee3-d4a258367915" containerID="51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b" exitCode=2
Aug 05 16:31:34.381864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:34.381474    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:34.381864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:34.381534    2576 scope.go:117] "RemoveContainer" containerID="51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b"
Aug 05 16:31:34.385798 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:34.385773    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-mb46j\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="40ba558a-fc0b-4e1b-aee3-d4a258367915" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-mb46j"
Aug 05 16:31:34.389837 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:34.389822    2576 scope.go:117] "RemoveContainer" containerID="51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b"
Aug 05 16:31:34.390112 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:34.390091    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b\": container with ID starting with 51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b not found: ID does not exist" containerID="51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b"
Aug 05 16:31:34.390159 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:34.390119    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b"} err="failed to get container status \"51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b\": rpc error: code = NotFound desc = could not find container \"51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b\": container with ID starting with 51f82bb3f03b25325c1c3fe6548a2a992bb8416c0a496b8543ac5f4b3614105b not found: ID does not exist"
Aug 05 16:31:44.384570 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.384536    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-td74n"
Aug 05 16:31:44.384972 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.384621    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:44.384972 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.384666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:44.494825 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.494789    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"]
Aug 05 16:31:44.495061 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.495035    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf" podUID="ac08d5a1-7554-4f9a-aa02-5bdab719a753" containerName="manager" containerID="cri-o://2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879" gracePeriod=10
Aug 05 16:31:44.738028 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.737970    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"]
Aug 05 16:31:44.751631 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.751611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:44.756292 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.756249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"]
Aug 05 16:31:44.790895 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.790875    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:44.818538 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.818514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac08d5a1-7554-4f9a-aa02-5bdab719a753-extensions-socket-volume\") pod \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") "
Aug 05 16:31:44.818687 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.818578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk9wn\" (UniqueName: \"kubernetes.io/projected/ac08d5a1-7554-4f9a-aa02-5bdab719a753-kube-api-access-rk9wn\") pod \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\" (UID: \"ac08d5a1-7554-4f9a-aa02-5bdab719a753\") "
Aug 05 16:31:44.818753 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.818695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c388447c-d1a7-42de-81bf-6bd75ae4fd29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-fv545\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:44.819012 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.818954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac08d5a1-7554-4f9a-aa02-5bdab719a753-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ac08d5a1-7554-4f9a-aa02-5bdab719a753" (UID: "ac08d5a1-7554-4f9a-aa02-5bdab719a753"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:31:44.819012 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.819001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrnpk\" (UniqueName: \"kubernetes.io/projected/c388447c-d1a7-42de-81bf-6bd75ae4fd29-kube-api-access-zrnpk\") pod \"kuadrant-operator-controller-manager-68cf589589-fv545\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:44.819163 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.819152    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac08d5a1-7554-4f9a-aa02-5bdab719a753-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:44.821031 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.821005    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac08d5a1-7554-4f9a-aa02-5bdab719a753-kube-api-access-rk9wn" (OuterVolumeSpecName: "kube-api-access-rk9wn") pod "ac08d5a1-7554-4f9a-aa02-5bdab719a753" (UID: "ac08d5a1-7554-4f9a-aa02-5bdab719a753"). InnerVolumeSpecName "kube-api-access-rk9wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:31:44.919589 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.919502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c388447c-d1a7-42de-81bf-6bd75ae4fd29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-fv545\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:44.919589 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.919561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrnpk\" (UniqueName: \"kubernetes.io/projected/c388447c-d1a7-42de-81bf-6bd75ae4fd29-kube-api-access-zrnpk\") pod \"kuadrant-operator-controller-manager-68cf589589-fv545\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:44.919822 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.919594    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk9wn\" (UniqueName: \"kubernetes.io/projected/ac08d5a1-7554-4f9a-aa02-5bdab719a753-kube-api-access-rk9wn\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:44.919972 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.919946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c388447c-d1a7-42de-81bf-6bd75ae4fd29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-fv545\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:44.933658 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:44.933629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrnpk\" (UniqueName: \"kubernetes.io/projected/c388447c-d1a7-42de-81bf-6bd75ae4fd29-kube-api-access-zrnpk\") pod \"kuadrant-operator-controller-manager-68cf589589-fv545\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:45.080914 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.080877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:45.266424 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.266397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"]
Aug 05 16:31:45.266602 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:31:45.266581    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc388447c_d1a7_42de_81bf_6bd75ae4fd29.slice/crio-e36a0686935dcf81fc34d1a5ca7fe2df52192d39eb116b857988778961e0bb99 WatchSource:0}: Error finding container e36a0686935dcf81fc34d1a5ca7fe2df52192d39eb116b857988778961e0bb99: Status 404 returned error can't find the container with id e36a0686935dcf81fc34d1a5ca7fe2df52192d39eb116b857988778961e0bb99
Aug 05 16:31:45.446505 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.446428    2576 generic.go:356] "Generic (PLEG): container finished" podID="ac08d5a1-7554-4f9a-aa02-5bdab719a753" containerID="2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879" exitCode=0
Aug 05 16:31:45.446505 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.446473    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"
Aug 05 16:31:45.446997 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.446513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf" event={"ID":"ac08d5a1-7554-4f9a-aa02-5bdab719a753","Type":"ContainerDied","Data":"2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879"}
Aug 05 16:31:45.446997 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.446572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf" event={"ID":"ac08d5a1-7554-4f9a-aa02-5bdab719a753","Type":"ContainerDied","Data":"179699027f67ec7442b2382c91f380a881861d7a47d4286dd32be2c700588aea"}
Aug 05 16:31:45.446997 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.446607    2576 scope.go:117] "RemoveContainer" containerID="2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879"
Aug 05 16:31:45.448426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.448398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545" event={"ID":"c388447c-d1a7-42de-81bf-6bd75ae4fd29","Type":"ContainerStarted","Data":"342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba"}
Aug 05 16:31:45.448521 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.448448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545" event={"ID":"c388447c-d1a7-42de-81bf-6bd75ae4fd29","Type":"ContainerStarted","Data":"e36a0686935dcf81fc34d1a5ca7fe2df52192d39eb116b857988778961e0bb99"}
Aug 05 16:31:45.448566 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.448520    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:45.455819 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.455804    2576 scope.go:117] "RemoveContainer" containerID="2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879"
Aug 05 16:31:45.456148 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:45.456129    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879\": container with ID starting with 2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879 not found: ID does not exist" containerID="2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879"
Aug 05 16:31:45.456235 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.456154    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879"} err="failed to get container status \"2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879\": rpc error: code = NotFound desc = could not find container \"2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879\": container with ID starting with 2a416581a26bdf45f7538012286112de0f263f0dcb4621418d622e2f34c91879 not found: ID does not exist"
Aug 05 16:31:45.486907 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.486864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545" podStartSLOduration=1.486852089 podStartE2EDuration="1.486852089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:45.486121643 +0000 UTC m=+563.993013369" watchObservedRunningTime="2026-08-05 16:31:45.486852089 +0000 UTC m=+563.993743801"
Aug 05 16:31:45.519495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.519462    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"]
Aug 05 16:31:45.523921 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.523895    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-5bxjf"]
Aug 05 16:31:45.990883 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:45.990846    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac08d5a1-7554-4f9a-aa02-5bdab719a753" path="/var/lib/kubelet/pods/ac08d5a1-7554-4f9a-aa02-5bdab719a753/volumes"
Aug 05 16:31:56.457498 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.457468    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:31:56.511941 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.511909    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"]
Aug 05 16:31:56.512200 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.512170    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp" podUID="add611f9-3ee9-44b1-a831-34c751e0d0a5" containerName="manager" containerID="cri-o://6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c" gracePeriod=10
Aug 05 16:31:56.758990 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.758925    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:56.826971 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.826941    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/add611f9-3ee9-44b1-a831-34c751e0d0a5-extensions-socket-volume\") pod \"add611f9-3ee9-44b1-a831-34c751e0d0a5\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") "
Aug 05 16:31:56.827145 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.827056    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n58rq\" (UniqueName: \"kubernetes.io/projected/add611f9-3ee9-44b1-a831-34c751e0d0a5-kube-api-access-n58rq\") pod \"add611f9-3ee9-44b1-a831-34c751e0d0a5\" (UID: \"add611f9-3ee9-44b1-a831-34c751e0d0a5\") "
Aug 05 16:31:56.827311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.827289    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add611f9-3ee9-44b1-a831-34c751e0d0a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "add611f9-3ee9-44b1-a831-34c751e0d0a5" (UID: "add611f9-3ee9-44b1-a831-34c751e0d0a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:31:56.829041 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.829019    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add611f9-3ee9-44b1-a831-34c751e0d0a5-kube-api-access-n58rq" (OuterVolumeSpecName: "kube-api-access-n58rq") pod "add611f9-3ee9-44b1-a831-34c751e0d0a5" (UID: "add611f9-3ee9-44b1-a831-34c751e0d0a5"). InnerVolumeSpecName "kube-api-access-n58rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:31:56.927692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.927653    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/add611f9-3ee9-44b1-a831-34c751e0d0a5-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:56.927692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:56.927688    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n58rq\" (UniqueName: \"kubernetes.io/projected/add611f9-3ee9-44b1-a831-34c751e0d0a5-kube-api-access-n58rq\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:31:57.510444 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.510409    2576 generic.go:356] "Generic (PLEG): container finished" podID="add611f9-3ee9-44b1-a831-34c751e0d0a5" containerID="6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c" exitCode=0
Aug 05 16:31:57.510833 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.510464    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"
Aug 05 16:31:57.510833 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.510499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp" event={"ID":"add611f9-3ee9-44b1-a831-34c751e0d0a5","Type":"ContainerDied","Data":"6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c"}
Aug 05 16:31:57.510833 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.510557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp" event={"ID":"add611f9-3ee9-44b1-a831-34c751e0d0a5","Type":"ContainerDied","Data":"4509a458cd4da7231e8773344a33812d19c25a592bdd24c12d75b94f3955c263"}
Aug 05 16:31:57.510833 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.510590    2576 scope.go:117] "RemoveContainer" containerID="6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c"
Aug 05 16:31:57.522571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.521161    2576 scope.go:117] "RemoveContainer" containerID="6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c"
Aug 05 16:31:57.522571 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:31:57.521544    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c\": container with ID starting with 6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c not found: ID does not exist" containerID="6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c"
Aug 05 16:31:57.522571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.521586    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c"} err="failed to get container status \"6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c\": rpc error: code = NotFound desc = could not find container \"6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c\": container with ID starting with 6aa21a50efbc36841ce3e55c612fb49f000a41b18fa6331bb99ee0e49e6bcd6c not found: ID does not exist"
Aug 05 16:31:57.542352 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.542331    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"]
Aug 05 16:31:57.546902 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.546884    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-9k6hp"]
Aug 05 16:31:57.990290 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:31:57.990256    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="add611f9-3ee9-44b1-a831-34c751e0d0a5" path="/var/lib/kubelet/pods/add611f9-3ee9-44b1-a831-34c751e0d0a5/volumes"
Aug 05 16:32:00.862199 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.862163    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"]
Aug 05 16:32:00.862546 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.862520    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac08d5a1-7554-4f9a-aa02-5bdab719a753" containerName="manager"
Aug 05 16:32:00.862546 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.862531    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac08d5a1-7554-4f9a-aa02-5bdab719a753" containerName="manager"
Aug 05 16:32:00.862546 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.862539    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add611f9-3ee9-44b1-a831-34c751e0d0a5" containerName="manager"
Aug 05 16:32:00.862546 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.862545    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="add611f9-3ee9-44b1-a831-34c751e0d0a5" containerName="manager"
Aug 05 16:32:00.862675 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.862602    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="add611f9-3ee9-44b1-a831-34c751e0d0a5" containerName="manager"
Aug 05 16:32:00.862675 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.862613    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac08d5a1-7554-4f9a-aa02-5bdab719a753" containerName="manager"
Aug 05 16:32:00.867020 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.866999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.869370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.869351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5d5vz\""
Aug 05 16:32:00.869483 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.869351    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 16:32:00.877906 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.877884    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"]
Aug 05 16:32:00.965305 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965305 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmq79\" (UniqueName: \"kubernetes.io/projected/06bca3d3-50ae-4d86-8af0-338c929bbdc4-kube-api-access-lmq79\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:00.965519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:00.965488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066391 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066391 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmq79\" (UniqueName: \"kubernetes.io/projected/06bca3d3-50ae-4d86-8af0-338c929bbdc4-kube-api-access-lmq79\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066667 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066701 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066751 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066794 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066834 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066834 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.066834 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.066825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.067077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.067057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.067182 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.067162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.067365 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.067346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.068927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.068903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.069132 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.069115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.074091 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.074066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06bca3d3-50ae-4d86-8af0-338c929bbdc4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.074174 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.074145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmq79\" (UniqueName: \"kubernetes.io/projected/06bca3d3-50ae-4d86-8af0-338c929bbdc4-kube-api-access-lmq79\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkxwq\" (UID: \"06bca3d3-50ae-4d86-8af0-338c929bbdc4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.177290 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.177254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:01.313386 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.313357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"]
Aug 05 16:32:01.314581 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:32:01.314556    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bca3d3_50ae_4d86_8af0_338c929bbdc4.slice/crio-95f0cfdc7d1f671dc080228a63ce50c2ff2336e732f426812162c2975601441a WatchSource:0}: Error finding container 95f0cfdc7d1f671dc080228a63ce50c2ff2336e732f426812162c2975601441a: Status 404 returned error can't find the container with id 95f0cfdc7d1f671dc080228a63ce50c2ff2336e732f426812162c2975601441a
Aug 05 16:32:01.532312 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:01.532230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" event={"ID":"06bca3d3-50ae-4d86-8af0-338c929bbdc4","Type":"ContainerStarted","Data":"95f0cfdc7d1f671dc080228a63ce50c2ff2336e732f426812162c2975601441a"}
Aug 05 16:32:06.339155 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:06.339118    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:32:06.339415 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:06.339206    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:32:06.339415 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:06.339246    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:32:06.560764 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:06.560719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" event={"ID":"06bca3d3-50ae-4d86-8af0-338c929bbdc4","Type":"ContainerStarted","Data":"57a218152b996c3f098aec404abd0587d2ca111ba0ae54fa0621edb4a6a71604"}
Aug 05 16:32:06.581251 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:06.581188    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podStartSLOduration=1.558837137 podStartE2EDuration="6.581168561s" totalImagesPullingTime="5.022331424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:06.57941621 +0000 UTC m=+585.086307942" watchObservedRunningTime="2026-08-05 16:32:06.581168561 +0000 UTC m=+585.088060274"
Aug 05 16:32:07.178169 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:07.178134    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:07.179654 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:07.179625    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkxwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 05 16:32:07.179775 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:07.179677    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podUID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 05 16:32:08.181696 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:08.181665    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:08.570800 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:08.570724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:08.571661 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:08.571642    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:32:17.305687 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.305653    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"]
Aug 05 16:32:17.309162 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.309145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.311404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.311377    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 16:32:17.316652 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.316625    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"]
Aug 05 16:32:17.411598 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.411548    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"]
Aug 05 16:32:17.413014 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.412968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5l9m\" (UniqueName: \"kubernetes.io/projected/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-kube-api-access-v5l9m\") pod \"limitador-limitador-859c4d96d6-xg6hp\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.413121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.413096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-config-file\") pod \"limitador-limitador-859c4d96d6-xg6hp\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.514186 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.514135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-config-file\") pod \"limitador-limitador-859c4d96d6-xg6hp\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.514186 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.514233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5l9m\" (UniqueName: \"kubernetes.io/projected/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-kube-api-access-v5l9m\") pod \"limitador-limitador-859c4d96d6-xg6hp\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.514960 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.514924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-config-file\") pod \"limitador-limitador-859c4d96d6-xg6hp\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.523486 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.523455    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5l9m\" (UniqueName: \"kubernetes.io/projected/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-kube-api-access-v5l9m\") pod \"limitador-limitador-859c4d96d6-xg6hp\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.622304 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.622221    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:17.760679 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:17.760652    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"]
Aug 05 16:32:17.763359 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:32:17.763325    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39414ba_608d_4cb1_b0e2_3d9ebfe207ee.slice/crio-e956ae53d5922d18a8fbfe025806ef666b87ab36979c8718a9dfc362362ee0a8 WatchSource:0}: Error finding container e956ae53d5922d18a8fbfe025806ef666b87ab36979c8718a9dfc362362ee0a8: Status 404 returned error can't find the container with id e956ae53d5922d18a8fbfe025806ef666b87ab36979c8718a9dfc362362ee0a8
Aug 05 16:32:18.149549 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.149513    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-ntfl4"]
Aug 05 16:32:18.153949 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.153927    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-ntfl4"
Aug 05 16:32:18.156665 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.156645    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mh5mq\""
Aug 05 16:32:18.173802 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.173773    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-ntfl4"]
Aug 05 16:32:18.323862 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.323830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6hqm\" (UniqueName: \"kubernetes.io/projected/a5e576c1-1310-475f-8618-d2794381aa4a-kube-api-access-f6hqm\") pod \"authorino-b54df94b4-ntfl4\" (UID: \"a5e576c1-1310-475f-8618-d2794381aa4a\") " pod="kuadrant-system/authorino-b54df94b4-ntfl4"
Aug 05 16:32:18.425198 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.425117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6hqm\" (UniqueName: \"kubernetes.io/projected/a5e576c1-1310-475f-8618-d2794381aa4a-kube-api-access-f6hqm\") pod \"authorino-b54df94b4-ntfl4\" (UID: \"a5e576c1-1310-475f-8618-d2794381aa4a\") " pod="kuadrant-system/authorino-b54df94b4-ntfl4"
Aug 05 16:32:18.433629 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.433596    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6hqm\" (UniqueName: \"kubernetes.io/projected/a5e576c1-1310-475f-8618-d2794381aa4a-kube-api-access-f6hqm\") pod \"authorino-b54df94b4-ntfl4\" (UID: \"a5e576c1-1310-475f-8618-d2794381aa4a\") " pod="kuadrant-system/authorino-b54df94b4-ntfl4"
Aug 05 16:32:18.463592 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.463559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-ntfl4"
Aug 05 16:32:18.594837 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.594769    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-ntfl4"]
Aug 05 16:32:18.596969 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:32:18.596943    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5e576c1_1310_475f_8618_d2794381aa4a.slice/crio-fc532fd8331c5d0a8c3b7d85b575dccd251406daf0858df7d353db40155a6f49 WatchSource:0}: Error finding container fc532fd8331c5d0a8c3b7d85b575dccd251406daf0858df7d353db40155a6f49: Status 404 returned error can't find the container with id fc532fd8331c5d0a8c3b7d85b575dccd251406daf0858df7d353db40155a6f49
Aug 05 16:32:18.621195 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.621165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp" event={"ID":"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee","Type":"ContainerStarted","Data":"e956ae53d5922d18a8fbfe025806ef666b87ab36979c8718a9dfc362362ee0a8"}
Aug 05 16:32:18.622238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:18.622218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-ntfl4" event={"ID":"a5e576c1-1310-475f-8618-d2794381aa4a","Type":"ContainerStarted","Data":"fc532fd8331c5d0a8c3b7d85b575dccd251406daf0858df7d353db40155a6f49"}
Aug 05 16:32:19.631202 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:19.630831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp" event={"ID":"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee","Type":"ContainerStarted","Data":"d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7"}
Aug 05 16:32:19.631202 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:19.631003    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:19.647747 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:19.647638    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp" podStartSLOduration=1.222321917 podStartE2EDuration="2.647619347s" totalImagesPullingTime="1.42529743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:19.646448927 +0000 UTC m=+598.153340643" watchObservedRunningTime="2026-08-05 16:32:19.647619347 +0000 UTC m=+598.154511060"
Aug 05 16:32:20.638499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:20.638462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-ntfl4" event={"ID":"a5e576c1-1310-475f-8618-d2794381aa4a","Type":"ContainerStarted","Data":"0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14"}
Aug 05 16:32:20.654650 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:20.654592    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-ntfl4" podStartSLOduration=0.737488843 podStartE2EDuration="2.65457201s" totalImagesPullingTime="1.917083167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:20.65304448 +0000 UTC m=+599.159936193" watchObservedRunningTime="2026-08-05 16:32:20.65457201 +0000 UTC m=+599.161463725"
Aug 05 16:32:21.625261 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:21.625222    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-ntfl4"]
Aug 05 16:32:21.940153 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:21.940124    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:32:21.940510 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:21.940317    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:32:22.648902 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:22.648840    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-ntfl4" podUID="a5e576c1-1310-475f-8618-d2794381aa4a" containerName="authorino" containerID="cri-o://0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14" gracePeriod=30
Aug 05 16:32:22.905056 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:22.904969    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-ntfl4"
Aug 05 16:32:23.066368 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.066336    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6hqm\" (UniqueName: \"kubernetes.io/projected/a5e576c1-1310-475f-8618-d2794381aa4a-kube-api-access-f6hqm\") pod \"a5e576c1-1310-475f-8618-d2794381aa4a\" (UID: \"a5e576c1-1310-475f-8618-d2794381aa4a\") "
Aug 05 16:32:23.068416 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.068391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e576c1-1310-475f-8618-d2794381aa4a-kube-api-access-f6hqm" (OuterVolumeSpecName: "kube-api-access-f6hqm") pod "a5e576c1-1310-475f-8618-d2794381aa4a" (UID: "a5e576c1-1310-475f-8618-d2794381aa4a"). InnerVolumeSpecName "kube-api-access-f6hqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:32:23.167440 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.167360    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6hqm\" (UniqueName: \"kubernetes.io/projected/a5e576c1-1310-475f-8618-d2794381aa4a-kube-api-access-f6hqm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:32:23.654731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.654698    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5e576c1-1310-475f-8618-d2794381aa4a" containerID="0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14" exitCode=0
Aug 05 16:32:23.654924 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.654743    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-ntfl4"
Aug 05 16:32:23.654924 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.654758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-ntfl4" event={"ID":"a5e576c1-1310-475f-8618-d2794381aa4a","Type":"ContainerDied","Data":"0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14"}
Aug 05 16:32:23.654924 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.654789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-ntfl4" event={"ID":"a5e576c1-1310-475f-8618-d2794381aa4a","Type":"ContainerDied","Data":"fc532fd8331c5d0a8c3b7d85b575dccd251406daf0858df7d353db40155a6f49"}
Aug 05 16:32:23.654924 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.654805    2576 scope.go:117] "RemoveContainer" containerID="0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14"
Aug 05 16:32:23.664248 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.664233    2576 scope.go:117] "RemoveContainer" containerID="0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14"
Aug 05 16:32:23.664482 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:32:23.664464    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14\": container with ID starting with 0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14 not found: ID does not exist" containerID="0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14"
Aug 05 16:32:23.664523 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.664491    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14"} err="failed to get container status \"0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14\": rpc error: code = NotFound desc = could not find container \"0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14\": container with ID starting with 0908d60f8d1c94d19427fb91aaaa9f717a3fd7a41f46585226cc67d99a8bde14 not found: ID does not exist"
Aug 05 16:32:23.675461 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.675437    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-ntfl4"]
Aug 05 16:32:23.681452 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.681429    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-ntfl4"]
Aug 05 16:32:23.990509 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:23.990437    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e576c1-1310-475f-8618-d2794381aa4a" path="/var/lib/kubelet/pods/a5e576c1-1310-475f-8618-d2794381aa4a/volumes"
Aug 05 16:32:30.639440 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:30.639405    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:32.627795 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:32.627759    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"]
Aug 05 16:32:32.628230 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:32.627952    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp" podUID="d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" containerName="limitador" containerID="cri-o://d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7" gracePeriod=30
Aug 05 16:32:33.181078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.181046    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:33.256916 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.256844    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5l9m\" (UniqueName: \"kubernetes.io/projected/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-kube-api-access-v5l9m\") pod \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") "
Aug 05 16:32:33.256916 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.256879    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-config-file\") pod \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\" (UID: \"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee\") "
Aug 05 16:32:33.257314 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.257288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-config-file" (OuterVolumeSpecName: "config-file") pod "d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" (UID: "d39414ba-608d-4cb1-b0e2-3d9ebfe207ee"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:32:33.258910 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.258891    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-kube-api-access-v5l9m" (OuterVolumeSpecName: "kube-api-access-v5l9m") pod "d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" (UID: "d39414ba-608d-4cb1-b0e2-3d9ebfe207ee"). InnerVolumeSpecName "kube-api-access-v5l9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:32:33.358355 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.358317    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5l9m\" (UniqueName: \"kubernetes.io/projected/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-kube-api-access-v5l9m\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:32:33.358355 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.358352    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee-config-file\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:32:33.705203 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.705151    2576 generic.go:356] "Generic (PLEG): container finished" podID="d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" containerID="d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7" exitCode=0
Aug 05 16:32:33.705610 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.705215    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"
Aug 05 16:32:33.705610 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.705231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp" event={"ID":"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee","Type":"ContainerDied","Data":"d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7"}
Aug 05 16:32:33.705610 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.705306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-xg6hp" event={"ID":"d39414ba-608d-4cb1-b0e2-3d9ebfe207ee","Type":"ContainerDied","Data":"e956ae53d5922d18a8fbfe025806ef666b87ab36979c8718a9dfc362362ee0a8"}
Aug 05 16:32:33.705610 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.705328    2576 scope.go:117] "RemoveContainer" containerID="d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7"
Aug 05 16:32:33.714464 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.714447    2576 scope.go:117] "RemoveContainer" containerID="d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7"
Aug 05 16:32:33.714695 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:32:33.714675    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7\": container with ID starting with d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7 not found: ID does not exist" containerID="d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7"
Aug 05 16:32:33.714759 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.714703    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7"} err="failed to get container status \"d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7\": rpc error: code = NotFound desc = could not find container \"d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7\": container with ID starting with d70a425a4058ebe0dcdf27f72ede46b3918ef4d1d8cd60e70f04506b775e75a7 not found: ID does not exist"
Aug 05 16:32:33.728520 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.728500    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"]
Aug 05 16:32:33.732747 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.732724    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-xg6hp"]
Aug 05 16:32:33.990036 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:33.989960    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" path="/var/lib/kubelet/pods/d39414ba-608d-4cb1-b0e2-3d9ebfe207ee/volumes"
Aug 05 16:32:34.463257 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.463215    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"]
Aug 05 16:32:34.463620 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.463602    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" containerName="limitador"
Aug 05 16:32:34.463620 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.463619    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" containerName="limitador"
Aug 05 16:32:34.463806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.463637    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e576c1-1310-475f-8618-d2794381aa4a" containerName="authorino"
Aug 05 16:32:34.463806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.463643    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e576c1-1310-475f-8618-d2794381aa4a" containerName="authorino"
Aug 05 16:32:34.463806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.463712    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d39414ba-608d-4cb1-b0e2-3d9ebfe207ee" containerName="limitador"
Aug 05 16:32:34.463806 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.463722    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e576c1-1310-475f-8618-d2794381aa4a" containerName="authorino"
Aug 05 16:32:34.468325 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.468303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.470817 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.470798    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 16:32:34.470950 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.470919    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 05 16:32:34.471090 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.471076    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 16:32:34.471398 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.471379    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gjgm5\""
Aug 05 16:32:34.479646 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.479624    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"]
Aug 05 16:32:34.569646 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.569616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e53cac40-d5a7-4d45-8b34-b99c10fe8c96-data\") pod \"postgres-69fb4594cf-jjqlb\" (UID: \"e53cac40-d5a7-4d45-8b34-b99c10fe8c96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.569646 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.569655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xmlx\" (UniqueName: \"kubernetes.io/projected/e53cac40-d5a7-4d45-8b34-b99c10fe8c96-kube-api-access-5xmlx\") pod \"postgres-69fb4594cf-jjqlb\" (UID: \"e53cac40-d5a7-4d45-8b34-b99c10fe8c96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.670898 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.670860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xmlx\" (UniqueName: \"kubernetes.io/projected/e53cac40-d5a7-4d45-8b34-b99c10fe8c96-kube-api-access-5xmlx\") pod \"postgres-69fb4594cf-jjqlb\" (UID: \"e53cac40-d5a7-4d45-8b34-b99c10fe8c96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.671077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.670963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e53cac40-d5a7-4d45-8b34-b99c10fe8c96-data\") pod \"postgres-69fb4594cf-jjqlb\" (UID: \"e53cac40-d5a7-4d45-8b34-b99c10fe8c96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.671316 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.671300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e53cac40-d5a7-4d45-8b34-b99c10fe8c96-data\") pod \"postgres-69fb4594cf-jjqlb\" (UID: \"e53cac40-d5a7-4d45-8b34-b99c10fe8c96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.683180 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.683157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xmlx\" (UniqueName: \"kubernetes.io/projected/e53cac40-d5a7-4d45-8b34-b99c10fe8c96-kube-api-access-5xmlx\") pod \"postgres-69fb4594cf-jjqlb\" (UID: \"e53cac40-d5a7-4d45-8b34-b99c10fe8c96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.779557 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.779476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:34.906816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:34.906794    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"]
Aug 05 16:32:34.908970 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:32:34.908944    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53cac40_d5a7_4d45_8b34_b99c10fe8c96.slice/crio-ea1c61793a1bc12771ec33ff0e80cda685a2eb576dc66359176e89a6404e6f20 WatchSource:0}: Error finding container ea1c61793a1bc12771ec33ff0e80cda685a2eb576dc66359176e89a6404e6f20: Status 404 returned error can't find the container with id ea1c61793a1bc12771ec33ff0e80cda685a2eb576dc66359176e89a6404e6f20
Aug 05 16:32:35.716519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:35.716485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb" event={"ID":"e53cac40-d5a7-4d45-8b34-b99c10fe8c96","Type":"ContainerStarted","Data":"ea1c61793a1bc12771ec33ff0e80cda685a2eb576dc66359176e89a6404e6f20"}
Aug 05 16:32:40.747852 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:40.747812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb" event={"ID":"e53cac40-d5a7-4d45-8b34-b99c10fe8c96","Type":"ContainerStarted","Data":"05facd55e6fdacc685003bc95237e96b3a152d4b89105a3afee3eb0a9bcf9258"}
Aug 05 16:32:40.748303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:40.747909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:40.762928 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:40.762882    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb" podStartSLOduration=1.091941924 podStartE2EDuration="6.762869175s" totalImagesPullingTime="5.670927251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:40.762038428 +0000 UTC m=+619.268930139" watchObservedRunningTime="2026-08-05 16:32:40.762869175 +0000 UTC m=+619.269760886"
Aug 05 16:32:46.782333 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:46.782259    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjqlb"
Aug 05 16:32:47.356359 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.356323    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2vpcq"]
Aug 05 16:32:47.360146 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.360120    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq"
Aug 05 16:32:47.362384 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.362362    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mh5mq\""
Aug 05 16:32:47.367902 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.367546    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2vpcq"]
Aug 05 16:32:47.492402 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.492370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5x7b\" (UniqueName: \"kubernetes.io/projected/dfb84b54-80cc-4908-a7f5-0da4928949b6-kube-api-access-r5x7b\") pod \"authorino-5dc7ccb5f-2vpcq\" (UID: \"dfb84b54-80cc-4908-a7f5-0da4928949b6\") " pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq"
Aug 05 16:32:47.529159 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.529125    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2vpcq"]
Aug 05 16:32:47.529425 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:32:47.529404    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-r5x7b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq" podUID="dfb84b54-80cc-4908-a7f5-0da4928949b6"
Aug 05 16:32:47.559742 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.559708    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-kgm2q"]
Aug 05 16:32:47.563191 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.563172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.565679 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.565646    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 05 16:32:47.572611 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.572587    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-kgm2q"]
Aug 05 16:32:47.593407 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.593378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x7b\" (UniqueName: \"kubernetes.io/projected/dfb84b54-80cc-4908-a7f5-0da4928949b6-kube-api-access-r5x7b\") pod \"authorino-5dc7ccb5f-2vpcq\" (UID: \"dfb84b54-80cc-4908-a7f5-0da4928949b6\") " pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq"
Aug 05 16:32:47.601748 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.601722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5x7b\" (UniqueName: \"kubernetes.io/projected/dfb84b54-80cc-4908-a7f5-0da4928949b6-kube-api-access-r5x7b\") pod \"authorino-5dc7ccb5f-2vpcq\" (UID: \"dfb84b54-80cc-4908-a7f5-0da4928949b6\") " pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq"
Aug 05 16:32:47.621161 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.621095    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-kgm2q"]
Aug 05 16:32:47.621377 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:32:47.621359    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-brt49 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-brt49 tls-cert]: context canceled" pod="kuadrant-system/authorino-687bd45585-kgm2q" podUID="9c112825-30b4-4639-a68a-b029d1cac088"
Aug 05 16:32:47.653201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.653165    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6566bd87d8-dnsks"]
Aug 05 16:32:47.656741 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.656722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.663433 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.663407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6566bd87d8-dnsks"]
Aug 05 16:32:47.694216 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.694184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brt49\" (UniqueName: \"kubernetes.io/projected/9c112825-30b4-4639-a68a-b029d1cac088-kube-api-access-brt49\") pod \"authorino-687bd45585-kgm2q\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") " pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.694373 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.694338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c112825-30b4-4639-a68a-b029d1cac088-tls-cert\") pod \"authorino-687bd45585-kgm2q\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") " pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.784772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.784742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq"
Aug 05 16:32:47.785167 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.784743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.791614 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.791590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq"
Aug 05 16:32:47.794767 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.794749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.795235 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.795215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c112825-30b4-4639-a68a-b029d1cac088-tls-cert\") pod \"authorino-687bd45585-kgm2q\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") " pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.795294 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.795260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b02edcf0-0b88-4f53-b717-17f47184faf6-tls-cert\") pod \"authorino-6566bd87d8-dnsks\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") " pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.795332 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.795312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brt49\" (UniqueName: \"kubernetes.io/projected/9c112825-30b4-4639-a68a-b029d1cac088-kube-api-access-brt49\") pod \"authorino-687bd45585-kgm2q\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") " pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.795363 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.795329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fmv\" (UniqueName: \"kubernetes.io/projected/b02edcf0-0b88-4f53-b717-17f47184faf6-kube-api-access-72fmv\") pod \"authorino-6566bd87d8-dnsks\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") " pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.797608 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.797584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c112825-30b4-4639-a68a-b029d1cac088-tls-cert\") pod \"authorino-687bd45585-kgm2q\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") " pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.803726 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.803705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brt49\" (UniqueName: \"kubernetes.io/projected/9c112825-30b4-4639-a68a-b029d1cac088-kube-api-access-brt49\") pod \"authorino-687bd45585-kgm2q\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") " pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:47.896548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.896519    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c112825-30b4-4639-a68a-b029d1cac088-tls-cert\") pod \"9c112825-30b4-4639-a68a-b029d1cac088\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") "
Aug 05 16:32:47.896728 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.896595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5x7b\" (UniqueName: \"kubernetes.io/projected/dfb84b54-80cc-4908-a7f5-0da4928949b6-kube-api-access-r5x7b\") pod \"dfb84b54-80cc-4908-a7f5-0da4928949b6\" (UID: \"dfb84b54-80cc-4908-a7f5-0da4928949b6\") "
Aug 05 16:32:47.896728 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.896646    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brt49\" (UniqueName: \"kubernetes.io/projected/9c112825-30b4-4639-a68a-b029d1cac088-kube-api-access-brt49\") pod \"9c112825-30b4-4639-a68a-b029d1cac088\" (UID: \"9c112825-30b4-4639-a68a-b029d1cac088\") "
Aug 05 16:32:47.896851 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.896769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72fmv\" (UniqueName: \"kubernetes.io/projected/b02edcf0-0b88-4f53-b717-17f47184faf6-kube-api-access-72fmv\") pod \"authorino-6566bd87d8-dnsks\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") " pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.896949 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.896931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b02edcf0-0b88-4f53-b717-17f47184faf6-tls-cert\") pod \"authorino-6566bd87d8-dnsks\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") " pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.898844 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.898814    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c112825-30b4-4639-a68a-b029d1cac088-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9c112825-30b4-4639-a68a-b029d1cac088" (UID: "9c112825-30b4-4639-a68a-b029d1cac088"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:32:47.898973 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.898950    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb84b54-80cc-4908-a7f5-0da4928949b6-kube-api-access-r5x7b" (OuterVolumeSpecName: "kube-api-access-r5x7b") pod "dfb84b54-80cc-4908-a7f5-0da4928949b6" (UID: "dfb84b54-80cc-4908-a7f5-0da4928949b6"). InnerVolumeSpecName "kube-api-access-r5x7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:32:47.898973 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.898991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c112825-30b4-4639-a68a-b029d1cac088-kube-api-access-brt49" (OuterVolumeSpecName: "kube-api-access-brt49") pod "9c112825-30b4-4639-a68a-b029d1cac088" (UID: "9c112825-30b4-4639-a68a-b029d1cac088"). InnerVolumeSpecName "kube-api-access-brt49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:32:47.899266 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.899248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b02edcf0-0b88-4f53-b717-17f47184faf6-tls-cert\") pod \"authorino-6566bd87d8-dnsks\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") " pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.904644 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.904619    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fmv\" (UniqueName: \"kubernetes.io/projected/b02edcf0-0b88-4f53-b717-17f47184faf6-kube-api-access-72fmv\") pod \"authorino-6566bd87d8-dnsks\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") " pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.967084 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.967051    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:32:47.998102 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.998072    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c112825-30b4-4639-a68a-b029d1cac088-tls-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:32:47.998102 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.998100    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5x7b\" (UniqueName: \"kubernetes.io/projected/dfb84b54-80cc-4908-a7f5-0da4928949b6-kube-api-access-r5x7b\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:32:47.998304 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:47.998113    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brt49\" (UniqueName: \"kubernetes.io/projected/9c112825-30b4-4639-a68a-b029d1cac088-kube-api-access-brt49\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:32:48.098499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.098472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6566bd87d8-dnsks"]
Aug 05 16:32:48.101215 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:32:48.101192    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb02edcf0_0b88_4f53_b717_17f47184faf6.slice/crio-0984d06ce4bfb5ba618e94a7dda975c4c3a605eab6022c84fccdb07b4f279ffe WatchSource:0}: Error finding container 0984d06ce4bfb5ba618e94a7dda975c4c3a605eab6022c84fccdb07b4f279ffe: Status 404 returned error can't find the container with id 0984d06ce4bfb5ba618e94a7dda975c4c3a605eab6022c84fccdb07b4f279ffe
Aug 05 16:32:48.791036 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.790996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6566bd87d8-dnsks" event={"ID":"b02edcf0-0b88-4f53-b717-17f47184faf6","Type":"ContainerStarted","Data":"0984d06ce4bfb5ba618e94a7dda975c4c3a605eab6022c84fccdb07b4f279ffe"}
Aug 05 16:32:48.791412 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.791070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2vpcq"
Aug 05 16:32:48.791412 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.791076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-kgm2q"
Aug 05 16:32:48.821817 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.821780    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2vpcq"]
Aug 05 16:32:48.826036 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.826011    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2vpcq"]
Aug 05 16:32:48.848329 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.848304    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-kgm2q"]
Aug 05 16:32:48.857441 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:48.854130    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-kgm2q"]
Aug 05 16:32:49.798361 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:49.798320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6566bd87d8-dnsks" event={"ID":"b02edcf0-0b88-4f53-b717-17f47184faf6","Type":"ContainerStarted","Data":"da0676ea6302078b7512116412d495c36c5e6964e787e971da704b92b49db7ab"}
Aug 05 16:32:49.814652 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:49.814606    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6566bd87d8-dnsks" podStartSLOduration=1.300843985 podStartE2EDuration="2.814591378s" totalImagesPullingTime="1.513747393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:49.814104049 +0000 UTC m=+628.320995761" watchObservedRunningTime="2026-08-05 16:32:49.814591378 +0000 UTC m=+628.321483090"
Aug 05 16:32:49.990559 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:49.990523    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c112825-30b4-4639-a68a-b029d1cac088" path="/var/lib/kubelet/pods/9c112825-30b4-4639-a68a-b029d1cac088/volumes"
Aug 05 16:32:49.990766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:49.990754    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb84b54-80cc-4908-a7f5-0da4928949b6" path="/var/lib/kubelet/pods/dfb84b54-80cc-4908-a7f5-0da4928949b6/volumes"
Aug 05 16:32:54.676844 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.676810    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b999f6f6f-zsq5s"]
Aug 05 16:32:54.682590 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.682569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:54.686339 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.686316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:32:54.686713 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.686688    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bfzbt\""
Aug 05 16:32:54.687077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.687060    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:32:54.692375 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.692354    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b999f6f6f-zsq5s"]
Aug 05 16:32:54.757205 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.757171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxtm\" (UniqueName: \"kubernetes.io/projected/223df087-c484-4df9-b893-7cccb8ddf9cd-kube-api-access-pzxtm\") pod \"maas-controller-6b999f6f6f-zsq5s\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") " pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:54.757372 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.757215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/223df087-c484-4df9-b893-7cccb8ddf9cd-webhook-cert\") pod \"maas-controller-6b999f6f6f-zsq5s\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") " pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:54.857819 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.857784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxtm\" (UniqueName: \"kubernetes.io/projected/223df087-c484-4df9-b893-7cccb8ddf9cd-kube-api-access-pzxtm\") pod \"maas-controller-6b999f6f6f-zsq5s\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") " pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:54.858019 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.857837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/223df087-c484-4df9-b893-7cccb8ddf9cd-webhook-cert\") pod \"maas-controller-6b999f6f6f-zsq5s\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") " pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:54.860267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.860240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/223df087-c484-4df9-b893-7cccb8ddf9cd-webhook-cert\") pod \"maas-controller-6b999f6f6f-zsq5s\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") " pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:54.866682 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.866658    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-pn2hc"]
Aug 05 16:32:54.869788 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.869769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxtm\" (UniqueName: \"kubernetes.io/projected/223df087-c484-4df9-b893-7cccb8ddf9cd-kube-api-access-pzxtm\") pod \"maas-controller-6b999f6f6f-zsq5s\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") " pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:54.871011 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.870995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:54.878932 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.878907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-pn2hc"]
Aug 05 16:32:54.958528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.958448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-webhook-cert\") pod \"maas-controller-5b9f57f8bb-pn2hc\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") " pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:54.958528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.958490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9p4\" (UniqueName: \"kubernetes.io/projected/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-kube-api-access-pt9p4\") pod \"maas-controller-5b9f57f8bb-pn2hc\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") " pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:54.993899 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:54.993873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:55.059682 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.059161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-webhook-cert\") pod \"maas-controller-5b9f57f8bb-pn2hc\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") " pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:55.059682 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.059214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9p4\" (UniqueName: \"kubernetes.io/projected/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-kube-api-access-pt9p4\") pod \"maas-controller-5b9f57f8bb-pn2hc\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") " pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:55.062566 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.062532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-webhook-cert\") pod \"maas-controller-5b9f57f8bb-pn2hc\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") " pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:55.067760 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.067738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9p4\" (UniqueName: \"kubernetes.io/projected/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-kube-api-access-pt9p4\") pod \"maas-controller-5b9f57f8bb-pn2hc\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") " pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:55.127654 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.127629    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b999f6f6f-zsq5s"]
Aug 05 16:32:55.129873 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:32:55.129849    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223df087_c484_4df9_b893_7cccb8ddf9cd.slice/crio-0ca7ee846d4bb49e718b57039a1a24634fdd56e43779fc06966c58bafa32dcbf WatchSource:0}: Error finding container 0ca7ee846d4bb49e718b57039a1a24634fdd56e43779fc06966c58bafa32dcbf: Status 404 returned error can't find the container with id 0ca7ee846d4bb49e718b57039a1a24634fdd56e43779fc06966c58bafa32dcbf
Aug 05 16:32:55.188441 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.188401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:55.323349 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.323316    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-pn2hc"]
Aug 05 16:32:55.324999 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:32:55.324963    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14b81fb_68ff_46ab_aab1_325dd1fc2ffe.slice/crio-604a6451c419b94f0c4e6be541352b3769428d0974b29289b2de3554095f51d6 WatchSource:0}: Error finding container 604a6451c419b94f0c4e6be541352b3769428d0974b29289b2de3554095f51d6: Status 404 returned error can't find the container with id 604a6451c419b94f0c4e6be541352b3769428d0974b29289b2de3554095f51d6
Aug 05 16:32:55.836309 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.836250    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s" event={"ID":"223df087-c484-4df9-b893-7cccb8ddf9cd","Type":"ContainerStarted","Data":"0ca7ee846d4bb49e718b57039a1a24634fdd56e43779fc06966c58bafa32dcbf"}
Aug 05 16:32:55.838663 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:55.838633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc" event={"ID":"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe","Type":"ContainerStarted","Data":"604a6451c419b94f0c4e6be541352b3769428d0974b29289b2de3554095f51d6"}
Aug 05 16:32:57.854694 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:57.854654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s" event={"ID":"223df087-c484-4df9-b893-7cccb8ddf9cd","Type":"ContainerStarted","Data":"32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6"}
Aug 05 16:32:57.855182 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:57.854824    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:32:57.856289 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:57.856247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc" event={"ID":"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe","Type":"ContainerStarted","Data":"802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887"}
Aug 05 16:32:57.856410 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:57.856308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:32:57.881782 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:57.881729    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s" podStartSLOduration=1.29573271 podStartE2EDuration="3.881714568s" totalImagesPullingTime="2.585981858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:57.880139732 +0000 UTC m=+636.387031448" watchObservedRunningTime="2026-08-05 16:32:57.881714568 +0000 UTC m=+636.388606279"
Aug 05 16:32:57.904636 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:32:57.904587    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc" podStartSLOduration=1.502977528 podStartE2EDuration="3.904571923s" totalImagesPullingTime="2.401594395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:57.902402958 +0000 UTC m=+636.409294693" watchObservedRunningTime="2026-08-05 16:32:57.904571923 +0000 UTC m=+636.411463629"
Aug 05 16:33:08.864227 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:08.864196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:33:08.864659 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:08.864269    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:33:08.927267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:08.927233    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b999f6f6f-zsq5s"]
Aug 05 16:33:08.927442 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:08.927419    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s" podUID="223df087-c484-4df9-b893-7cccb8ddf9cd" containerName="manager" containerID="cri-o://32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6" gracePeriod=30
Aug 05 16:33:09.193189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.193162    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:33:09.296733 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.296697    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/223df087-c484-4df9-b893-7cccb8ddf9cd-webhook-cert\") pod \"223df087-c484-4df9-b893-7cccb8ddf9cd\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") "
Aug 05 16:33:09.296926 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.296766    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxtm\" (UniqueName: \"kubernetes.io/projected/223df087-c484-4df9-b893-7cccb8ddf9cd-kube-api-access-pzxtm\") pod \"223df087-c484-4df9-b893-7cccb8ddf9cd\" (UID: \"223df087-c484-4df9-b893-7cccb8ddf9cd\") "
Aug 05 16:33:09.299000 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.298963    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/223df087-c484-4df9-b893-7cccb8ddf9cd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "223df087-c484-4df9-b893-7cccb8ddf9cd" (UID: "223df087-c484-4df9-b893-7cccb8ddf9cd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:33:09.299000 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.298975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223df087-c484-4df9-b893-7cccb8ddf9cd-kube-api-access-pzxtm" (OuterVolumeSpecName: "kube-api-access-pzxtm") pod "223df087-c484-4df9-b893-7cccb8ddf9cd" (UID: "223df087-c484-4df9-b893-7cccb8ddf9cd"). InnerVolumeSpecName "kube-api-access-pzxtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:33:09.397559 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.397524    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/223df087-c484-4df9-b893-7cccb8ddf9cd-webhook-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:33:09.397559 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.397552    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxtm\" (UniqueName: \"kubernetes.io/projected/223df087-c484-4df9-b893-7cccb8ddf9cd-kube-api-access-pzxtm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:33:09.924542 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.924508    2576 generic.go:356] "Generic (PLEG): container finished" podID="223df087-c484-4df9-b893-7cccb8ddf9cd" containerID="32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6" exitCode=0
Aug 05 16:33:09.924930 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.924557    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s"
Aug 05 16:33:09.924930 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.924596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s" event={"ID":"223df087-c484-4df9-b893-7cccb8ddf9cd","Type":"ContainerDied","Data":"32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6"}
Aug 05 16:33:09.924930 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.924653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b999f6f6f-zsq5s" event={"ID":"223df087-c484-4df9-b893-7cccb8ddf9cd","Type":"ContainerDied","Data":"0ca7ee846d4bb49e718b57039a1a24634fdd56e43779fc06966c58bafa32dcbf"}
Aug 05 16:33:09.924930 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.924676    2576 scope.go:117] "RemoveContainer" containerID="32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6"
Aug 05 16:33:09.933477 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.933357    2576 scope.go:117] "RemoveContainer" containerID="32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6"
Aug 05 16:33:09.933636 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:33:09.933617    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6\": container with ID starting with 32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6 not found: ID does not exist" containerID="32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6"
Aug 05 16:33:09.933690 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.933644    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6"} err="failed to get container status \"32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6\": rpc error: code = NotFound desc = could not find container \"32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6\": container with ID starting with 32fb3635e81aafc3fca0be921d59e248fadd6c0bd43381ed442070af07c369e6 not found: ID does not exist"
Aug 05 16:33:09.945843 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.945822    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b999f6f6f-zsq5s"]
Aug 05 16:33:09.952961 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.952937    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b999f6f6f-zsq5s"]
Aug 05 16:33:09.990431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:09.990395    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="223df087-c484-4df9-b893-7cccb8ddf9cd" path="/var/lib/kubelet/pods/223df087-c484-4df9-b893-7cccb8ddf9cd/volumes"
Aug 05 16:33:31.302344 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.302311    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"]
Aug 05 16:33:31.302739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.302690    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="223df087-c484-4df9-b893-7cccb8ddf9cd" containerName="manager"
Aug 05 16:33:31.302739 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.302700    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="223df087-c484-4df9-b893-7cccb8ddf9cd" containerName="manager"
Aug 05 16:33:31.302816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.302773    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="223df087-c484-4df9-b893-7cccb8ddf9cd" containerName="manager"
Aug 05 16:33:31.311118 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.311091    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.313632 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.313609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8x4pl\""
Aug 05 16:33:31.313732 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.313651    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 05 16:33:31.317769 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.317745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"]
Aug 05 16:33:31.390394 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.390366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eda3e3f-002e-4fab-befa-b8864d2299fd-maas-api-tls\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.390569 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.390456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgcr9\" (UniqueName: \"kubernetes.io/projected/9eda3e3f-002e-4fab-befa-b8864d2299fd-kube-api-access-qgcr9\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.390569 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.390489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eda3e3f-002e-4fab-befa-b8864d2299fd-openshift-service-ca\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.491666 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.491631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eda3e3f-002e-4fab-befa-b8864d2299fd-openshift-service-ca\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.491666 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.491669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eda3e3f-002e-4fab-befa-b8864d2299fd-maas-api-tls\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.491864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.491734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgcr9\" (UniqueName: \"kubernetes.io/projected/9eda3e3f-002e-4fab-befa-b8864d2299fd-kube-api-access-qgcr9\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.492321 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.492288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eda3e3f-002e-4fab-befa-b8864d2299fd-openshift-service-ca\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.494086 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.494068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9eda3e3f-002e-4fab-befa-b8864d2299fd-maas-api-tls\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.500127 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.500108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgcr9\" (UniqueName: \"kubernetes.io/projected/9eda3e3f-002e-4fab-befa-b8864d2299fd-kube-api-access-qgcr9\") pod \"maas-api-6475fbf58c-g78gl\" (UID: \"9eda3e3f-002e-4fab-befa-b8864d2299fd\") " pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.623850 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.623772    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:31.769090 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.769058    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"]
Aug 05 16:33:31.771276 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:33:31.771240    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eda3e3f_002e_4fab_befa_b8864d2299fd.slice/crio-f62f2c8da9b16f78b7d5227669b1b9bbcea7b45982bf1dd4cdfa16d4f3cf98f8 WatchSource:0}: Error finding container f62f2c8da9b16f78b7d5227669b1b9bbcea7b45982bf1dd4cdfa16d4f3cf98f8: Status 404 returned error can't find the container with id f62f2c8da9b16f78b7d5227669b1b9bbcea7b45982bf1dd4cdfa16d4f3cf98f8
Aug 05 16:33:31.853282 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.853238    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-zhmcq"]
Aug 05 16:33:31.863470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.863443    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-zhmcq"]
Aug 05 16:33:31.863667 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.863541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:31.865999 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.865956    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 05 16:33:31.866146 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.866011    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-76ftf\""
Aug 05 16:33:31.914116 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.914081    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"]
Aug 05 16:33:31.918149 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.918118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:31.928835 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.928808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"]
Aug 05 16:33:31.997885 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.997855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc3e577c-8e7d-4b73-bcd3-eb02dff189ed-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2frhk\" (UID: \"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:31.998077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.997893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7ccx\" (UniqueName: \"kubernetes.io/projected/fc3e577c-8e7d-4b73-bcd3-eb02dff189ed-kube-api-access-g7ccx\") pod \"payload-pre-processing-687dbb6cf6-2frhk\" (UID: \"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:31.998077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.997920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8081823a-db7a-48e3-bfd2-1e2889d2c9c2-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-zhmcq\" (UID: \"8081823a-db7a-48e3-bfd2-1e2889d2c9c2\") " pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:31.998077 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:31.997940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfdx\" (UniqueName: \"kubernetes.io/projected/8081823a-db7a-48e3-bfd2-1e2889d2c9c2-kube-api-access-fgfdx\") pod \"payload-processing-5cc6cd444b-zhmcq\" (UID: \"8081823a-db7a-48e3-bfd2-1e2889d2c9c2\") " pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:32.032320 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.032275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl" event={"ID":"9eda3e3f-002e-4fab-befa-b8864d2299fd","Type":"ContainerStarted","Data":"f62f2c8da9b16f78b7d5227669b1b9bbcea7b45982bf1dd4cdfa16d4f3cf98f8"}
Aug 05 16:33:32.098757 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.098724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc3e577c-8e7d-4b73-bcd3-eb02dff189ed-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2frhk\" (UID: \"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:32.098927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.098765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7ccx\" (UniqueName: \"kubernetes.io/projected/fc3e577c-8e7d-4b73-bcd3-eb02dff189ed-kube-api-access-g7ccx\") pod \"payload-pre-processing-687dbb6cf6-2frhk\" (UID: \"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:32.098927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.098789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8081823a-db7a-48e3-bfd2-1e2889d2c9c2-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-zhmcq\" (UID: \"8081823a-db7a-48e3-bfd2-1e2889d2c9c2\") " pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:32.098927 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.098813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfdx\" (UniqueName: \"kubernetes.io/projected/8081823a-db7a-48e3-bfd2-1e2889d2c9c2-kube-api-access-fgfdx\") pod \"payload-processing-5cc6cd444b-zhmcq\" (UID: \"8081823a-db7a-48e3-bfd2-1e2889d2c9c2\") " pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:32.099490 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.099469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc3e577c-8e7d-4b73-bcd3-eb02dff189ed-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-2frhk\" (UID: \"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:32.099543 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.099513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8081823a-db7a-48e3-bfd2-1e2889d2c9c2-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-zhmcq\" (UID: \"8081823a-db7a-48e3-bfd2-1e2889d2c9c2\") " pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:32.106109 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.106088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfdx\" (UniqueName: \"kubernetes.io/projected/8081823a-db7a-48e3-bfd2-1e2889d2c9c2-kube-api-access-fgfdx\") pod \"payload-processing-5cc6cd444b-zhmcq\" (UID: \"8081823a-db7a-48e3-bfd2-1e2889d2c9c2\") " pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:32.106210 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.106141    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7ccx\" (UniqueName: \"kubernetes.io/projected/fc3e577c-8e7d-4b73-bcd3-eb02dff189ed-kube-api-access-g7ccx\") pod \"payload-pre-processing-687dbb6cf6-2frhk\" (UID: \"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:32.176059 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.175950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:32.230121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.230092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:32.337068 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.337034    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-zhmcq"]
Aug 05 16:33:32.339061 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:33:32.339033    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8081823a_db7a_48e3_bfd2_1e2889d2c9c2.slice/crio-e0c206caadc8185a65b6c26c10463bb52cfabf85de8e9d8fe5dc4d1feda78f8c WatchSource:0}: Error finding container e0c206caadc8185a65b6c26c10463bb52cfabf85de8e9d8fe5dc4d1feda78f8c: Status 404 returned error can't find the container with id e0c206caadc8185a65b6c26c10463bb52cfabf85de8e9d8fe5dc4d1feda78f8c
Aug 05 16:33:32.392288 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:32.392263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"]
Aug 05 16:33:32.395048 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:33:32.395022    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3e577c_8e7d_4b73_bcd3_eb02dff189ed.slice/crio-45c311f44a251d0211a5ffffbf164a8945310b2ac13a68b9a68b68104b34ae4e WatchSource:0}: Error finding container 45c311f44a251d0211a5ffffbf164a8945310b2ac13a68b9a68b68104b34ae4e: Status 404 returned error can't find the container with id 45c311f44a251d0211a5ffffbf164a8945310b2ac13a68b9a68b68104b34ae4e
Aug 05 16:33:33.046800 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:33.046721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk" event={"ID":"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed","Type":"ContainerStarted","Data":"45c311f44a251d0211a5ffffbf164a8945310b2ac13a68b9a68b68104b34ae4e"}
Aug 05 16:33:33.048589 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:33.048554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq" event={"ID":"8081823a-db7a-48e3-bfd2-1e2889d2c9c2","Type":"ContainerStarted","Data":"e0c206caadc8185a65b6c26c10463bb52cfabf85de8e9d8fe5dc4d1feda78f8c"}
Aug 05 16:33:35.064607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:35.064570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl" event={"ID":"9eda3e3f-002e-4fab-befa-b8864d2299fd","Type":"ContainerStarted","Data":"0bb27d07ed3522c196dbe14ee480d8d033400d63a2220bb0c8ecf0df256017d5"}
Aug 05 16:33:35.065125 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:35.064756    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:35.082878 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:35.082821    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl" podStartSLOduration=1.572514438 podStartE2EDuration="4.08280671s" totalImagesPullingTime="2.510292272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:33:35.080920144 +0000 UTC m=+673.587811857" watchObservedRunningTime="2026-08-05 16:33:35.08280671 +0000 UTC m=+673.589698450"
Aug 05 16:33:36.070682 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:36.070594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk" event={"ID":"fc3e577c-8e7d-4b73-bcd3-eb02dff189ed","Type":"ContainerStarted","Data":"5eeea2020a5c7abcde7c3edb1a7c6350b129401657fe238d637e781f6c19fa34"}
Aug 05 16:33:36.071128 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:36.070751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:33:36.072281 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:36.072256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq" event={"ID":"8081823a-db7a-48e3-bfd2-1e2889d2c9c2","Type":"ContainerStarted","Data":"a5680a78eea90bc54689e966098d09c28840ef58620b25776c7df6ff403bced2"}
Aug 05 16:33:36.072375 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:36.072359    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:36.088537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:36.088483    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk" podStartSLOduration=1.657907724 podStartE2EDuration="5.088466477s" totalImagesPullingTime="3.430558753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:33:36.087570247 +0000 UTC m=+674.594461987" watchObservedRunningTime="2026-08-05 16:33:36.088466477 +0000 UTC m=+674.595358190"
Aug 05 16:33:36.108212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:36.108139    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq" podStartSLOduration=1.6484132169999999 podStartE2EDuration="5.108115987s" totalImagesPullingTime="3.45970277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:33:36.106727654 +0000 UTC m=+674.613619388" watchObservedRunningTime="2026-08-05 16:33:36.108115987 +0000 UTC m=+674.615007709"
Aug 05 16:33:39.613155 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:39.613113    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkxwq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 05 16:33:39.613545 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:39.613178    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podUID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 05 16:33:41.085249 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:41.078244    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6475fbf58c-g78gl"
Aug 05 16:33:42.106139 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:42.106107    2576 generic.go:356] "Generic (PLEG): container finished" podID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerID="57a218152b996c3f098aec404abd0587d2ca111ba0ae54fa0621edb4a6a71604" exitCode=0
Aug 05 16:33:42.106591 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:42.106188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" event={"ID":"06bca3d3-50ae-4d86-8af0-338c929bbdc4","Type":"ContainerDied","Data":"57a218152b996c3f098aec404abd0587d2ca111ba0ae54fa0621edb4a6a71604"}
Aug 05 16:33:42.106591 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:42.106571    2576 scope.go:117] "RemoveContainer" containerID="57a218152b996c3f098aec404abd0587d2ca111ba0ae54fa0621edb4a6a71604"
Aug 05 16:33:42.107727 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:42.107680    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:33:42.107823 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:42.107773    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:33:42.107823 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:42.107806    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:33:43.120178 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:43.119288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" event={"ID":"06bca3d3-50ae-4d86-8af0-338c929bbdc4","Type":"ContainerStarted","Data":"0a65493d743d18fe70c757bc67fbbe46c9d135a160d7c0ce7f0f28f399c7fa07"}
Aug 05 16:33:43.177616 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:43.177585    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:33:43.177825 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:43.177809    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkxwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 05 16:33:43.177878 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:43.177860    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podUID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 05 16:33:44.177860 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:44.177823    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkxwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 05 16:33:44.178275 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:44.177889    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podUID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 05 16:33:45.177994 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:45.177958    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkxwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 05 16:33:45.178397 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:45.178039    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podUID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 05 16:33:46.178640 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:46.178602    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkxwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 05 16:33:46.179043 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:46.178661    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podUID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 05 16:33:47.079542 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:47.079497    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk" podUID="fc3e577c-8e7d-4b73-bcd3-eb02dff189ed" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.50:9004: connect: connection refused"
Aug 05 16:33:47.080196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:47.079848    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-zhmcq"
Aug 05 16:33:47.178575 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:47.178544    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkxwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Aug 05 16:33:47.178743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:47.178597    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq" podUID="06bca3d3-50ae-4d86-8af0-338c929bbdc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Aug 05 16:33:48.278543 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:48.278501    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:33:48.279047 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:48.278914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:33:48.279717 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:48.279699    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkxwq"
Aug 05 16:33:52.231467 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:52.231428    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk" podUID="fc3e577c-8e7d-4b73-bcd3-eb02dff189ed" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.50:9004: connect: connection refused"
Aug 05 16:33:57.077746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:33:57.077693    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk" podUID="fc3e577c-8e7d-4b73-bcd3-eb02dff189ed" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.50:9004: connect: connection refused"
Aug 05 16:34:07.078462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:07.078434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-2frhk"
Aug 05 16:34:24.951073 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:24.950974    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"]
Aug 05 16:34:24.955581 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:24.955564    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:24.957890 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:24.957870    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 16:34:24.958873 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:24.958593    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 16:34:24.958873 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:24.958593    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g97pd\""
Aug 05 16:34:24.958873 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:24.958711    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 05 16:34:24.962356 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:24.962335    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"]
Aug 05 16:34:25.001866 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.001839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.001866 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.001867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.002099 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.001940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvhk4\" (UniqueName: \"kubernetes.io/projected/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-kube-api-access-fvhk4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.002099 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.001962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.002099 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.002006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.002099 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.002048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.102578 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.102534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvhk4\" (UniqueName: \"kubernetes.io/projected/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-kube-api-access-fvhk4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.102766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.102591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.102766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.102624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.102766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.102646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.102766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.102701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.102766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.102723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.103133 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.103032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.103133 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.103078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.103242 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.103205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.105248 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.105210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.105418 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.105389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.110194 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.110136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvhk4\" (UniqueName: \"kubernetes.io/projected/d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4-kube-api-access-fvhk4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-79ggv\" (UID: \"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.269015 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.268892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:25.405019 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:25.404992    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"]
Aug 05 16:34:25.406919 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:34:25.406891    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b0c5bb_72cc_4c7f_926b_1bb96d36f4e4.slice/crio-3b6d4b793997cbb9a57587502f93c1f3df5c55395d36794844a742ce111ef827 WatchSource:0}: Error finding container 3b6d4b793997cbb9a57587502f93c1f3df5c55395d36794844a742ce111ef827: Status 404 returned error can't find the container with id 3b6d4b793997cbb9a57587502f93c1f3df5c55395d36794844a742ce111ef827
Aug 05 16:34:26.357511 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:26.357461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv" event={"ID":"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4","Type":"ContainerStarted","Data":"3b6d4b793997cbb9a57587502f93c1f3df5c55395d36794844a742ce111ef827"}
Aug 05 16:34:27.363548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:27.363507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv" event={"ID":"d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4","Type":"ContainerStarted","Data":"30285e0230344df1b1e477e18423dca7af871e17b4dcb80133ec6ffde69666e1"}
Aug 05 16:34:27.382268 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:27.382219    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv" podStartSLOduration=2.241062059 podStartE2EDuration="3.382203546s" totalImagesPullingTime="1.141141487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:34:27.380715679 +0000 UTC m=+725.887607392" watchObservedRunningTime="2026-08-05 16:34:27.382203546 +0000 UTC m=+725.889095258"
Aug 05 16:34:35.269413 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:35.269360    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:35.269911 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:35.269438    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:35.282084 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:35.282058    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:34:35.415026 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:34:35.414999    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-79ggv"
Aug 05 16:35:02.050298 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.050256    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"]
Aug 05 16:35:02.055259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.055237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.057360 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.057334    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 05 16:35:02.066469 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.066435    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"]
Aug 05 16:35:02.149238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.149205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.149416 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.149273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.149416 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.149330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.149416 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.149353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z8q7\" (UniqueName: \"kubernetes.io/projected/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-kube-api-access-5z8q7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.149566 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.149423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.149566 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.149450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.250658 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.250622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.250844 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.250665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8q7\" (UniqueName: \"kubernetes.io/projected/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-kube-api-access-5z8q7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.250844 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.250787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.250844 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.250836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.251076 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.250990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.251076 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.251006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.251076 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.251027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.251195 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.251142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.251195 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.251173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.253120 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.253095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.253556 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.253534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.259023 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.258996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8q7\" (UniqueName: \"kubernetes.io/projected/9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3-kube-api-access-5z8q7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67\" (UID: \"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.368560 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.368470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:02.504087 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.504060    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"]
Aug 05 16:35:02.505759 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:35:02.505731    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4d8c5b_fc52_47ff_ba26_d299bd3b55e3.slice/crio-9c3423d8ca323dab2ebaaf23689a4d0f6180407bcd4d9cc2d028b28d00e9e118 WatchSource:0}: Error finding container 9c3423d8ca323dab2ebaaf23689a4d0f6180407bcd4d9cc2d028b28d00e9e118: Status 404 returned error can't find the container with id 9c3423d8ca323dab2ebaaf23689a4d0f6180407bcd4d9cc2d028b28d00e9e118
Aug 05 16:35:02.507190 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.507171    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:35:02.547119 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:02.547087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67" event={"ID":"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3","Type":"ContainerStarted","Data":"9c3423d8ca323dab2ebaaf23689a4d0f6180407bcd4d9cc2d028b28d00e9e118"}
Aug 05 16:35:03.553504 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:03.553467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67" event={"ID":"9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3","Type":"ContainerStarted","Data":"b9ceb4219d30e91bde4ab221ff9dc495e15b1f7725da31ad38fd4a0d8308039b"}
Aug 05 16:35:03.574787 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:03.574730    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67" podStartSLOduration=1.306200667 podStartE2EDuration="1.57471121s" totalImagesPullingTime="268.510543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:35:03.572857623 +0000 UTC m=+762.079749335" watchObservedRunningTime="2026-08-05 16:35:03.57471121 +0000 UTC m=+762.081602930"
Aug 05 16:35:12.368711 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:12.368671    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:12.369182 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:12.368737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:12.381321 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:12.381297    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:35:12.610468 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:35:12.610441    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67"
Aug 05 16:36:53.924435 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:53.924393    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6566bd87d8-dnsks"]
Aug 05 16:36:53.925152 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:53.924579    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6566bd87d8-dnsks" podUID="b02edcf0-0b88-4f53-b717-17f47184faf6" containerName="authorino" containerID="cri-o://da0676ea6302078b7512116412d495c36c5e6964e787e971da704b92b49db7ab" gracePeriod=30
Aug 05 16:36:54.132121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.132090    2576 generic.go:356] "Generic (PLEG): container finished" podID="b02edcf0-0b88-4f53-b717-17f47184faf6" containerID="da0676ea6302078b7512116412d495c36c5e6964e787e971da704b92b49db7ab" exitCode=0
Aug 05 16:36:54.132298 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.132158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6566bd87d8-dnsks" event={"ID":"b02edcf0-0b88-4f53-b717-17f47184faf6","Type":"ContainerDied","Data":"da0676ea6302078b7512116412d495c36c5e6964e787e971da704b92b49db7ab"}
Aug 05 16:36:54.178215 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.178157    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:36:54.203196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.203164    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b02edcf0-0b88-4f53-b717-17f47184faf6-tls-cert\") pod \"b02edcf0-0b88-4f53-b717-17f47184faf6\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") "
Aug 05 16:36:54.203332 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.203228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72fmv\" (UniqueName: \"kubernetes.io/projected/b02edcf0-0b88-4f53-b717-17f47184faf6-kube-api-access-72fmv\") pod \"b02edcf0-0b88-4f53-b717-17f47184faf6\" (UID: \"b02edcf0-0b88-4f53-b717-17f47184faf6\") "
Aug 05 16:36:54.205248 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.205217    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02edcf0-0b88-4f53-b717-17f47184faf6-kube-api-access-72fmv" (OuterVolumeSpecName: "kube-api-access-72fmv") pod "b02edcf0-0b88-4f53-b717-17f47184faf6" (UID: "b02edcf0-0b88-4f53-b717-17f47184faf6"). InnerVolumeSpecName "kube-api-access-72fmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:36:54.213607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.213576    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b02edcf0-0b88-4f53-b717-17f47184faf6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b02edcf0-0b88-4f53-b717-17f47184faf6" (UID: "b02edcf0-0b88-4f53-b717-17f47184faf6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:36:54.304896 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.304864    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b02edcf0-0b88-4f53-b717-17f47184faf6-tls-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:36:54.304896 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:54.304895    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72fmv\" (UniqueName: \"kubernetes.io/projected/b02edcf0-0b88-4f53-b717-17f47184faf6-kube-api-access-72fmv\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:36:55.138630 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:55.138602    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6566bd87d8-dnsks"
Aug 05 16:36:55.139071 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:55.138642    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6566bd87d8-dnsks" event={"ID":"b02edcf0-0b88-4f53-b717-17f47184faf6","Type":"ContainerDied","Data":"0984d06ce4bfb5ba618e94a7dda975c4c3a605eab6022c84fccdb07b4f279ffe"}
Aug 05 16:36:55.139071 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:55.138697    2576 scope.go:117] "RemoveContainer" containerID="da0676ea6302078b7512116412d495c36c5e6964e787e971da704b92b49db7ab"
Aug 05 16:36:55.158337 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:55.158316    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6566bd87d8-dnsks"]
Aug 05 16:36:55.162248 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:55.162228    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6566bd87d8-dnsks"]
Aug 05 16:36:55.991578 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:36:55.991546    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02edcf0-0b88-4f53-b717-17f47184faf6" path="/var/lib/kubelet/pods/b02edcf0-0b88-4f53-b717-17f47184faf6/volumes"
Aug 05 16:37:21.971943 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:21.971915    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:37:21.973855 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:21.973835    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:37:45.981315 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:45.981281    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-pn2hc"]
Aug 05 16:37:45.981862 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:45.981473    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc" podUID="e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" containerName="manager" containerID="cri-o://802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887" gracePeriod=30
Aug 05 16:37:46.237277 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.237221    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:37:46.292656 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.292622    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9p4\" (UniqueName: \"kubernetes.io/projected/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-kube-api-access-pt9p4\") pod \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") "
Aug 05 16:37:46.292837 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.292719    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-webhook-cert\") pod \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\" (UID: \"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe\") "
Aug 05 16:37:46.294874 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.294835    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" (UID: "e14b81fb-68ff-46ab-aab1-325dd1fc2ffe"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:37:46.295179 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.295153    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-kube-api-access-pt9p4" (OuterVolumeSpecName: "kube-api-access-pt9p4") pod "e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" (UID: "e14b81fb-68ff-46ab-aab1-325dd1fc2ffe"). InnerVolumeSpecName "kube-api-access-pt9p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:37:46.393772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.393738    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-webhook-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:37:46.393772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.393775    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9p4\" (UniqueName: \"kubernetes.io/projected/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe-kube-api-access-pt9p4\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:37:46.421208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.421173    2576 generic.go:356] "Generic (PLEG): container finished" podID="e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" containerID="802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887" exitCode=0
Aug 05 16:37:46.421393 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.421215    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc"
Aug 05 16:37:46.421393 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.421264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc" event={"ID":"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe","Type":"ContainerDied","Data":"802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887"}
Aug 05 16:37:46.421393 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.421324    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-pn2hc" event={"ID":"e14b81fb-68ff-46ab-aab1-325dd1fc2ffe","Type":"ContainerDied","Data":"604a6451c419b94f0c4e6be541352b3769428d0974b29289b2de3554095f51d6"}
Aug 05 16:37:46.421393 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.421358    2576 scope.go:117] "RemoveContainer" containerID="802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887"
Aug 05 16:37:46.430729 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.430707    2576 scope.go:117] "RemoveContainer" containerID="802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887"
Aug 05 16:37:46.430973 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:37:46.430955    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887\": container with ID starting with 802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887 not found: ID does not exist" containerID="802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887"
Aug 05 16:37:46.431070 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.430997    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887"} err="failed to get container status \"802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887\": rpc error: code = NotFound desc = could not find container \"802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887\": container with ID starting with 802cac3179001561d38af4f268666fe547e553058c4e6641507f451d06c93887 not found: ID does not exist"
Aug 05 16:37:46.444605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.444579    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-pn2hc"]
Aug 05 16:37:46.449906 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:46.449887    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-pn2hc"]
Aug 05 16:37:47.989816 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:37:47.989770    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" path="/var/lib/kubelet/pods/e14b81fb-68ff-46ab-aab1-325dd1fc2ffe/volumes"
Aug 05 16:38:47.255256 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.255184    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-zs4mz"]
Aug 05 16:38:47.257571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.255598    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" containerName="manager"
Aug 05 16:38:47.257571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.255610    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" containerName="manager"
Aug 05 16:38:47.257571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.255623    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02edcf0-0b88-4f53-b717-17f47184faf6" containerName="authorino"
Aug 05 16:38:47.257571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.255629    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02edcf0-0b88-4f53-b717-17f47184faf6" containerName="authorino"
Aug 05 16:38:47.257571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.255700    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02edcf0-0b88-4f53-b717-17f47184faf6" containerName="authorino"
Aug 05 16:38:47.257571 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.255716    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14b81fb-68ff-46ab-aab1-325dd1fc2ffe" containerName="manager"
Aug 05 16:38:47.258643 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.258628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.261873 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.261854    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:38:47.262725 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.262706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bfzbt\""
Aug 05 16:38:47.262833 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.262752    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:38:47.287802 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.287777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-zs4mz"]
Aug 05 16:38:47.351081 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.351037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-webhook-cert\") pod \"maas-controller-5b9f57f8bb-zs4mz\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") " pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.351247 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.351145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqmkn\" (UniqueName: \"kubernetes.io/projected/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-kube-api-access-bqmkn\") pod \"maas-controller-5b9f57f8bb-zs4mz\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") " pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.452126 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.452084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqmkn\" (UniqueName: \"kubernetes.io/projected/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-kube-api-access-bqmkn\") pod \"maas-controller-5b9f57f8bb-zs4mz\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") " pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.452302 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.452187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-webhook-cert\") pod \"maas-controller-5b9f57f8bb-zs4mz\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") " pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.454539 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.454516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-webhook-cert\") pod \"maas-controller-5b9f57f8bb-zs4mz\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") " pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.462098 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.462069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqmkn\" (UniqueName: \"kubernetes.io/projected/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-kube-api-access-bqmkn\") pod \"maas-controller-5b9f57f8bb-zs4mz\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") " pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.569444 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.569347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:47.708683 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.708659    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-zs4mz"]
Aug 05 16:38:47.711068 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:38:47.711028    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55313e2_a28e_41a6_b94e_2fbcb7a0e7f0.slice/crio-f97907703444de0439b4de51ec3a50c43484937ff33328976b4a5a55d376642f WatchSource:0}: Error finding container f97907703444de0439b4de51ec3a50c43484937ff33328976b4a5a55d376642f: Status 404 returned error can't find the container with id f97907703444de0439b4de51ec3a50c43484937ff33328976b4a5a55d376642f
Aug 05 16:38:47.727804 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:47.727773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz" event={"ID":"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0","Type":"ContainerStarted","Data":"f97907703444de0439b4de51ec3a50c43484937ff33328976b4a5a55d376642f"}
Aug 05 16:38:48.735472 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:48.735432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz" event={"ID":"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0","Type":"ContainerStarted","Data":"50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120"}
Aug 05 16:38:48.735865 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:48.735561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:38:48.755458 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:48.755413    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz" podStartSLOduration=1.255410951 podStartE2EDuration="1.755399055s" totalImagesPullingTime="499.988104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:38:48.752824801 +0000 UTC m=+987.259716528" watchObservedRunningTime="2026-08-05 16:38:48.755399055 +0000 UTC m=+987.262290782"
Aug 05 16:38:59.742820 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:38:59.742789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:39:04.384020 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.383988    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-zs4mz"]
Aug 05 16:39:04.384401 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.384190    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz" podUID="e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" containerName="manager" containerID="cri-o://50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120" gracePeriod=30
Aug 05 16:39:04.636141 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.636081    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:39:04.715425 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.715393    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqmkn\" (UniqueName: \"kubernetes.io/projected/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-kube-api-access-bqmkn\") pod \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") "
Aug 05 16:39:04.715615 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.715459    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-webhook-cert\") pod \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\" (UID: \"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0\") "
Aug 05 16:39:04.717515 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.717488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" (UID: "e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:39:04.717615 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.717493    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-kube-api-access-bqmkn" (OuterVolumeSpecName: "kube-api-access-bqmkn") pod "e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" (UID: "e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0"). InnerVolumeSpecName "kube-api-access-bqmkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:39:04.816114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.816082    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-webhook-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:39:04.816114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.816110    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqmkn\" (UniqueName: \"kubernetes.io/projected/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0-kube-api-access-bqmkn\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:39:04.828525 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.828494    2576 generic.go:356] "Generic (PLEG): container finished" podID="e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" containerID="50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120" exitCode=0
Aug 05 16:39:04.828687 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.828539    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz"
Aug 05 16:39:04.828687 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.828582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz" event={"ID":"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0","Type":"ContainerDied","Data":"50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120"}
Aug 05 16:39:04.828687 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.828647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-zs4mz" event={"ID":"e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0","Type":"ContainerDied","Data":"f97907703444de0439b4de51ec3a50c43484937ff33328976b4a5a55d376642f"}
Aug 05 16:39:04.828687 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.828680    2576 scope.go:117] "RemoveContainer" containerID="50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120"
Aug 05 16:39:04.838360 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.838342    2576 scope.go:117] "RemoveContainer" containerID="50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120"
Aug 05 16:39:04.838615 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:39:04.838596    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120\": container with ID starting with 50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120 not found: ID does not exist" containerID="50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120"
Aug 05 16:39:04.838665 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.838625    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120"} err="failed to get container status \"50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120\": rpc error: code = NotFound desc = could not find container \"50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120\": container with ID starting with 50dbad2c187c29468f5e301a6fc4a49215f0ebfc71e09aebabd808163af3e120 not found: ID does not exist"
Aug 05 16:39:04.852584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.852561    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-zs4mz"]
Aug 05 16:39:04.857456 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:04.857432    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-zs4mz"]
Aug 05 16:39:05.621945 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.621910    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-qvd49"]
Aug 05 16:39:05.622373 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.622359    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" containerName="manager"
Aug 05 16:39:05.622373 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.622373    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" containerName="manager"
Aug 05 16:39:05.622458 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.622449    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" containerName="manager"
Aug 05 16:39:05.627042 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.627026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.629511 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.629488    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:39:05.630195 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.630179    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bfzbt\""
Aug 05 16:39:05.630251 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.630223    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:39:05.638211 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.638189    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-qvd49"]
Aug 05 16:39:05.724376 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.724346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df524f16-b86f-4243-8a19-4900b05821b3-webhook-cert\") pod \"maas-controller-5b9f57f8bb-qvd49\" (UID: \"df524f16-b86f-4243-8a19-4900b05821b3\") " pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.724546 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.724404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jn8s\" (UniqueName: \"kubernetes.io/projected/df524f16-b86f-4243-8a19-4900b05821b3-kube-api-access-8jn8s\") pod \"maas-controller-5b9f57f8bb-qvd49\" (UID: \"df524f16-b86f-4243-8a19-4900b05821b3\") " pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.825431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.825391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df524f16-b86f-4243-8a19-4900b05821b3-webhook-cert\") pod \"maas-controller-5b9f57f8bb-qvd49\" (UID: \"df524f16-b86f-4243-8a19-4900b05821b3\") " pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.825582 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.825456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jn8s\" (UniqueName: \"kubernetes.io/projected/df524f16-b86f-4243-8a19-4900b05821b3-kube-api-access-8jn8s\") pod \"maas-controller-5b9f57f8bb-qvd49\" (UID: \"df524f16-b86f-4243-8a19-4900b05821b3\") " pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.827918 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.827898    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df524f16-b86f-4243-8a19-4900b05821b3-webhook-cert\") pod \"maas-controller-5b9f57f8bb-qvd49\" (UID: \"df524f16-b86f-4243-8a19-4900b05821b3\") " pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.836560 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.836526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jn8s\" (UniqueName: \"kubernetes.io/projected/df524f16-b86f-4243-8a19-4900b05821b3-kube-api-access-8jn8s\") pod \"maas-controller-5b9f57f8bb-qvd49\" (UID: \"df524f16-b86f-4243-8a19-4900b05821b3\") " pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.938892 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.938856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:05.994943 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:05.993351    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0" path="/var/lib/kubelet/pods/e55313e2-a28e-41a6-b94e-2fbcb7a0e7f0/volumes"
Aug 05 16:39:06.097340 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:06.097315    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b9f57f8bb-qvd49"]
Aug 05 16:39:06.099657 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:39:06.099633    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf524f16_b86f_4243_8a19_4900b05821b3.slice/crio-fb2dc5b2eda3b02e1205fba3d1b8553665e55349d87fa71a8fc5519e4bfe2f15 WatchSource:0}: Error finding container fb2dc5b2eda3b02e1205fba3d1b8553665e55349d87fa71a8fc5519e4bfe2f15: Status 404 returned error can't find the container with id fb2dc5b2eda3b02e1205fba3d1b8553665e55349d87fa71a8fc5519e4bfe2f15
Aug 05 16:39:06.843197 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:06.843169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-qvd49" event={"ID":"df524f16-b86f-4243-8a19-4900b05821b3","Type":"ContainerStarted","Data":"23d4a0f9b784f4785f36e52167b07ac079d4edc57a5cbd018ad908c4cee296b4"}
Aug 05 16:39:06.843553 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:06.843215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b9f57f8bb-qvd49" event={"ID":"df524f16-b86f-4243-8a19-4900b05821b3","Type":"ContainerStarted","Data":"fb2dc5b2eda3b02e1205fba3d1b8553665e55349d87fa71a8fc5519e4bfe2f15"}
Aug 05 16:39:06.843553 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:06.843245    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:39:06.868742 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:06.868695    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b9f57f8bb-qvd49" podStartSLOduration=1.318262488 podStartE2EDuration="1.868678843s" totalImagesPullingTime="550.416355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:06.865227615 +0000 UTC m=+1005.372119337" watchObservedRunningTime="2026-08-05 16:39:06.868678843 +0000 UTC m=+1005.375570555"
Aug 05 16:39:17.851782 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:39:17.851750    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b9f57f8bb-qvd49"
Aug 05 16:42:22.012175 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:42:22.012144    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:42:22.013725 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:42:22.013702    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:45:00.144520 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.144487    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp"]
Aug 05 16:45:00.148040 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.148015    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp"
Aug 05 16:45:00.150494 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.150473    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 16:45:00.157828 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.157811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp"
Aug 05 16:45:00.163557 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.163528    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp"]
Aug 05 16:45:00.512483 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.512405    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp"]
Aug 05 16:45:00.515789 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:45:00.515766    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23556a6_7602_42d0_8524_2fce033c6f4f.slice/crio-8bc7133cec7a2ef25a7cd2a7e22ff74889335b7cc67a7f67b3279742042676a8 WatchSource:0}: Error finding container 8bc7133cec7a2ef25a7cd2a7e22ff74889335b7cc67a7f67b3279742042676a8: Status 404 returned error can't find the container with id 8bc7133cec7a2ef25a7cd2a7e22ff74889335b7cc67a7f67b3279742042676a8
Aug 05 16:45:00.517656 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.517638    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:45:00.676250 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:00.676218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp" event={"ID":"d23556a6-7602-42d0-8524-2fce033c6f4f","Type":"ContainerStarted","Data":"8bc7133cec7a2ef25a7cd2a7e22ff74889335b7cc67a7f67b3279742042676a8"}
Aug 05 16:45:03.697071 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:03.696954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp" event={"ID":"d23556a6-7602-42d0-8524-2fce033c6f4f","Type":"ContainerStarted","Data":"b3299d225f47d14fc852c65f88b3bb520e24b27c548df1c8f6f88ce022fc5458"}
Aug 05 16:45:03.713666 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:03.713609    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp" podStartSLOduration=1.112612231 podStartE2EDuration="3.713585865s" totalImagesPullingTime="2.600973634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:03.711343649 +0000 UTC m=+1362.218235373" watchObservedRunningTime="2026-08-05 16:45:03.713585865 +0000 UTC m=+1362.220477576"
Aug 05 16:45:04.704255 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:04.704221    2576 generic.go:356] "Generic (PLEG): container finished" podID="d23556a6-7602-42d0-8524-2fce033c6f4f" containerID="b3299d225f47d14fc852c65f88b3bb520e24b27c548df1c8f6f88ce022fc5458" exitCode=0
Aug 05 16:45:04.704638 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:04.704313    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp" event={"ID":"d23556a6-7602-42d0-8524-2fce033c6f4f","Type":"ContainerDied","Data":"b3299d225f47d14fc852c65f88b3bb520e24b27c548df1c8f6f88ce022fc5458"}
Aug 05 16:45:05.850633 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:05.850609    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp"
Aug 05 16:45:06.716356 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:06.716330    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp"
Aug 05 16:45:06.716528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:06.716325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765805-4lvfp" event={"ID":"d23556a6-7602-42d0-8524-2fce033c6f4f","Type":"ContainerDied","Data":"8bc7133cec7a2ef25a7cd2a7e22ff74889335b7cc67a7f67b3279742042676a8"}
Aug 05 16:45:06.716528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:06.716452    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bc7133cec7a2ef25a7cd2a7e22ff74889335b7cc67a7f67b3279742042676a8"
Aug 05 16:45:31.338601 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.338565    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"]
Aug 05 16:45:31.339144 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.338761    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545" podUID="c388447c-d1a7-42de-81bf-6bd75ae4fd29" containerName="manager" containerID="cri-o://342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba" gracePeriod=10
Aug 05 16:45:31.602487 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.602430    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:45:31.643584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.643544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c388447c-d1a7-42de-81bf-6bd75ae4fd29-extensions-socket-volume\") pod \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") "
Aug 05 16:45:31.643768 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.643644    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrnpk\" (UniqueName: \"kubernetes.io/projected/c388447c-d1a7-42de-81bf-6bd75ae4fd29-kube-api-access-zrnpk\") pod \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\" (UID: \"c388447c-d1a7-42de-81bf-6bd75ae4fd29\") "
Aug 05 16:45:31.644035 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.644007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c388447c-d1a7-42de-81bf-6bd75ae4fd29-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c388447c-d1a7-42de-81bf-6bd75ae4fd29" (UID: "c388447c-d1a7-42de-81bf-6bd75ae4fd29"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:45:31.645785 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.645757    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c388447c-d1a7-42de-81bf-6bd75ae4fd29-kube-api-access-zrnpk" (OuterVolumeSpecName: "kube-api-access-zrnpk") pod "c388447c-d1a7-42de-81bf-6bd75ae4fd29" (UID: "c388447c-d1a7-42de-81bf-6bd75ae4fd29"). InnerVolumeSpecName "kube-api-access-zrnpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:45:31.745101 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.745065    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c388447c-d1a7-42de-81bf-6bd75ae4fd29-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:45:31.745101 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.745096    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrnpk\" (UniqueName: \"kubernetes.io/projected/c388447c-d1a7-42de-81bf-6bd75ae4fd29-kube-api-access-zrnpk\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:45:31.847999 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.847940    2576 generic.go:356] "Generic (PLEG): container finished" podID="c388447c-d1a7-42de-81bf-6bd75ae4fd29" containerID="342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba" exitCode=0
Aug 05 16:45:31.848161 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.848011    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"
Aug 05 16:45:31.848161 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.848011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545" event={"ID":"c388447c-d1a7-42de-81bf-6bd75ae4fd29","Type":"ContainerDied","Data":"342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba"}
Aug 05 16:45:31.848161 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.848072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545" event={"ID":"c388447c-d1a7-42de-81bf-6bd75ae4fd29","Type":"ContainerDied","Data":"e36a0686935dcf81fc34d1a5ca7fe2df52192d39eb116b857988778961e0bb99"}
Aug 05 16:45:31.848161 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.848103    2576 scope.go:117] "RemoveContainer" containerID="342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba"
Aug 05 16:45:31.857722 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.857707    2576 scope.go:117] "RemoveContainer" containerID="342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba"
Aug 05 16:45:31.857971 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:45:31.857952    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba\": container with ID starting with 342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba not found: ID does not exist" containerID="342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba"
Aug 05 16:45:31.858075 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.857991    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba"} err="failed to get container status \"342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba\": rpc error: code = NotFound desc = could not find container \"342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba\": container with ID starting with 342d827961064f1b3407febf03b92f8ad12576075c9df77dd4d37f7e5d7d2eba not found: ID does not exist"
Aug 05 16:45:31.870107 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.870085    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"]
Aug 05 16:45:31.876595 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.876571    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-fv545"]
Aug 05 16:45:31.990608 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:45:31.990566    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c388447c-d1a7-42de-81bf-6bd75ae4fd29" path="/var/lib/kubelet/pods/c388447c-d1a7-42de-81bf-6bd75ae4fd29/volumes"
Aug 05 16:46:32.033296 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.033259    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"]
Aug 05 16:46:32.033783 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.033663    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c388447c-d1a7-42de-81bf-6bd75ae4fd29" containerName="manager"
Aug 05 16:46:32.033783 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.033674    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c388447c-d1a7-42de-81bf-6bd75ae4fd29" containerName="manager"
Aug 05 16:46:32.033783 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.033694    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23556a6-7602-42d0-8524-2fce033c6f4f" containerName="cleanup"
Aug 05 16:46:32.033783 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.033700    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23556a6-7602-42d0-8524-2fce033c6f4f" containerName="cleanup"
Aug 05 16:46:32.033938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.033788    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23556a6-7602-42d0-8524-2fce033c6f4f" containerName="cleanup"
Aug 05 16:46:32.033938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.033797    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c388447c-d1a7-42de-81bf-6bd75ae4fd29" containerName="manager"
Aug 05 16:46:32.038117 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.038099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.040826 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.040803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5c7kl\""
Aug 05 16:46:32.053594 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.053567    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"]
Aug 05 16:46:32.093417 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.093390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mvj6v\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.093546 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.093463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c4v9\" (UniqueName: \"kubernetes.io/projected/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-kube-api-access-2c4v9\") pod \"kuadrant-operator-controller-manager-68cf589589-mvj6v\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.194655 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.194623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c4v9\" (UniqueName: \"kubernetes.io/projected/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-kube-api-access-2c4v9\") pod \"kuadrant-operator-controller-manager-68cf589589-mvj6v\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.194815 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.194684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mvj6v\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.195056 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.195039    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-mvj6v\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.204330 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.204303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c4v9\" (UniqueName: \"kubernetes.io/projected/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-kube-api-access-2c4v9\") pod \"kuadrant-operator-controller-manager-68cf589589-mvj6v\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.348136 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.348048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:32.498065 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:32.497974    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"]
Aug 05 16:46:32.500478 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:46:32.500448    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b1add0_4414_4fd8_b0cc_8f1dde2d2b28.slice/crio-ef332e0688a4114c16dd48e1b5af61c23ebd38739f57edfd867a26285e19f6ef WatchSource:0}: Error finding container ef332e0688a4114c16dd48e1b5af61c23ebd38739f57edfd867a26285e19f6ef: Status 404 returned error can't find the container with id ef332e0688a4114c16dd48e1b5af61c23ebd38739f57edfd867a26285e19f6ef
Aug 05 16:46:33.164777 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:33.164743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v" event={"ID":"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28","Type":"ContainerStarted","Data":"ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e"}
Aug 05 16:46:33.165200 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:33.164803    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v" event={"ID":"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28","Type":"ContainerStarted","Data":"ef332e0688a4114c16dd48e1b5af61c23ebd38739f57edfd867a26285e19f6ef"}
Aug 05 16:46:33.165200 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:33.164831    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:46:33.196429 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:33.196377    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v" podStartSLOduration=1.196362857 podStartE2EDuration="1.196362857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:33.194149655 +0000 UTC m=+1451.701041368" watchObservedRunningTime="2026-08-05 16:46:33.196362857 +0000 UTC m=+1451.703254569"
Aug 05 16:46:44.172310 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:46:44.172280    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 16:47:22.043823 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:47:22.043795    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:47:22.046917 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:47:22.046895    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:52:22.078262 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:52:22.078229    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:52:22.082465 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:52:22.082438    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:54:26.359768 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.359725    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"]
Aug 05 16:54:26.363538 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.363521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.366499 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.366467    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b701e0ce-openshift-default-dockercfg-8gldp\""
Aug 05 16:54:26.379989 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.379940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-certs\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-token\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-podinfo\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-envoy\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380114 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvzwm\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-kube-api-access-nvzwm\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380255 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-socket\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380255 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-credential-socket\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380255 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-data\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.380351 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.380252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istiod-ca-cert\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.397716 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.397683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"]
Aug 05 16:54:26.481115 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvzwm\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-kube-api-access-nvzwm\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481115 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-socket\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-credential-socket\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-data\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istiod-ca-cert\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-certs\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-token\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-podinfo\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-envoy\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481591    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-socket\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-credential-socket\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481662    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-data\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.481938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.481901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-certs\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.482201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.482116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istiod-ca-cert\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.483769 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.483753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-envoy\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.483991 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.483964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-podinfo\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.493066 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.493040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-token\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.493715 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.493696    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvzwm\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-kube-api-access-nvzwm\") pod \"e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") " pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.674416 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.674388    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:26.827887 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.827859    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"]
Aug 05 16:54:26.830018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:54:26.829962    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67507268_46aa_4e1c_9ac7_d2481df5b8aa.slice/crio-3d0264d5c0e40565387d0366f67b768563046f704f7b2f9406deb2c9f4dda404 WatchSource:0}: Error finding container 3d0264d5c0e40565387d0366f67b768563046f704f7b2f9406deb2c9f4dda404: Status 404 returned error can't find the container with id 3d0264d5c0e40565387d0366f67b768563046f704f7b2f9406deb2c9f4dda404
Aug 05 16:54:26.832262 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.832224    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:26.832347 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.832313    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:26.832392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:26.832356    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:27.669477 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:27.669434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" event={"ID":"67507268-46aa-4e1c-9ac7-d2481df5b8aa","Type":"ContainerStarted","Data":"455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec"}
Aug 05 16:54:27.669876 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:27.669499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" event={"ID":"67507268-46aa-4e1c-9ac7-d2481df5b8aa","Type":"ContainerStarted","Data":"3d0264d5c0e40565387d0366f67b768563046f704f7b2f9406deb2c9f4dda404"}
Aug 05 16:54:27.675549 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:27.675531    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:27.680617 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:27.680596    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:27.695759 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:27.695717    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podStartSLOduration=1.695703406 podStartE2EDuration="1.695703406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:27.691906769 +0000 UTC m=+1926.198798481" watchObservedRunningTime="2026-08-05 16:54:27.695703406 +0000 UTC m=+1926.202595118"
Aug 05 16:54:28.675128 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:28.675098    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:28.676168 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:28.676149    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:31.459695 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.459659    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"]
Aug 05 16:54:31.463451 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.463435    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.465810 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.465787    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b701e0ce-dockercfg-q5z9s\""
Aug 05 16:54:31.466117 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.466101    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b701e0ce\""
Aug 05 16:54:31.474446 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.474423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"]
Aug 05 16:54:31.517225 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.517188    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"]
Aug 05 16:54:31.520963 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.520940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.531577 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.531544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1ab627-b875-4db3-9a30-afb9b8d363c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.531772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.531752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tl2q\" (UniqueName: \"kubernetes.io/projected/9c1ab627-b875-4db3-9a30-afb9b8d363c7-kube-api-access-6tl2q\") pod \"payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.531886 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.531864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"]
Aug 05 16:54:31.632549 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.632514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkd4\" (UniqueName: \"kubernetes.io/projected/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-kube-api-access-4jkd4\") pod \"payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") " pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.632720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.632579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-plugins-config-volume\") pod \"payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") " pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.632720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.632639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tl2q\" (UniqueName: \"kubernetes.io/projected/9c1ab627-b875-4db3-9a30-afb9b8d363c7-kube-api-access-6tl2q\") pod \"payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.632720 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.632683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1ab627-b875-4db3-9a30-afb9b8d363c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.633356 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.633337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1ab627-b875-4db3-9a30-afb9b8d363c7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.641382 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.641357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tl2q\" (UniqueName: \"kubernetes.io/projected/9c1ab627-b875-4db3-9a30-afb9b8d363c7-kube-api-access-6tl2q\") pod \"payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.733568 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.733473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkd4\" (UniqueName: \"kubernetes.io/projected/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-kube-api-access-4jkd4\") pod \"payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") " pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.733568 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.733533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-plugins-config-volume\") pod \"payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") " pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.734331 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.734311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-plugins-config-volume\") pod \"payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") " pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.743942 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.743917    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkd4\" (UniqueName: \"kubernetes.io/projected/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-kube-api-access-4jkd4\") pod \"payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") " pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.775922 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.775887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:31.833313 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.832948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:31.945120 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.945082    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"]
Aug 05 16:54:31.946247 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:54:31.946206    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1ab627_b875_4db3_9a30_afb9b8d363c7.slice/crio-61412a38276ee8b17078f9cbe9114fb212de0d084aba074bd7e5349d253b5628 WatchSource:0}: Error finding container 61412a38276ee8b17078f9cbe9114fb212de0d084aba074bd7e5349d253b5628: Status 404 returned error can't find the container with id 61412a38276ee8b17078f9cbe9114fb212de0d084aba074bd7e5349d253b5628
Aug 05 16:54:31.996865 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:31.996840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"]
Aug 05 16:54:31.999129 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:54:31.999101    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8911d1fe_89bc_4f74_af0b_2e6923b9eaac.slice/crio-e3601e73c0315e340d8376c120a422cb69e15021dbbefc4503dca3b16db2dc43 WatchSource:0}: Error finding container e3601e73c0315e340d8376c120a422cb69e15021dbbefc4503dca3b16db2dc43: Status 404 returned error can't find the container with id e3601e73c0315e340d8376c120a422cb69e15021dbbefc4503dca3b16db2dc43
Aug 05 16:54:32.701895 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.701858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9" event={"ID":"8911d1fe-89bc-4f74-af0b-2e6923b9eaac","Type":"ContainerStarted","Data":"e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7"}
Aug 05 16:54:32.702404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.701925    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9" event={"ID":"8911d1fe-89bc-4f74-af0b-2e6923b9eaac","Type":"ContainerStarted","Data":"e3601e73c0315e340d8376c120a422cb69e15021dbbefc4503dca3b16db2dc43"}
Aug 05 16:54:32.702404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.701954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:32.704002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.703961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq" event={"ID":"9c1ab627-b875-4db3-9a30-afb9b8d363c7","Type":"ContainerStarted","Data":"2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a"}
Aug 05 16:54:32.704117 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.704035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq" event={"ID":"9c1ab627-b875-4db3-9a30-afb9b8d363c7","Type":"ContainerStarted","Data":"61412a38276ee8b17078f9cbe9114fb212de0d084aba074bd7e5349d253b5628"}
Aug 05 16:54:32.704117 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.704099    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:32.728012 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.727949    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9" podStartSLOduration=1.727934123 podStartE2EDuration="1.727934123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:32.726397463 +0000 UTC m=+1931.233289178" watchObservedRunningTime="2026-08-05 16:54:32.727934123 +0000 UTC m=+1931.234825835"
Aug 05 16:54:32.749908 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:32.749860    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq" podStartSLOduration=1.74984377 podStartE2EDuration="1.74984377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:32.748512704 +0000 UTC m=+1931.255404427" watchObservedRunningTime="2026-08-05 16:54:32.74984377 +0000 UTC m=+1931.256735481"
Aug 05 16:54:43.676348 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.676311    2576 patch_prober.go:28] interesting pod/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Aug 05 16:54:43.676792 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.676385    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Aug 05 16:54:43.712605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.712578    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:43.712746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.712645    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:43.770426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.770388    2576 generic.go:356] "Generic (PLEG): container finished" podID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerID="455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec" exitCode=0
Aug 05 16:54:43.770426 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.770416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" event={"ID":"67507268-46aa-4e1c-9ac7-d2481df5b8aa","Type":"ContainerDied","Data":"455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec"}
Aug 05 16:54:43.770845 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.770829    2576 scope.go:117] "RemoveContainer" containerID="455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec"
Aug 05 16:54:43.772126 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.772076    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:43.772256 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.772181    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:43.772256 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:43.772230    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:44.411056 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.411007    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"]
Aug 05 16:54:44.415122 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.415102    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"
Aug 05 16:54:44.417879 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.417857    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 16:54:44.423470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.423450    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"]
Aug 05 16:54:44.563740 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.563702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb52fb90-63ea-4f80-8aca-094acbb85b72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg\" (UID: \"fb52fb90-63ea-4f80-8aca-094acbb85b72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"
Aug 05 16:54:44.664671 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.664571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb52fb90-63ea-4f80-8aca-094acbb85b72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg\" (UID: \"fb52fb90-63ea-4f80-8aca-094acbb85b72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"
Aug 05 16:54:44.665211 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.665191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb52fb90-63ea-4f80-8aca-094acbb85b72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg\" (UID: \"fb52fb90-63ea-4f80-8aca-094acbb85b72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"
Aug 05 16:54:44.727878 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.727844    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"
Aug 05 16:54:44.778066 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:44.778023    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" event={"ID":"67507268-46aa-4e1c-9ac7-d2481df5b8aa","Type":"ContainerStarted","Data":"b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf"}
Aug 05 16:54:45.100912 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:45.100799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"]
Aug 05 16:54:45.112900 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:54:45.112851    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb52fb90_63ea_4f80_8aca_094acbb85b72.slice/crio-e183575b9d701f3f5d66bd4d2b0da44be8ef2acc9ca496864f4abaa6a90154a4 WatchSource:0}: Error finding container e183575b9d701f3f5d66bd4d2b0da44be8ef2acc9ca496864f4abaa6a90154a4: Status 404 returned error can't find the container with id e183575b9d701f3f5d66bd4d2b0da44be8ef2acc9ca496864f4abaa6a90154a4
Aug 05 16:54:45.674679 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:45.674600    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:45.674945 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:45.674920    2576 patch_prober.go:28] interesting pod/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Aug 05 16:54:45.675080 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:45.675019    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Aug 05 16:54:45.787023 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:45.786896    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg" event={"ID":"fb52fb90-63ea-4f80-8aca-094acbb85b72","Type":"ContainerStarted","Data":"bb0ee46c12448c9e65370e97599b55007fb1e3344cd801e98801cc268d66cba2"}
Aug 05 16:54:45.787023 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:45.786954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg" event={"ID":"fb52fb90-63ea-4f80-8aca-094acbb85b72","Type":"ContainerStarted","Data":"e183575b9d701f3f5d66bd4d2b0da44be8ef2acc9ca496864f4abaa6a90154a4"}
Aug 05 16:54:46.675375 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:46.675339    2576 patch_prober.go:28] interesting pod/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Aug 05 16:54:46.675548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:46.675425    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Aug 05 16:54:46.794967 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:46.794932    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb52fb90-63ea-4f80-8aca-094acbb85b72" containerID="bb0ee46c12448c9e65370e97599b55007fb1e3344cd801e98801cc268d66cba2" exitCode=0
Aug 05 16:54:46.795438 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:46.795020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg" event={"ID":"fb52fb90-63ea-4f80-8aca-094acbb85b72","Type":"ContainerDied","Data":"bb0ee46c12448c9e65370e97599b55007fb1e3344cd801e98801cc268d66cba2"}
Aug 05 16:54:47.675091 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:47.675046    2576 patch_prober.go:28] interesting pod/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Aug 05 16:54:47.675313 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:47.675116    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Aug 05 16:54:47.979827 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:47.979798    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"
Aug 05 16:54:48.119597 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.119558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb52fb90-63ea-4f80-8aca-094acbb85b72-maas-api-service-ca\") pod \"fb52fb90-63ea-4f80-8aca-094acbb85b72\" (UID: \"fb52fb90-63ea-4f80-8aca-094acbb85b72\") "
Aug 05 16:54:48.119893 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.119867    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb52fb90-63ea-4f80-8aca-094acbb85b72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb52fb90-63ea-4f80-8aca-094acbb85b72" (UID: "fb52fb90-63ea-4f80-8aca-094acbb85b72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:54:48.120028 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.120013    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb52fb90-63ea-4f80-8aca-094acbb85b72-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:48.675253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.675217    2576 patch_prober.go:28] interesting pod/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Aug 05 16:54:48.675433 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.675269    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Aug 05 16:54:48.814078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.814042    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"
Aug 05 16:54:48.814242 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.814081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg" event={"ID":"fb52fb90-63ea-4f80-8aca-094acbb85b72","Type":"ContainerDied","Data":"e183575b9d701f3f5d66bd4d2b0da44be8ef2acc9ca496864f4abaa6a90154a4"}
Aug 05 16:54:48.814242 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:48.814131    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e183575b9d701f3f5d66bd4d2b0da44be8ef2acc9ca496864f4abaa6a90154a4"
Aug 05 16:54:49.675840 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:49.675803    2576 patch_prober.go:28] interesting pod/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Aug 05 16:54:49.676350 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:49.675863    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Aug 05 16:54:49.883379 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:49.883337    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"]
Aug 05 16:54:49.883569 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:49.883546    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9" podUID="8911d1fe-89bc-4f74-af0b-2e6923b9eaac" containerName="payload-processing" containerID="cri-o://e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7" gracePeriod=30
Aug 05 16:54:49.898489 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:49.897092    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"]
Aug 05 16:54:49.898489 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:49.897502    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq" podUID="9c1ab627-b875-4db3-9a30-afb9b8d363c7" containerName="payload-pre-processing" containerID="cri-o://2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a" gracePeriod=30
Aug 05 16:54:50.199432 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.199405    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:50.204958 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.204873    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:50.223398 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.223355    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"]
Aug 05 16:54:50.232037 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.231948    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b701e0ce-xz2gg"]
Aug 05 16:54:50.341319 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.341278    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-plugins-config-volume\") pod \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") "
Aug 05 16:54:50.341470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.341350    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jkd4\" (UniqueName: \"kubernetes.io/projected/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-kube-api-access-4jkd4\") pod \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\" (UID: \"8911d1fe-89bc-4f74-af0b-2e6923b9eaac\") "
Aug 05 16:54:50.341470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.341442    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tl2q\" (UniqueName: \"kubernetes.io/projected/9c1ab627-b875-4db3-9a30-afb9b8d363c7-kube-api-access-6tl2q\") pod \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") "
Aug 05 16:54:50.341561 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.341493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1ab627-b875-4db3-9a30-afb9b8d363c7-plugins-config-volume\") pod \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\" (UID: \"9c1ab627-b875-4db3-9a30-afb9b8d363c7\") "
Aug 05 16:54:50.341765 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.341737    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8911d1fe-89bc-4f74-af0b-2e6923b9eaac" (UID: "8911d1fe-89bc-4f74-af0b-2e6923b9eaac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:54:50.341858 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.341824    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-plugins-config-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:50.342121 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.342098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c1ab627-b875-4db3-9a30-afb9b8d363c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c1ab627-b875-4db3-9a30-afb9b8d363c7" (UID: "9c1ab627-b875-4db3-9a30-afb9b8d363c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:54:50.345814 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.345784    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-kube-api-access-4jkd4" (OuterVolumeSpecName: "kube-api-access-4jkd4") pod "8911d1fe-89bc-4f74-af0b-2e6923b9eaac" (UID: "8911d1fe-89bc-4f74-af0b-2e6923b9eaac"). InnerVolumeSpecName "kube-api-access-4jkd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:54:50.345925 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.345803    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c1ab627-b875-4db3-9a30-afb9b8d363c7-kube-api-access-6tl2q" (OuterVolumeSpecName: "kube-api-access-6tl2q") pod "9c1ab627-b875-4db3-9a30-afb9b8d363c7" (UID: "9c1ab627-b875-4db3-9a30-afb9b8d363c7"). InnerVolumeSpecName "kube-api-access-6tl2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:54:50.364812 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.364782    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"]
Aug 05 16:54:50.365042 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.365009    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy" containerID="cri-o://b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf" gracePeriod=30
Aug 05 16:54:50.442836 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.442797    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1ab627-b875-4db3-9a30-afb9b8d363c7-plugins-config-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:50.442836 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.442830    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jkd4\" (UniqueName: \"kubernetes.io/projected/8911d1fe-89bc-4f74-af0b-2e6923b9eaac-kube-api-access-4jkd4\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:50.442836 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.442840    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tl2q\" (UniqueName: \"kubernetes.io/projected/9c1ab627-b875-4db3-9a30-afb9b8d363c7-kube-api-access-6tl2q\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:50.832405 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.832364    2576 generic.go:356] "Generic (PLEG): container finished" podID="8911d1fe-89bc-4f74-af0b-2e6923b9eaac" containerID="e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7" exitCode=0
Aug 05 16:54:50.832870 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.832419    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"
Aug 05 16:54:50.832870 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.832444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9" event={"ID":"8911d1fe-89bc-4f74-af0b-2e6923b9eaac","Type":"ContainerDied","Data":"e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7"}
Aug 05 16:54:50.832870 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.832554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9" event={"ID":"8911d1fe-89bc-4f74-af0b-2e6923b9eaac","Type":"ContainerDied","Data":"e3601e73c0315e340d8376c120a422cb69e15021dbbefc4503dca3b16db2dc43"}
Aug 05 16:54:50.832870 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.832588    2576 scope.go:117] "RemoveContainer" containerID="e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7"
Aug 05 16:54:50.834072 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.834049    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c1ab627-b875-4db3-9a30-afb9b8d363c7" containerID="2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a" exitCode=0
Aug 05 16:54:50.834270 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.834113    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"
Aug 05 16:54:50.834270 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.834143    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq" event={"ID":"9c1ab627-b875-4db3-9a30-afb9b8d363c7","Type":"ContainerDied","Data":"2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a"}
Aug 05 16:54:50.834270 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.834189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq" event={"ID":"9c1ab627-b875-4db3-9a30-afb9b8d363c7","Type":"ContainerDied","Data":"61412a38276ee8b17078f9cbe9114fb212de0d084aba074bd7e5349d253b5628"}
Aug 05 16:54:50.843743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.843726    2576 scope.go:117] "RemoveContainer" containerID="e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7"
Aug 05 16:54:50.843974 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:54:50.843955    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7\": container with ID starting with e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7 not found: ID does not exist" containerID="e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7"
Aug 05 16:54:50.844067 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.844012    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7"} err="failed to get container status \"e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7\": rpc error: code = NotFound desc = could not find container \"e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7\": container with ID starting with e78368721263f4462f23c0482a10127f001558f47508635f1f511455f0c620c7 not found: ID does not exist"
Aug 05 16:54:50.844067 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.844035    2576 scope.go:117] "RemoveContainer" containerID="2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a"
Aug 05 16:54:50.853181 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.853162    2576 scope.go:117] "RemoveContainer" containerID="2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a"
Aug 05 16:54:50.853412 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:54:50.853394    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a\": container with ID starting with 2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a not found: ID does not exist" containerID="2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a"
Aug 05 16:54:50.853467 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.853419    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a"} err="failed to get container status \"2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a\": rpc error: code = NotFound desc = could not find container \"2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a\": container with ID starting with 2c54e6ae459a04e3217f0e414672d9ad7970e54b0410a3629e00309de01a978a not found: ID does not exist"
Aug 05 16:54:50.881059 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.881032    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"]
Aug 05 16:54:50.893363 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.893338    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b701e0ce-644b5f9448-f4wgq"]
Aug 05 16:54:50.929741 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.929706    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"]
Aug 05 16:54:50.944526 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:50.944498    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b701e0ce-6bdf44bdf8-clwv9"]
Aug 05 16:54:51.441063 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441035    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"]
Aug 05 16:54:51.441470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441456    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c1ab627-b875-4db3-9a30-afb9b8d363c7" containerName="payload-pre-processing"
Aug 05 16:54:51.441470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441470    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c1ab627-b875-4db3-9a30-afb9b8d363c7" containerName="payload-pre-processing"
Aug 05 16:54:51.441584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441491    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb52fb90-63ea-4f80-8aca-094acbb85b72" containerName="revoke-keys"
Aug 05 16:54:51.441584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441497    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb52fb90-63ea-4f80-8aca-094acbb85b72" containerName="revoke-keys"
Aug 05 16:54:51.441584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441506    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8911d1fe-89bc-4f74-af0b-2e6923b9eaac" containerName="payload-processing"
Aug 05 16:54:51.441584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441512    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8911d1fe-89bc-4f74-af0b-2e6923b9eaac" containerName="payload-processing"
Aug 05 16:54:51.441584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441570    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c1ab627-b875-4db3-9a30-afb9b8d363c7" containerName="payload-pre-processing"
Aug 05 16:54:51.441584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441580    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8911d1fe-89bc-4f74-af0b-2e6923b9eaac" containerName="payload-processing"
Aug 05 16:54:51.441584 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.441589    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb52fb90-63ea-4f80-8aca-094acbb85b72" containerName="revoke-keys"
Aug 05 16:54:51.445869 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.445854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.449215 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.449193    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-dfc96bfb-gw-openshift-default-dockercfg-jb885\""
Aug 05 16:54:51.466502 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.466479    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"]
Aug 05 16:54:51.553541 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-certs\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553699 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-token\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553699 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-podinfo\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553790 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqps2\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-kube-api-access-jqps2\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553827 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-socket\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553868 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-data\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553868 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-credential-socket\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553956 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac63251f-5c7e-4df3-b274-879f2e3be938-istiod-ca-cert\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.553956 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.553903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-envoy\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655401 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-credential-socket\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655401 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac63251f-5c7e-4df3-b274-879f2e3be938-istiod-ca-cert\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655637 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-envoy\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655637 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-certs\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655637 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-token\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655797 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-podinfo\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655797 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqps2\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-kube-api-access-jqps2\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-socket\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-credential-socket\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-data\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.655901 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.655873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-certs\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.656145 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.656100    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-socket\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.656199 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.656157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-data\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.656290 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.656271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac63251f-5c7e-4df3-b274-879f2e3be938-istiod-ca-cert\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.657895 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.657872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-envoy\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.658447 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.658424    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-podinfo\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.667915 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.667895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqps2\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-kube-api-access-jqps2\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.668864 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.668845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-token\") pod \"e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") " pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.756380 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.756297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:51.906247 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.906222    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"]
Aug 05 16:54:51.908549 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:54:51.908513    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac63251f_5c7e_4df3_b274_879f2e3be938.slice/crio-61ad173c4265dbad7642230df74ce27ee171fc7b87432de1a320e3bd7e5c1aaa WatchSource:0}: Error finding container 61ad173c4265dbad7642230df74ce27ee171fc7b87432de1a320e3bd7e5c1aaa: Status 404 returned error can't find the container with id 61ad173c4265dbad7642230df74ce27ee171fc7b87432de1a320e3bd7e5c1aaa
Aug 05 16:54:51.910731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.910699    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:51.910829 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.910766    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:51.910829 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.910797    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:54:51.993407 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.993373    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8911d1fe-89bc-4f74-af0b-2e6923b9eaac" path="/var/lib/kubelet/pods/8911d1fe-89bc-4f74-af0b-2e6923b9eaac/volumes"
Aug 05 16:54:51.993958 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.993936    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c1ab627-b875-4db3-9a30-afb9b8d363c7" path="/var/lib/kubelet/pods/9c1ab627-b875-4db3-9a30-afb9b8d363c7/volumes"
Aug 05 16:54:51.994424 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:51.994404    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb52fb90-63ea-4f80-8aca-094acbb85b72" path="/var/lib/kubelet/pods/fb52fb90-63ea-4f80-8aca-094acbb85b72/volumes"
Aug 05 16:54:52.850523 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:52.850490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" event={"ID":"ac63251f-5c7e-4df3-b274-879f2e3be938","Type":"ContainerStarted","Data":"d7294d27ed5030a85f08ef7ac3ac53d556912fbfd675acd301114f89a780221d"}
Aug 05 16:54:52.850704 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:52.850542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" event={"ID":"ac63251f-5c7e-4df3-b274-879f2e3be938","Type":"ContainerStarted","Data":"61ad173c4265dbad7642230df74ce27ee171fc7b87432de1a320e3bd7e5c1aaa"}
Aug 05 16:54:52.874394 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:52.874338    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podStartSLOduration=1.874320397 podStartE2EDuration="1.874320397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:52.872001929 +0000 UTC m=+1951.378893659" watchObservedRunningTime="2026-08-05 16:54:52.874320397 +0000 UTC m=+1951.381212111"
Aug 05 16:54:53.756654 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:53.756611    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:53.762044 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:53.762018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:53.855752 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:53.855720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:53.856756 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:53.856737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:54:55.395442 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.395407    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"]
Aug 05 16:54:55.399253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.399231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.402178 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.402156    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-dfc96bfb\""
Aug 05 16:54:55.402277 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.402216    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-dfc96bfb-dockercfg-g4d72\""
Aug 05 16:54:55.414746 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.414719    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"]
Aug 05 16:54:55.494079 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.494047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w7bz\" (UniqueName: \"kubernetes.io/projected/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-kube-api-access-8w7bz\") pod \"payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.494226 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.494114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.595003 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.594871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w7bz\" (UniqueName: \"kubernetes.io/projected/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-kube-api-access-8w7bz\") pod \"payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.595003 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.594959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.599018 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.596070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.606944 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.606920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w7bz\" (UniqueName: \"kubernetes.io/projected/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-kube-api-access-8w7bz\") pod \"payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.633026 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.633007    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:55.695690 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695660    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istiod-ca-cert\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.695841 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695702    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-envoy\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.695841 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-socket\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.695841 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-data\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.695841 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695775    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-podinfo\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.696122 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695852    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvzwm\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-kube-api-access-nvzwm\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.696122 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695874    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-certs\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.696122 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695938    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-token\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.696122 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.695975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-credential-socket\") pod \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\" (UID: \"67507268-46aa-4e1c-9ac7-d2481df5b8aa\") "
Aug 05 16:54:55.696311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.696216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:54:55.696311 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.696237    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:54:55.696413 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.696372    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.696413 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.696391    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.696508 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.696465    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:54:55.696698 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.696674    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:54:55.696813 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.696792    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:54:55.698078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.698046    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:54:55.698248 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.698231    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:54:55.698410 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.698386    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 16:54:55.698410 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.698397    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-kube-api-access-nvzwm" (OuterVolumeSpecName: "kube-api-access-nvzwm") pod "67507268-46aa-4e1c-9ac7-d2481df5b8aa" (UID: "67507268-46aa-4e1c-9ac7-d2481df5b8aa"). InnerVolumeSpecName "kube-api-access-nvzwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:54:55.749904 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.749868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:55.797771 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.797738    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.797771 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.797767    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.797771 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.797776    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.797771 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.797785    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.798076 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.797795    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvzwm\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-kube-api-access-nvzwm\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.798076 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.797809    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67507268-46aa-4e1c-9ac7-d2481df5b8aa-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.798076 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.797820    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67507268-46aa-4e1c-9ac7-d2481df5b8aa-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:54:55.876187 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.876156    2576 generic.go:356] "Generic (PLEG): container finished" podID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerID="b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf" exitCode=0
Aug 05 16:54:55.876367 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.876211    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"
Aug 05 16:54:55.876367 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.876246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" event={"ID":"67507268-46aa-4e1c-9ac7-d2481df5b8aa","Type":"ContainerDied","Data":"b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf"}
Aug 05 16:54:55.876367 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.876319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg" event={"ID":"67507268-46aa-4e1c-9ac7-d2481df5b8aa","Type":"ContainerDied","Data":"3d0264d5c0e40565387d0366f67b768563046f704f7b2f9406deb2c9f4dda404"}
Aug 05 16:54:55.876367 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.876350    2576 scope.go:117] "RemoveContainer" containerID="b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf"
Aug 05 16:54:55.886692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.886659    2576 scope.go:117] "RemoveContainer" containerID="455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec"
Aug 05 16:54:55.895343 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.895321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"]
Aug 05 16:54:55.897361 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.897337    2576 scope.go:117] "RemoveContainer" containerID="b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf"
Aug 05 16:54:55.897717 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:54:55.897694    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf\": container with ID starting with b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf not found: ID does not exist" containerID="b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf"
Aug 05 16:54:55.897809 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.897728    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf"} err="failed to get container status \"b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf\": rpc error: code = NotFound desc = could not find container \"b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf\": container with ID starting with b5f0dad8f31185d440515f0855bf16a2b4c98b32fce282bc9bb809a07e81b5cf not found: ID does not exist"
Aug 05 16:54:55.897809 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.897751    2576 scope.go:117] "RemoveContainer" containerID="455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec"
Aug 05 16:54:55.898074 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:54:55.898052    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec\": container with ID starting with 455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec not found: ID does not exist" containerID="455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec"
Aug 05 16:54:55.898139 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.898081    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec"} err="failed to get container status \"455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec\": rpc error: code = NotFound desc = could not find container \"455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec\": container with ID starting with 455d23dd3b4cab5a55d6c8f3a9c99570aa515124623fdb1c7dd38cbefb0799ec not found: ID does not exist"
Aug 05 16:54:55.899066 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:54:55.899046    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e2da1b_5a8c_4260_a0a7_75bcfee19a8b.slice/crio-0b1fdc48ee42b44934ace6c8934ff9ea673a2c3f4580d960b060ceb3494b68af WatchSource:0}: Error finding container 0b1fdc48ee42b44934ace6c8934ff9ea673a2c3f4580d960b060ceb3494b68af: Status 404 returned error can't find the container with id 0b1fdc48ee42b44934ace6c8934ff9ea673a2c3f4580d960b060ceb3494b68af
Aug 05 16:54:55.905309 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.905287    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"]
Aug 05 16:54:55.912784 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.912763    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b701e0ce-openshift-default-5747865546-x5kdg"]
Aug 05 16:54:55.994304 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:55.994265    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" path="/var/lib/kubelet/pods/67507268-46aa-4e1c-9ac7-d2481df5b8aa/volumes"
Aug 05 16:54:56.886504 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:56.886462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r" event={"ID":"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b","Type":"ContainerStarted","Data":"8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b"}
Aug 05 16:54:56.887070 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:56.886534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r" event={"ID":"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b","Type":"ContainerStarted","Data":"0b1fdc48ee42b44934ace6c8934ff9ea673a2c3f4580d960b060ceb3494b68af"}
Aug 05 16:54:56.887070 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:56.886567    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:54:56.922185 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:54:56.922129    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r" podStartSLOduration=1.922113859 podStartE2EDuration="1.922113859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:54:56.921877932 +0000 UTC m=+1955.428769644" watchObservedRunningTime="2026-08-05 16:54:56.922113859 +0000 UTC m=+1955.429005570"
Aug 05 16:55:06.956638 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:06.956558    2576 generic.go:356] "Generic (PLEG): container finished" podID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerID="d7294d27ed5030a85f08ef7ac3ac53d556912fbfd675acd301114f89a780221d" exitCode=0
Aug 05 16:55:06.957062 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:06.956631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" event={"ID":"ac63251f-5c7e-4df3-b274-879f2e3be938","Type":"ContainerDied","Data":"d7294d27ed5030a85f08ef7ac3ac53d556912fbfd675acd301114f89a780221d"}
Aug 05 16:55:06.957116 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:06.957097    2576 scope.go:117] "RemoveContainer" containerID="d7294d27ed5030a85f08ef7ac3ac53d556912fbfd675acd301114f89a780221d"
Aug 05 16:55:06.958091 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:06.958064    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:06.958161 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:06.958148    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:06.958199 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:06.958182    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:07.896674 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:07.896631    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:55:07.965694 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:07.965664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" event={"ID":"ac63251f-5c7e-4df3-b274-879f2e3be938","Type":"ContainerStarted","Data":"18589cf421d00e6061572aadd08400254f7675cb605748517d8cf53fbf0867c9"}
Aug 05 16:55:08.756900 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:08.756858    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:55:08.757738 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:08.757712    2576 patch_prober.go:28] interesting pod/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 16:55:08.757844 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:08.757797    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 16:55:08.856227 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:08.856193    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:55:09.757632 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:09.757598    2576 patch_prober.go:28] interesting pod/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 16:55:09.758050 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:09.757651    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 16:55:10.757053 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:10.757017    2576 patch_prober.go:28] interesting pod/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 16:55:10.757216 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:10.757100    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 16:55:11.757544 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:11.757512    2576 patch_prober.go:28] interesting pod/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 16:55:11.757911 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:11.757583    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 16:55:12.757593 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:12.757554    2576 patch_prober.go:28] interesting pod/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 16:55:12.758093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:12.757617    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 16:55:13.760646 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:13.760612    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:55:13.761673 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:13.761654    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:55:19.345476 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.345395    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"]
Aug 05 16:55:19.345891 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.345877    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy"
Aug 05 16:55:19.345938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.345893    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy"
Aug 05 16:55:19.345938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.345916    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy"
Aug 05 16:55:19.345938 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.345922    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy"
Aug 05 16:55:19.346049 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.346001    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy"
Aug 05 16:55:19.349272 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.349257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"
Aug 05 16:55:19.351459 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.351438    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 16:55:19.356370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.356337    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"]
Aug 05 16:55:19.431791 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.431756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6\" (UID: \"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"
Aug 05 16:55:19.532495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.532457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6\" (UID: \"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"
Aug 05 16:55:19.533130 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.533110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6\" (UID: \"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"
Aug 05 16:55:19.661851 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.661806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"
Aug 05 16:55:19.799514 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:19.799487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"]
Aug 05 16:55:19.801495 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:55:19.801464    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7b4ed6_9a4d_48a9_b28a_f1bf3a145547.slice/crio-d8577b0c62fed5f01fb02d0dda64640fa09a18a2116081dc691f0bc8549415db WatchSource:0}: Error finding container d8577b0c62fed5f01fb02d0dda64640fa09a18a2116081dc691f0bc8549415db: Status 404 returned error can't find the container with id d8577b0c62fed5f01fb02d0dda64640fa09a18a2116081dc691f0bc8549415db
Aug 05 16:55:20.033666 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:20.033633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6" event={"ID":"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547","Type":"ContainerStarted","Data":"d8577b0c62fed5f01fb02d0dda64640fa09a18a2116081dc691f0bc8549415db"}
Aug 05 16:55:21.040884 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:21.040849    2576 generic.go:356] "Generic (PLEG): container finished" podID="0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547" containerID="15fe92e560522b389b7e4ac83fac4ff98312950ed2ffbabc91e9f642ee078149" exitCode=0
Aug 05 16:55:21.041306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:21.040942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6" event={"ID":"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547","Type":"ContainerDied","Data":"15fe92e560522b389b7e4ac83fac4ff98312950ed2ffbabc91e9f642ee078149"}
Aug 05 16:55:22.191228 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:22.191200    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"
Aug 05 16:55:22.258454 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:22.258428    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547-maas-api-service-ca\") pod \"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547\" (UID: \"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547\") "
Aug 05 16:55:22.258745 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:22.258723    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547" (UID: "0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:22.359863 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:22.359782    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:23.053126 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:23.053094    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"
Aug 05 16:55:23.053280 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:23.053125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6" event={"ID":"0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547","Type":"ContainerDied","Data":"d8577b0c62fed5f01fb02d0dda64640fa09a18a2116081dc691f0bc8549415db"}
Aug 05 16:55:23.053280 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:23.053171    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8577b0c62fed5f01fb02d0dda64640fa09a18a2116081dc691f0bc8549415db"
Aug 05 16:55:25.499623 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.499587    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"]
Aug 05 16:55:25.500130 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.499834    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r" podUID="05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" containerName="payload-pre-processing" containerID="cri-o://8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b" gracePeriod=30
Aug 05 16:55:25.690166 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.690097    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"]
Aug 05 16:55:25.697553 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.697519    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dfc96bfb-ctjp6"]
Aug 05 16:55:25.763867 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.763804    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:55:25.865768 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.865730    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"]
Aug 05 16:55:25.866005 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.865943    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy" containerID="cri-o://18589cf421d00e6061572aadd08400254f7675cb605748517d8cf53fbf0867c9" gracePeriod=30
Aug 05 16:55:25.898587 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.898551    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-plugins-config-volume\") pod \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") "
Aug 05 16:55:25.898755 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.898607    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w7bz\" (UniqueName: \"kubernetes.io/projected/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-kube-api-access-8w7bz\") pod \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\" (UID: \"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b\") "
Aug 05 16:55:25.898945 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.898921    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" (UID: "05e2da1b-5a8c-4260-a0a7-75bcfee19a8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:25.900629 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.900605    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-kube-api-access-8w7bz" (OuterVolumeSpecName: "kube-api-access-8w7bz") pod "05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" (UID: "05e2da1b-5a8c-4260-a0a7-75bcfee19a8b"). InnerVolumeSpecName "kube-api-access-8w7bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:55:25.992770 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.992733    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547" path="/var/lib/kubelet/pods/0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547/volumes"
Aug 05 16:55:25.999372 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.999350    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-plugins-config-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:25.999372 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:25.999372    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w7bz\" (UniqueName: \"kubernetes.io/projected/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b-kube-api-access-8w7bz\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:26.072570 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.072484    2576 generic.go:356] "Generic (PLEG): container finished" podID="05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" containerID="8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b" exitCode=0
Aug 05 16:55:26.072731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.072586    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"
Aug 05 16:55:26.072731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.072591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r" event={"ID":"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b","Type":"ContainerDied","Data":"8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b"}
Aug 05 16:55:26.072731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.072704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r" event={"ID":"05e2da1b-5a8c-4260-a0a7-75bcfee19a8b","Type":"ContainerDied","Data":"0b1fdc48ee42b44934ace6c8934ff9ea673a2c3f4580d960b060ceb3494b68af"}
Aug 05 16:55:26.072731 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.072731    2576 scope.go:117] "RemoveContainer" containerID="8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b"
Aug 05 16:55:26.081697 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.081674    2576 scope.go:117] "RemoveContainer" containerID="8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b"
Aug 05 16:55:26.081971 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:55:26.081946    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b\": container with ID starting with 8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b not found: ID does not exist" containerID="8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b"
Aug 05 16:55:26.082094 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.081989    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b"} err="failed to get container status \"8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b\": rpc error: code = NotFound desc = could not find container \"8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b\": container with ID starting with 8ef54acad3906cb49daf1fbe40d29d5fdf35583b182db0b50d2ff8fb7c748c7b not found: ID does not exist"
Aug 05 16:55:26.104223 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.104195    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"]
Aug 05 16:55:26.112370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.112350    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-dfc96bfb-694b7b94b8-plf6r"]
Aug 05 16:55:26.699772 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.699739    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"]
Aug 05 16:55:26.700248 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.700231    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547" containerName="revoke-keys"
Aug 05 16:55:26.700303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.700249    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547" containerName="revoke-keys"
Aug 05 16:55:26.700303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.700274    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" containerName="payload-pre-processing"
Aug 05 16:55:26.700303 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.700280    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" containerName="payload-pre-processing"
Aug 05 16:55:26.700400 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.700348    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7b4ed6-9a4d-48a9-b28a-f1bf3a145547" containerName="revoke-keys"
Aug 05 16:55:26.700400 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.700357    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" containerName="payload-pre-processing"
Aug 05 16:55:26.700400 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.700365    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="67507268-46aa-4e1c-9ac7-d2481df5b8aa" containerName="istio-proxy"
Aug 05 16:55:26.704777 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.704756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.711066 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.711041    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3a6cf6a5-openshift-default-dockercfg-gh8rr\""
Aug 05 16:55:26.728559 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.728535    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"]
Aug 05 16:55:26.806842 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.806799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-envoy\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.806860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-data\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.806889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-socket\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807055 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.806908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79rqr\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-kube-api-access-79rqr\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.807077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-certs\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.807143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4983f122-c49d-42f0-9116-2f52eea0f238-istiod-ca-cert\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.807203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-istio-token\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807253 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.807243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-credential-socket\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.807417 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.807273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4983f122-c49d-42f0-9116-2f52eea0f238-istio-podinfo\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.907992 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.907946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-istio-token\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-credential-socket\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4983f122-c49d-42f0-9116-2f52eea0f238-istio-podinfo\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-envoy\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-data\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-socket\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908208 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79rqr\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-kube-api-access-79rqr\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908494 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-certs\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908494 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4983f122-c49d-42f0-9116-2f52eea0f238-istiod-ca-cert\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908494 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-credential-socket\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908629 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-data\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908686 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-certs\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.908815 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.908794    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-socket\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.909092 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.909073    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4983f122-c49d-42f0-9116-2f52eea0f238-istiod-ca-cert\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.910645 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.910628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-envoy\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.910779 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.910763    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4983f122-c49d-42f0-9116-2f52eea0f238-istio-podinfo\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.919072 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.919050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-istio-token\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:26.919727 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:26.919708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79rqr\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-kube-api-access-79rqr\") pod \"e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") " pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:27.015000 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:27.014884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:27.156079 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:27.156052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"]
Aug 05 16:55:27.158157 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:55:27.158128    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4983f122_c49d_42f0_9116_2f52eea0f238.slice/crio-f69f0a7ce9f7ca17af5b6836c7255317202a3e15b78cbc9a8fd8123fe9c3cef9 WatchSource:0}: Error finding container f69f0a7ce9f7ca17af5b6836c7255317202a3e15b78cbc9a8fd8123fe9c3cef9: Status 404 returned error can't find the container with id f69f0a7ce9f7ca17af5b6836c7255317202a3e15b78cbc9a8fd8123fe9c3cef9
Aug 05 16:55:27.160381 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:27.160353    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:27.160450 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:27.160420    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:27.160495 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:27.160447    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:27.991329 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:27.991294    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e2da1b-5a8c-4260-a0a7-75bcfee19a8b" path="/var/lib/kubelet/pods/05e2da1b-5a8c-4260-a0a7-75bcfee19a8b/volumes"
Aug 05 16:55:28.095579 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:28.095538    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" event={"ID":"4983f122-c49d-42f0-9116-2f52eea0f238","Type":"ContainerStarted","Data":"db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1"}
Aug 05 16:55:28.095771 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:28.095651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" event={"ID":"4983f122-c49d-42f0-9116-2f52eea0f238","Type":"ContainerStarted","Data":"f69f0a7ce9f7ca17af5b6836c7255317202a3e15b78cbc9a8fd8123fe9c3cef9"}
Aug 05 16:55:28.120379 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:28.120330    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podStartSLOduration=2.120314772 podStartE2EDuration="2.120314772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:55:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:55:28.118628573 +0000 UTC m=+1986.625520286" watchObservedRunningTime="2026-08-05 16:55:28.120314772 +0000 UTC m=+1986.627206533"
Aug 05 16:55:28.763238 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:28.763201    2576 patch_prober.go:28] interesting pod/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:55:28.763403 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:28.763260    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:55:29.015291 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:29.015207    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:29.020431 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:29.020406    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:29.100889 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:29.100850    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:29.101923 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:29.101900    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:31.113809 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.113777    2576 generic.go:356] "Generic (PLEG): container finished" podID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerID="18589cf421d00e6061572aadd08400254f7675cb605748517d8cf53fbf0867c9" exitCode=0
Aug 05 16:55:31.114216 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.113843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" event={"ID":"ac63251f-5c7e-4df3-b274-879f2e3be938","Type":"ContainerDied","Data":"18589cf421d00e6061572aadd08400254f7675cb605748517d8cf53fbf0867c9"}
Aug 05 16:55:31.114216 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.113903    2576 scope.go:117] "RemoveContainer" containerID="d7294d27ed5030a85f08ef7ac3ac53d556912fbfd675acd301114f89a780221d"
Aug 05 16:55:31.135370 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.135344    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:55:31.251345 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251309    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-podinfo\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251357    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqps2\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-kube-api-access-jqps2\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251436    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-token\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251463    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-data\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251528 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251495    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-credential-socket\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251750 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251531    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-envoy\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251750 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251584    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-socket\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251750 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251626    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac63251f-5c7e-4df3-b274-879f2e3be938-istiod-ca-cert\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.251750 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.251651    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-certs\") pod \"ac63251f-5c7e-4df3-b274-879f2e3be938\" (UID: \"ac63251f-5c7e-4df3-b274-879f2e3be938\") "
Aug 05 16:55:31.252362 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.252037    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:55:31.252362 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.252291    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:55:31.252641 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.252457    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:55:31.252895 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.252859    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac63251f-5c7e-4df3-b274-879f2e3be938-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:31.253290 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.253264    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:55:31.254965 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.254926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-kube-api-access-jqps2" (OuterVolumeSpecName: "kube-api-access-jqps2") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "kube-api-access-jqps2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:55:31.254965 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.254938    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:55:31.255280 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.255260    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 16:55:31.255549 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.255518    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac63251f-5c7e-4df3-b274-879f2e3be938" (UID: "ac63251f-5c7e-4df3-b274-879f2e3be938"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:55:31.353513 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353479    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353513 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353507    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqps2\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-kube-api-access-jqps2\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353513 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353517    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353762 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353526    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353762 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353545    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353762 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353554    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353762 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353562    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353762 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353570    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac63251f-5c7e-4df3-b274-879f2e3be938-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:31.353762 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:31.353578    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac63251f-5c7e-4df3-b274-879f2e3be938-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:32.121281 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:32.121247    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"
Aug 05 16:55:32.121281 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:32.121264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6" event={"ID":"ac63251f-5c7e-4df3-b274-879f2e3be938","Type":"ContainerDied","Data":"61ad173c4265dbad7642230df74ce27ee171fc7b87432de1a320e3bd7e5c1aaa"}
Aug 05 16:55:32.121753 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:32.121351    2576 scope.go:117] "RemoveContainer" containerID="18589cf421d00e6061572aadd08400254f7675cb605748517d8cf53fbf0867c9"
Aug 05 16:55:32.164104 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:32.164077    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"]
Aug 05 16:55:32.170348 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:32.170325    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-dfc96bfb-gw-openshift-default-85b79fc648-4mpm6"]
Aug 05 16:55:33.992079 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:33.992046    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" path="/var/lib/kubelet/pods/ac63251f-5c7e-4df3-b274-879f2e3be938/volumes"
Aug 05 16:55:43.183894 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:43.183861    2576 generic.go:356] "Generic (PLEG): container finished" podID="4983f122-c49d-42f0-9116-2f52eea0f238" containerID="db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1" exitCode=0
Aug 05 16:55:43.184308 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:43.183929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" event={"ID":"4983f122-c49d-42f0-9116-2f52eea0f238","Type":"ContainerDied","Data":"db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1"}
Aug 05 16:55:43.184360 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:43.184341    2576 scope.go:117] "RemoveContainer" containerID="db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1"
Aug 05 16:55:43.185470 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:43.185437    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:43.185568 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:43.185512    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:43.185568 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:43.185545    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:55:44.101241 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:44.101194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:44.194663 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:44.194618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" event={"ID":"4983f122-c49d-42f0-9116-2f52eea0f238","Type":"ContainerStarted","Data":"56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9"}
Aug 05 16:55:45.015732 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:45.015692    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:45.016827 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:45.016797    2576 patch_prober.go:28] interesting pod/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 16:55:45.016952 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:45.016864    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 16:55:46.015634 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:46.015593    2576 patch_prober.go:28] interesting pod/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 16:55:46.016067 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:46.015665    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 16:55:47.015530 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:47.015491    2576 patch_prober.go:28] interesting pod/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 16:55:47.015733 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:47.015548    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 16:55:48.015867 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:48.015828    2576 patch_prober.go:28] interesting pod/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 16:55:48.016299 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:48.015899    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 16:55:49.015780 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:49.015737    2576 patch_prober.go:28] interesting pod/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 16:55:49.015965 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:49.015798    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 16:55:50.020061 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:50.020029    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:50.020439 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:50.020420    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:50.021010 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:50.020993    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:55:55.292430 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.292397    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"]
Aug 05 16:55:55.292847 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.292834    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy"
Aug 05 16:55:55.292891 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.292848    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy"
Aug 05 16:55:55.292891 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.292864    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy"
Aug 05 16:55:55.292891 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.292870    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy"
Aug 05 16:55:55.293037 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.292948    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy"
Aug 05 16:55:55.296197 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.296182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"
Aug 05 16:55:55.298888 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.298870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 16:55:55.305465 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.305439    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"]
Aug 05 16:55:55.401692 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.401657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/080685d0-bc10-4635-be8b-b0b34adb0154-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs\" (UID: \"080685d0-bc10-4635-be8b-b0b34adb0154\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"
Aug 05 16:55:55.502272 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.502233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/080685d0-bc10-4635-be8b-b0b34adb0154-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs\" (UID: \"080685d0-bc10-4635-be8b-b0b34adb0154\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"
Aug 05 16:55:55.502872 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.502852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/080685d0-bc10-4635-be8b-b0b34adb0154-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs\" (UID: \"080685d0-bc10-4635-be8b-b0b34adb0154\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"
Aug 05 16:55:55.607751 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.607666    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"
Aug 05 16:55:55.746340 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:55.746313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"]
Aug 05 16:55:55.748018 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:55:55.747947    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080685d0_bc10_4635_be8b_b0b34adb0154.slice/crio-507a1440539e59a4745ba94d914fc360227890691e07d74891de35c7e50ff95a WatchSource:0}: Error finding container 507a1440539e59a4745ba94d914fc360227890691e07d74891de35c7e50ff95a: Status 404 returned error can't find the container with id 507a1440539e59a4745ba94d914fc360227890691e07d74891de35c7e50ff95a
Aug 05 16:55:56.267518 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:56.267421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs" event={"ID":"080685d0-bc10-4635-be8b-b0b34adb0154","Type":"ContainerStarted","Data":"3a2540a4b729d87b4d63c8f6e8958b3bc15ae46a2b0aba2ed91f60cccdf39b7f"}
Aug 05 16:55:56.267518 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:56.267504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs" event={"ID":"080685d0-bc10-4635-be8b-b0b34adb0154","Type":"ContainerStarted","Data":"507a1440539e59a4745ba94d914fc360227890691e07d74891de35c7e50ff95a"}
Aug 05 16:55:56.285519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:56.285478    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs" podStartSLOduration=1.285464548 podStartE2EDuration="1.285464548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:55:56.283608706 +0000 UTC m=+2014.790500419" watchObservedRunningTime="2026-08-05 16:55:56.285464548 +0000 UTC m=+2014.792356260"
Aug 05 16:55:57.273906 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:57.273869    2576 generic.go:356] "Generic (PLEG): container finished" podID="080685d0-bc10-4635-be8b-b0b34adb0154" containerID="3a2540a4b729d87b4d63c8f6e8958b3bc15ae46a2b0aba2ed91f60cccdf39b7f" exitCode=0
Aug 05 16:55:57.274313 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:57.273946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs" event={"ID":"080685d0-bc10-4635-be8b-b0b34adb0154","Type":"ContainerDied","Data":"3a2540a4b729d87b4d63c8f6e8958b3bc15ae46a2b0aba2ed91f60cccdf39b7f"}
Aug 05 16:55:58.411411 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:58.411385    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"
Aug 05 16:55:58.535269 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:58.535178    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/080685d0-bc10-4635-be8b-b0b34adb0154-maas-api-service-ca\") pod \"080685d0-bc10-4635-be8b-b0b34adb0154\" (UID: \"080685d0-bc10-4635-be8b-b0b34adb0154\") "
Aug 05 16:55:58.535548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:58.535522    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/080685d0-bc10-4635-be8b-b0b34adb0154-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "080685d0-bc10-4635-be8b-b0b34adb0154" (UID: "080685d0-bc10-4635-be8b-b0b34adb0154"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:58.636759 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:58.636726    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/080685d0-bc10-4635-be8b-b0b34adb0154-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:55:59.286002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:59.285952    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"
Aug 05 16:55:59.286002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:59.285974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs" event={"ID":"080685d0-bc10-4635-be8b-b0b34adb0154","Type":"ContainerDied","Data":"507a1440539e59a4745ba94d914fc360227890691e07d74891de35c7e50ff95a"}
Aug 05 16:55:59.286237 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:55:59.286039    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="507a1440539e59a4745ba94d914fc360227890691e07d74891de35c7e50ff95a"
Aug 05 16:56:01.599556 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:01.599519    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"]
Aug 05 16:56:01.602903 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:01.602873    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a6cf6a5-dpphs"]
Aug 05 16:56:01.992660 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:01.992628    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="080685d0-bc10-4635-be8b-b0b34adb0154" path="/var/lib/kubelet/pods/080685d0-bc10-4635-be8b-b0b34adb0154/volumes"
Aug 05 16:56:02.797647 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:02.796586    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"]
Aug 05 16:56:02.797647 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:02.796912    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy" containerID="cri-o://56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9" gracePeriod=30
Aug 05 16:56:03.645851 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.645812    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"]
Aug 05 16:56:03.646306 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.646292    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080685d0-bc10-4635-be8b-b0b34adb0154" containerName="revoke-keys"
Aug 05 16:56:03.646364 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.646308    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="080685d0-bc10-4635-be8b-b0b34adb0154" containerName="revoke-keys"
Aug 05 16:56:03.646400 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.646374    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac63251f-5c7e-4df3-b274-879f2e3be938" containerName="istio-proxy"
Aug 05 16:56:03.646400 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.646386    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="080685d0-bc10-4635-be8b-b0b34adb0154" containerName="revoke-keys"
Aug 05 16:56:03.649637 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.649619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.662193 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.662168    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0ac50acb-openshift-default-dockercfg-pm6kq\""
Aug 05 16:56:03.669264 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.669231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"]
Aug 05 16:56:03.790424 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-certs\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790596 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-data\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790596 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-credential-socket\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790596 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-socket\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790782 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-podinfo\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790782 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-token\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790782 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istiod-ca-cert\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790782 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2pj9\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-kube-api-access-t2pj9\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.790953 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.790786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-envoy\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.891972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-socket\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-podinfo\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-token\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istiod-ca-cert\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2pj9\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-kube-api-access-t2pj9\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-envoy\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-certs\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-data\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-credential-socket\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.892493 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-socket\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.893010 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-credential-socket\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.893010 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-certs\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.893010 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istiod-ca-cert\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.893010 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.892847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-data\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.894697 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.894672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-envoy\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.894861 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.894839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-podinfo\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.902596 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.902534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-token\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.902713 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.902697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2pj9\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-kube-api-access-t2pj9\") pod \"e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") " pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:03.959711 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:03.959665    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:04.111748 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.111711    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"]
Aug 05 16:56:04.112854 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:56:04.112829    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de01f9b_821e_45b8_8bd8_7a42ce7e6c16.slice/crio-5bd7500f4860c704fc1eeb561de3158b98364711f5c003a34c1884f6cfcf4fa7 WatchSource:0}: Error finding container 5bd7500f4860c704fc1eeb561de3158b98364711f5c003a34c1884f6cfcf4fa7: Status 404 returned error can't find the container with id 5bd7500f4860c704fc1eeb561de3158b98364711f5c003a34c1884f6cfcf4fa7
Aug 05 16:56:04.115093 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.115061    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:56:04.115189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.115124    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:56:04.115189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.115152    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:56:04.317931 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.317894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" event={"ID":"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16","Type":"ContainerStarted","Data":"51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5"}
Aug 05 16:56:04.318138 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.317949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" event={"ID":"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16","Type":"ContainerStarted","Data":"5bd7500f4860c704fc1eeb561de3158b98364711f5c003a34c1884f6cfcf4fa7"}
Aug 05 16:56:04.353386 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.353321    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podStartSLOduration=1.353303206 podStartE2EDuration="1.353303206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:56:04.351497531 +0000 UTC m=+2022.858389243" watchObservedRunningTime="2026-08-05 16:56:04.353303206 +0000 UTC m=+2022.860194920"
Aug 05 16:56:04.959932 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:04.959898    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:05.022993 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:05.022936    2576 patch_prober.go:28] interesting pod/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:56:05.023249 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:05.023022    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:56:05.965662 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:05.965631    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:06.329100 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:06.329015    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:06.330038 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:06.330018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:08.074898 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.074834    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:56:08.237462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79rqr\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-kube-api-access-79rqr\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237474    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-credential-socket\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237516    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-istio-token\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237551    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4983f122-c49d-42f0-9116-2f52eea0f238-istio-podinfo\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-envoy\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237610    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-certs\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237914 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237716    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-socket\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237914 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237745    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-data\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237914 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237768    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4983f122-c49d-42f0-9116-2f52eea0f238-istiod-ca-cert\") pod \"4983f122-c49d-42f0-9116-2f52eea0f238\" (UID: \"4983f122-c49d-42f0-9116-2f52eea0f238\") "
Aug 05 16:56:08.237914 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237837    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:08.238166 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237972    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:08.238166 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.237976    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:08.238274 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.238166    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-data" (OuterVolumeSpecName: "istio-data") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:08.238274 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.238186    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4983f122-c49d-42f0-9116-2f52eea0f238-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:56:08.238274 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.238190    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.238274 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.238218    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.238274 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.238233    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.239802 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.239769    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4983f122-c49d-42f0-9116-2f52eea0f238-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 16:56:08.239925 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.239798    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:08.239925 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.239851    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-istio-token" (OuterVolumeSpecName: "istio-token") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:56:08.239925 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.239885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-kube-api-access-79rqr" (OuterVolumeSpecName: "kube-api-access-79rqr") pod "4983f122-c49d-42f0-9116-2f52eea0f238" (UID: "4983f122-c49d-42f0-9116-2f52eea0f238"). InnerVolumeSpecName "kube-api-access-79rqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:56:08.339189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.339106    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79rqr\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-kube-api-access-79rqr\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.339189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.339134    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4983f122-c49d-42f0-9116-2f52eea0f238-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.339189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.339145    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4983f122-c49d-42f0-9116-2f52eea0f238-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.339189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.339153    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.339189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.339160    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4983f122-c49d-42f0-9116-2f52eea0f238-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.339189 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.339167    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4983f122-c49d-42f0-9116-2f52eea0f238-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:08.340531 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.340507    2576 generic.go:356] "Generic (PLEG): container finished" podID="4983f122-c49d-42f0-9116-2f52eea0f238" containerID="56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9" exitCode=0
Aug 05 16:56:08.340632 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.340553    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"
Aug 05 16:56:08.340632 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.340595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" event={"ID":"4983f122-c49d-42f0-9116-2f52eea0f238","Type":"ContainerDied","Data":"56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9"}
Aug 05 16:56:08.340694 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.340646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d" event={"ID":"4983f122-c49d-42f0-9116-2f52eea0f238","Type":"ContainerDied","Data":"f69f0a7ce9f7ca17af5b6836c7255317202a3e15b78cbc9a8fd8123fe9c3cef9"}
Aug 05 16:56:08.340694 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.340676    2576 scope.go:117] "RemoveContainer" containerID="56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9"
Aug 05 16:56:08.351010 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.350964    2576 scope.go:117] "RemoveContainer" containerID="db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1"
Aug 05 16:56:08.359672 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.359652    2576 scope.go:117] "RemoveContainer" containerID="56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9"
Aug 05 16:56:08.359948 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:56:08.359928    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9\": container with ID starting with 56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9 not found: ID does not exist" containerID="56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9"
Aug 05 16:56:08.360015 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.359957    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9"} err="failed to get container status \"56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9\": rpc error: code = NotFound desc = could not find container \"56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9\": container with ID starting with 56864f382fa4816326055bca6307641e2ed96af15d3b170109daf39929655aa9 not found: ID does not exist"
Aug 05 16:56:08.360015 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.359976    2576 scope.go:117] "RemoveContainer" containerID="db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1"
Aug 05 16:56:08.360246 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:56:08.360229    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1\": container with ID starting with db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1 not found: ID does not exist" containerID="db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1"
Aug 05 16:56:08.360288 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.360253    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1"} err="failed to get container status \"db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1\": rpc error: code = NotFound desc = could not find container \"db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1\": container with ID starting with db01fed4d9740a0b935658308b9d376a9d18335ee5903f5f6d245507350e25c1 not found: ID does not exist"
Aug 05 16:56:08.369439 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.369378    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"]
Aug 05 16:56:08.371595 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:08.371573    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3a6cf6a5-openshift-default-68f7b649cd-79s5d"]
Aug 05 16:56:09.991025 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:09.990975    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" path="/var/lib/kubelet/pods/4983f122-c49d-42f0-9116-2f52eea0f238/volumes"
Aug 05 16:56:19.406595 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:19.406557    2576 generic.go:356] "Generic (PLEG): container finished" podID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerID="51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5" exitCode=0
Aug 05 16:56:19.407080 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:19.406633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" event={"ID":"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16","Type":"ContainerDied","Data":"51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5"}
Aug 05 16:56:19.407137 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:19.407102    2576 scope.go:117] "RemoveContainer" containerID="51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5"
Aug 05 16:56:19.408103 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:19.408076    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:56:19.408178 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:19.408146    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:56:19.408220 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:19.408177    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:56:20.416273 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:20.416240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" event={"ID":"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16","Type":"ContainerStarted","Data":"662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd"}
Aug 05 16:56:20.959872 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:20.959837    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:20.961175 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:20.961143    2576 patch_prober.go:28] interesting pod/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Aug 05 16:56:20.961324 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:20.961200    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Aug 05 16:56:21.329715 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:21.329626    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:21.960913 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:21.960884    2576 patch_prober.go:28] interesting pod/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Aug 05 16:56:21.961322 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:21.960931    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Aug 05 16:56:22.960607 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:22.960574    2576 patch_prober.go:28] interesting pod/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Aug 05 16:56:22.960797 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:22.960629    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Aug 05 16:56:23.960148 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:23.960116    2576 patch_prober.go:28] interesting pod/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Aug 05 16:56:23.960507 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:23.960173    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Aug 05 16:56:24.960781 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:24.960740    2576 patch_prober.go:28] interesting pod/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Aug 05 16:56:24.961244 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:24.960798    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Aug 05 16:56:25.964364 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:25.964329    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:25.965511 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:25.965481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:30.643504 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.643462    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"]
Aug 05 16:56:30.643935 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.643894    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy"
Aug 05 16:56:30.643935 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.643906    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy"
Aug 05 16:56:30.643935 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.643930    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy"
Aug 05 16:56:30.643935 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.643936    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy"
Aug 05 16:56:30.644117 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.644022    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy"
Aug 05 16:56:30.644117 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.644034    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4983f122-c49d-42f0-9116-2f52eea0f238" containerName="istio-proxy"
Aug 05 16:56:30.647297 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.647277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"
Aug 05 16:56:30.650054 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.650033    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 16:56:30.659246 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.659224    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"]
Aug 05 16:56:30.770502 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.770466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7bf85a-af08-40a1-9eaf-080768733e89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf\" (UID: \"bb7bf85a-af08-40a1-9eaf-080768733e89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"
Aug 05 16:56:30.871467 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.871427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7bf85a-af08-40a1-9eaf-080768733e89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf\" (UID: \"bb7bf85a-af08-40a1-9eaf-080768733e89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"
Aug 05 16:56:30.872090 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.872070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7bf85a-af08-40a1-9eaf-080768733e89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf\" (UID: \"bb7bf85a-af08-40a1-9eaf-080768733e89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"
Aug 05 16:56:30.958545 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:30.958463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"
Aug 05 16:56:31.098510 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:31.098480    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"]
Aug 05 16:56:31.100618 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:56:31.100588    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7bf85a_af08_40a1_9eaf_080768733e89.slice/crio-d5ff9098c3bac4e82b69c77745da28789bef463d5a544ba8b2c89c6651f9ed6f WatchSource:0}: Error finding container d5ff9098c3bac4e82b69c77745da28789bef463d5a544ba8b2c89c6651f9ed6f: Status 404 returned error can't find the container with id d5ff9098c3bac4e82b69c77745da28789bef463d5a544ba8b2c89c6651f9ed6f
Aug 05 16:56:31.477967 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:31.477932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf" event={"ID":"bb7bf85a-af08-40a1-9eaf-080768733e89","Type":"ContainerStarted","Data":"2dfaef843a64ca0ca19fe9e4c844395719b80d48ad01a5f54fd7a17985be241f"}
Aug 05 16:56:31.478169 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:31.478013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf" event={"ID":"bb7bf85a-af08-40a1-9eaf-080768733e89","Type":"ContainerStarted","Data":"d5ff9098c3bac4e82b69c77745da28789bef463d5a544ba8b2c89c6651f9ed6f"}
Aug 05 16:56:31.498462 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:31.498405    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf" podStartSLOduration=1.498391074 podStartE2EDuration="1.498391074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:56:31.496388172 +0000 UTC m=+2050.003279886" watchObservedRunningTime="2026-08-05 16:56:31.498391074 +0000 UTC m=+2050.005282787"
Aug 05 16:56:32.485218 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:32.485184    2576 generic.go:356] "Generic (PLEG): container finished" podID="bb7bf85a-af08-40a1-9eaf-080768733e89" containerID="2dfaef843a64ca0ca19fe9e4c844395719b80d48ad01a5f54fd7a17985be241f" exitCode=0
Aug 05 16:56:32.485218 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:32.485219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf" event={"ID":"bb7bf85a-af08-40a1-9eaf-080768733e89","Type":"ContainerDied","Data":"2dfaef843a64ca0ca19fe9e4c844395719b80d48ad01a5f54fd7a17985be241f"}
Aug 05 16:56:33.635469 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:33.635444    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"
Aug 05 16:56:33.696807 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:33.696776    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7bf85a-af08-40a1-9eaf-080768733e89-maas-api-service-ca\") pod \"bb7bf85a-af08-40a1-9eaf-080768733e89\" (UID: \"bb7bf85a-af08-40a1-9eaf-080768733e89\") "
Aug 05 16:56:33.697137 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:33.697116    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb7bf85a-af08-40a1-9eaf-080768733e89-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb7bf85a-af08-40a1-9eaf-080768733e89" (UID: "bb7bf85a-af08-40a1-9eaf-080768733e89"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:56:33.798297 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:33.798215    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7bf85a-af08-40a1-9eaf-080768733e89-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:34.496549 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:34.496515    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf" event={"ID":"bb7bf85a-af08-40a1-9eaf-080768733e89","Type":"ContainerDied","Data":"d5ff9098c3bac4e82b69c77745da28789bef463d5a544ba8b2c89c6651f9ed6f"}
Aug 05 16:56:34.496549 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:34.496539    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"
Aug 05 16:56:34.496766 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:34.496602    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5ff9098c3bac4e82b69c77745da28789bef463d5a544ba8b2c89c6651f9ed6f"
Aug 05 16:56:37.923669 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:37.923605    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"]
Aug 05 16:56:37.926448 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:37.926422    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0ac50acb-mbcmf"]
Aug 05 16:56:37.992936 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:37.992897    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb7bf85a-af08-40a1-9eaf-080768733e89" path="/var/lib/kubelet/pods/bb7bf85a-af08-40a1-9eaf-080768733e89/volumes"
Aug 05 16:56:38.071411 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:38.071377    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"]
Aug 05 16:56:38.071659 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:38.071626    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy" containerID="cri-o://662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd" gracePeriod=30
Aug 05 16:56:40.967390 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:40.967349    2576 patch_prober.go:28] interesting pod/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:56:40.967781 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:40.967423    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:56:43.335738 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.335675    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:43.495785 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.495747    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-podinfo\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.495785 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.495792    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-credential-socket\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.495817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-token\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.495880    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2pj9\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-kube-api-access-t2pj9\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.495922    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-envoy\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.495950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-socket\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.495996    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-data\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496078 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496028    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-certs\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496397 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496096    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istiod-ca-cert\") pod \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\" (UID: \"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16\") "
Aug 05 16:56:43.496397 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496200    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:43.496501 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496435    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:43.496558 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496496    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.496798 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496689    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-data" (OuterVolumeSpecName: "istio-data") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:43.496798 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496763    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:43.496798 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.496783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:56:43.498404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.498367    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-kube-api-access-t2pj9" (OuterVolumeSpecName: "kube-api-access-t2pj9") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "kube-api-access-t2pj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:56:43.498404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.498378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-token" (OuterVolumeSpecName: "istio-token") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:56:43.498574 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.498555    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 16:56:43.498632 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.498606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" (UID: "7de01f9b-821e-45b8-8bd8-7a42ce7e6c16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:56:43.547021 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.546960    2576 generic.go:356] "Generic (PLEG): container finished" podID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerID="662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd" exitCode=0
Aug 05 16:56:43.547220 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.547021    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" event={"ID":"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16","Type":"ContainerDied","Data":"662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd"}
Aug 05 16:56:43.547220 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.547048    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"
Aug 05 16:56:43.547220 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.547092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6" event={"ID":"7de01f9b-821e-45b8-8bd8-7a42ce7e6c16","Type":"ContainerDied","Data":"5bd7500f4860c704fc1eeb561de3158b98364711f5c003a34c1884f6cfcf4fa7"}
Aug 05 16:56:43.547220 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.547122    2576 scope.go:117] "RemoveContainer" containerID="662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd"
Aug 05 16:56:43.556642 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.556625    2576 scope.go:117] "RemoveContainer" containerID="51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5"
Aug 05 16:56:43.564863 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.564848    2576 scope.go:117] "RemoveContainer" containerID="662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd"
Aug 05 16:56:43.565137 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:56:43.565117    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd\": container with ID starting with 662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd not found: ID does not exist" containerID="662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd"
Aug 05 16:56:43.565200 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.565146    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd"} err="failed to get container status \"662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd\": rpc error: code = NotFound desc = could not find container \"662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd\": container with ID starting with 662a88d4b6ff8223af769398caa7b199076425cbf233f9183f94ad7068141ffd not found: ID does not exist"
Aug 05 16:56:43.565200 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.565163    2576 scope.go:117] "RemoveContainer" containerID="51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5"
Aug 05 16:56:43.565405 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:56:43.565384    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5\": container with ID starting with 51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5 not found: ID does not exist" containerID="51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5"
Aug 05 16:56:43.565465 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.565413    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5"} err="failed to get container status \"51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5\": rpc error: code = NotFound desc = could not find container \"51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5\": container with ID starting with 51b72756c69711d3ef1a2bd86365306b61742ec2b9f0bdb58ea7b55d71ccaeb5 not found: ID does not exist"
Aug 05 16:56:43.589931 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.589856    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"]
Aug 05 16:56:43.597101 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597066    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.597101 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597100    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.597259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597116    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.597259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597129    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.597259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597142    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.597259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597154    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.597259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597165    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.597259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.597178    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2pj9\" (UniqueName: \"kubernetes.io/projected/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16-kube-api-access-t2pj9\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:56:43.598909 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.598883    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0ac50acb-openshift-default-9d9b5b7d8-cnpm6"]
Aug 05 16:56:43.991084 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:56:43.991048    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" path="/var/lib/kubelet/pods/7de01f9b-821e-45b8-8bd8-7a42ce7e6c16/volumes"
Aug 05 16:57:22.110832 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:57:22.110797    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:57:22.117591 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:57:22.117563    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 16:58:40.889380 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.889287    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"]
Aug 05 16:58:40.889894 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.889880    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy"
Aug 05 16:58:40.889942 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.889898    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy"
Aug 05 16:58:40.889942 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.889913    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7bf85a-af08-40a1-9eaf-080768733e89" containerName="revoke-keys"
Aug 05 16:58:40.889942 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.889921    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7bf85a-af08-40a1-9eaf-080768733e89" containerName="revoke-keys"
Aug 05 16:58:40.890061 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.889959    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy"
Aug 05 16:58:40.890061 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.889969    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy"
Aug 05 16:58:40.890130 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.890084    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb7bf85a-af08-40a1-9eaf-080768733e89" containerName="revoke-keys"
Aug 05 16:58:40.890130 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.890094    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy"
Aug 05 16:58:40.890130 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.890105    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de01f9b-821e-45b8-8bd8-7a42ce7e6c16" containerName="istio-proxy"
Aug 05 16:58:40.893554 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.893533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:40.895920 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.895898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-04a2be95-openshift-default-dockercfg-tx25x\""
Aug 05 16:58:40.913480 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:40.913451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"]
Aug 05 16:58:41.004034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.003997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-podinfo\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004034 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-token\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004283 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-credential-socket\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004283 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istiod-ca-cert\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004283 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2lq\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-kube-api-access-nd2lq\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004283 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-certs\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004283 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-envoy\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-socket\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.004519 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.004374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-data\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105018 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.104989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istiod-ca-cert\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105233 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2lq\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-kube-api-access-nd2lq\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105233 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-certs\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105233 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-envoy\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105233 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-socket\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105387 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-data\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105387 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-podinfo\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105387 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-token\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105387 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-credential-socket\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105548 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-certs\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105659 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-data\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105730 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istiod-ca-cert\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105859 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-socket\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.105859 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.105843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-credential-socket\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.107702 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.107671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-envoy\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.107823 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.107807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-podinfo\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.113603 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.113578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-token\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.113948 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.113927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2lq\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-kube-api-access-nd2lq\") pod \"e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") " pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.204392 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.204300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:41.352747 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.352723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"]
Aug 05 16:58:41.354563 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:58:41.354520    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9912fa_4523_47be_a2e0_78ea3a0aa17b.slice/crio-1bc68baef5e337071086ceb79805a352c0b73e6f1b6190acf5838aa2f1eb54f0 WatchSource:0}: Error finding container 1bc68baef5e337071086ceb79805a352c0b73e6f1b6190acf5838aa2f1eb54f0: Status 404 returned error can't find the container with id 1bc68baef5e337071086ceb79805a352c0b73e6f1b6190acf5838aa2f1eb54f0
Aug 05 16:58:41.356832 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.356800    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:58:41.356918 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.356869    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:58:41.356918 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:41.356896    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:58:42.177033 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:42.176976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" event={"ID":"6c9912fa-4523-47be-a2e0-78ea3a0aa17b","Type":"ContainerStarted","Data":"9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471"}
Aug 05 16:58:42.177421 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:42.177056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" event={"ID":"6c9912fa-4523-47be-a2e0-78ea3a0aa17b","Type":"ContainerStarted","Data":"1bc68baef5e337071086ceb79805a352c0b73e6f1b6190acf5838aa2f1eb54f0"}
Aug 05 16:58:42.201537 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:42.201480    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podStartSLOduration=2.201458076 podStartE2EDuration="2.201458076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:58:42.197465206 +0000 UTC m=+2180.704356920" watchObservedRunningTime="2026-08-05 16:58:42.201458076 +0000 UTC m=+2180.708349789"
Aug 05 16:58:42.205187 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:42.205165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:42.210195 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:42.210166    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:43.181932 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:43.181902    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:43.182939 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:43.182912    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:58:58.183336 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.183300    2576 patch_prober.go:28] interesting pod/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 05 16:58:58.183735 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.183390    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 05 16:58:58.263430 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.263400    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerID="9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471" exitCode=0
Aug 05 16:58:58.263582 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.263474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" event={"ID":"6c9912fa-4523-47be-a2e0-78ea3a0aa17b","Type":"ContainerDied","Data":"9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471"}
Aug 05 16:58:58.263874 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.263858    2576 scope.go:117] "RemoveContainer" containerID="9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471"
Aug 05 16:58:58.264884 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.264860    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:58:58.264991 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.264924    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:58:58.264991 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:58.264956    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:58:59.271304 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:58:59.271268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" event={"ID":"6c9912fa-4523-47be-a2e0-78ea3a0aa17b","Type":"ContainerStarted","Data":"6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c"}
Aug 05 16:59:00.205434 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:00.204966    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:59:00.205434 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:00.205115    2576 patch_prober.go:28] interesting pod/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 05 16:59:00.205434 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:00.205160    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 05 16:59:01.206038 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:01.205967    2576 patch_prober.go:28] interesting pod/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 05 16:59:01.206543 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:01.206070    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 05 16:59:02.205386 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:02.205332    2576 patch_prober.go:28] interesting pod/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 05 16:59:02.205605 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:02.205405    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 05 16:59:03.204743 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:03.204698    2576 patch_prober.go:28] interesting pod/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 05 16:59:03.205723 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:03.205322    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 05 16:59:04.205484 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:04.205436    2576 patch_prober.go:28] interesting pod/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 05 16:59:04.205881 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:04.205513    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 05 16:59:05.208909 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:05.208878    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:59:05.209352 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:05.209267    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:59:05.210060 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:05.210039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:59:16.998830 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:16.998786    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"]
Aug 05 16:59:17.003201 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.003178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"
Aug 05 16:59:17.005593 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.005573    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 16:59:17.011972 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.011947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"]
Aug 05 16:59:17.069560 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.069524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a43301a-59b3-4456-ad5c-af42c1d6ddca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-04a2be95-grzmj\" (UID: \"8a43301a-59b3-4456-ad5c-af42c1d6ddca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"
Aug 05 16:59:17.170404 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.170369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a43301a-59b3-4456-ad5c-af42c1d6ddca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-04a2be95-grzmj\" (UID: \"8a43301a-59b3-4456-ad5c-af42c1d6ddca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"
Aug 05 16:59:17.171082 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.171054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a43301a-59b3-4456-ad5c-af42c1d6ddca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-04a2be95-grzmj\" (UID: \"8a43301a-59b3-4456-ad5c-af42c1d6ddca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"
Aug 05 16:59:17.315134 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.315054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"
Aug 05 16:59:17.657339 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:17.657311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"]
Aug 05 16:59:17.658679 ip-10-0-128-82 kubenswrapper[2576]: W0805 16:59:17.658654    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a43301a_59b3_4456_ad5c_af42c1d6ddca.slice/crio-4f24e213c347a33f1035eb18e2aff892e508e96168a1541361026f9c07e1de39 WatchSource:0}: Error finding container 4f24e213c347a33f1035eb18e2aff892e508e96168a1541361026f9c07e1de39: Status 404 returned error can't find the container with id 4f24e213c347a33f1035eb18e2aff892e508e96168a1541361026f9c07e1de39
Aug 05 16:59:18.381425 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:18.381390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj" event={"ID":"8a43301a-59b3-4456-ad5c-af42c1d6ddca","Type":"ContainerStarted","Data":"561c8721ea125f1bc8e5be9aba8b57d0846cbcf02fd71d3ae640b4caed0af25a"}
Aug 05 16:59:18.382064 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:18.381446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj" event={"ID":"8a43301a-59b3-4456-ad5c-af42c1d6ddca","Type":"ContainerStarted","Data":"4f24e213c347a33f1035eb18e2aff892e508e96168a1541361026f9c07e1de39"}
Aug 05 16:59:18.398893 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:18.398849    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj" podStartSLOduration=2.398834281 podStartE2EDuration="2.398834281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:59:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:59:18.397058282 +0000 UTC m=+2216.903949997" watchObservedRunningTime="2026-08-05 16:59:18.398834281 +0000 UTC m=+2216.905725993"
Aug 05 16:59:19.388217 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:19.388178    2576 generic.go:356] "Generic (PLEG): container finished" podID="8a43301a-59b3-4456-ad5c-af42c1d6ddca" containerID="561c8721ea125f1bc8e5be9aba8b57d0846cbcf02fd71d3ae640b4caed0af25a" exitCode=0
Aug 05 16:59:19.388713 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:19.388264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj" event={"ID":"8a43301a-59b3-4456-ad5c-af42c1d6ddca","Type":"ContainerDied","Data":"561c8721ea125f1bc8e5be9aba8b57d0846cbcf02fd71d3ae640b4caed0af25a"}
Aug 05 16:59:20.524606 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:20.524578    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"
Aug 05 16:59:20.603880 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:20.603846    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a43301a-59b3-4456-ad5c-af42c1d6ddca-maas-api-service-ca\") pod \"8a43301a-59b3-4456-ad5c-af42c1d6ddca\" (UID: \"8a43301a-59b3-4456-ad5c-af42c1d6ddca\") "
Aug 05 16:59:20.604259 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:20.604234    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a43301a-59b3-4456-ad5c-af42c1d6ddca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a43301a-59b3-4456-ad5c-af42c1d6ddca" (UID: "8a43301a-59b3-4456-ad5c-af42c1d6ddca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:59:20.705060 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:20.704942    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a43301a-59b3-4456-ad5c-af42c1d6ddca-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:21.401036 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:21.400973    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"
Aug 05 16:59:21.401212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:21.401004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj" event={"ID":"8a43301a-59b3-4456-ad5c-af42c1d6ddca","Type":"ContainerDied","Data":"4f24e213c347a33f1035eb18e2aff892e508e96168a1541361026f9c07e1de39"}
Aug 05 16:59:21.401212 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:21.401126    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f24e213c347a33f1035eb18e2aff892e508e96168a1541361026f9c07e1de39"
Aug 05 16:59:27.840167 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:27.840128    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"]
Aug 05 16:59:27.843355 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:27.843324    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-04a2be95-grzmj"]
Aug 05 16:59:27.994058 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:27.994025    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a43301a-59b3-4456-ad5c-af42c1d6ddca" path="/var/lib/kubelet/pods/8a43301a-59b3-4456-ad5c-af42c1d6ddca/volumes"
Aug 05 16:59:34.742162 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:34.742110    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"]
Aug 05 16:59:34.742565 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:34.742389    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" containerID="cri-o://6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c" gracePeriod=30
Aug 05 16:59:35.211390 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:35.211352    2576 patch_prober.go:28] interesting pod/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:59:35.211566 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:35.211410    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:59:39.998282 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:39.998254    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:59:40.092894 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.092803    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-podinfo\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.092894 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.092839    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-certs\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.092894 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.092867    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-envoy\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.092894 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.092892    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-socket\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.093267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.092935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-data\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.093267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.092960    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd2lq\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-kube-api-access-nd2lq\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.093267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-token\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.093267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093066    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istiod-ca-cert\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.093267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-credential-socket\") pod \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\" (UID: \"6c9912fa-4523-47be-a2e0-78ea3a0aa17b\") "
Aug 05 16:59:40.093267 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093148    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:59:40.093574 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093409    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.093574 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093515    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:59:40.093574 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093527    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:59:40.093737 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093355    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:59:40.093840 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.093732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:59:40.095207 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.095186    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 16:59:40.095397 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.095373    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-kube-api-access-nd2lq" (OuterVolumeSpecName: "kube-api-access-nd2lq") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "kube-api-access-nd2lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:59:40.095513 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.095494    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:59:40.095559 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.095504    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c9912fa-4523-47be-a2e0-78ea3a0aa17b" (UID: "6c9912fa-4523-47be-a2e0-78ea3a0aa17b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:59:40.194875 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194846    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.194875 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194873    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.194875 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194881    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.195143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194889    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.195143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194898    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd2lq\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-kube-api-access-nd2lq\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.195143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194909    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.195143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194916    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.195143 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.194924    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9912fa-4523-47be-a2e0-78ea3a0aa17b-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 16:59:40.504196 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.504161    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerID="6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c" exitCode=0
Aug 05 16:59:40.504374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.504220    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"
Aug 05 16:59:40.504374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.504254    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" event={"ID":"6c9912fa-4523-47be-a2e0-78ea3a0aa17b","Type":"ContainerDied","Data":"6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c"}
Aug 05 16:59:40.504374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.504313    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q" event={"ID":"6c9912fa-4523-47be-a2e0-78ea3a0aa17b","Type":"ContainerDied","Data":"1bc68baef5e337071086ceb79805a352c0b73e6f1b6190acf5838aa2f1eb54f0"}
Aug 05 16:59:40.504374 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.504339    2576 scope.go:117] "RemoveContainer" containerID="6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c"
Aug 05 16:59:40.513921 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.513904    2576 scope.go:117] "RemoveContainer" containerID="9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471"
Aug 05 16:59:40.521932 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.521914    2576 scope.go:117] "RemoveContainer" containerID="6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c"
Aug 05 16:59:40.522221 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:59:40.522200    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c\": container with ID starting with 6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c not found: ID does not exist" containerID="6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c"
Aug 05 16:59:40.522265 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.522240    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c"} err="failed to get container status \"6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c\": rpc error: code = NotFound desc = could not find container \"6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c\": container with ID starting with 6f7e737725c8f136f7e5d75f5dc187d52989973d3a8a6deea15607807a93439c not found: ID does not exist"
Aug 05 16:59:40.522265 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.522258    2576 scope.go:117] "RemoveContainer" containerID="9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471"
Aug 05 16:59:40.522493 ip-10-0-128-82 kubenswrapper[2576]: E0805 16:59:40.522476    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471\": container with ID starting with 9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471 not found: ID does not exist" containerID="9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471"
Aug 05 16:59:40.522538 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.522498    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471"} err="failed to get container status \"9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471\": rpc error: code = NotFound desc = could not find container \"9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471\": container with ID starting with 9b26ec80413b3bb1c0fd196e8064b4b03b289433e9b4a9ad8b7764b71b021471 not found: ID does not exist"
Aug 05 16:59:40.528873 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.528852    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"]
Aug 05 16:59:40.535002 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:40.534962    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-04a2be95-openshift-default-57fd4c6cdd-s5j2q"]
Aug 05 16:59:41.990972 ip-10-0-128-82 kubenswrapper[2576]: I0805 16:59:41.990941    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" path="/var/lib/kubelet/pods/6c9912fa-4523-47be-a2e0-78ea3a0aa17b/volumes"
Aug 05 17:00:00.140256 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.140216    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq"]
Aug 05 17:00:00.140887 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.140865    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy"
Aug 05 17:00:00.140951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.140891    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy"
Aug 05 17:00:00.140951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.140907    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a43301a-59b3-4456-ad5c-af42c1d6ddca" containerName="revoke-keys"
Aug 05 17:00:00.140951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.140916    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a43301a-59b3-4456-ad5c-af42c1d6ddca" containerName="revoke-keys"
Aug 05 17:00:00.141083 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.141070    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a43301a-59b3-4456-ad5c-af42c1d6ddca" containerName="revoke-keys"
Aug 05 17:00:00.141124 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.141085    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy"
Aug 05 17:00:00.141124 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.141094    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy"
Aug 05 17:00:00.144160 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.144143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq"
Aug 05 17:00:00.146807 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.146775    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 17:00:00.149470 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.149439    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq"]
Aug 05 17:00:00.160061 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.160034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq"
Aug 05 17:00:00.300172 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.300139    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq"]
Aug 05 17:00:00.304110 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:00:00.304085    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d47a16e_15b6_4fb2_9905_bb4587796483.slice/crio-75c8c57199f866126c7a7681794c570c2341f97b33a57dabbcff6782ba521b9f WatchSource:0}: Error finding container 75c8c57199f866126c7a7681794c570c2341f97b33a57dabbcff6782ba521b9f: Status 404 returned error can't find the container with id 75c8c57199f866126c7a7681794c570c2341f97b33a57dabbcff6782ba521b9f
Aug 05 17:00:00.615951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.615913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq" event={"ID":"7d47a16e-15b6-4fb2-9905-bb4587796483","Type":"ContainerStarted","Data":"895ac2bd07f34c11ab42e337b22afc603470cd298a3240412d770e2b48b46567"}
Aug 05 17:00:00.616098 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.615973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq" event={"ID":"7d47a16e-15b6-4fb2-9905-bb4587796483","Type":"ContainerStarted","Data":"75c8c57199f866126c7a7681794c570c2341f97b33a57dabbcff6782ba521b9f"}
Aug 05 17:00:00.632339 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:00.632295    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq" podStartSLOduration=0.632280255 podStartE2EDuration="632.280255ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:00:00.631508868 +0000 UTC m=+2259.138400592" watchObservedRunningTime="2026-08-05 17:00:00.632280255 +0000 UTC m=+2259.139171966"
Aug 05 17:00:01.623890 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:01.623789    2576 generic.go:356] "Generic (PLEG): container finished" podID="7d47a16e-15b6-4fb2-9905-bb4587796483" containerID="895ac2bd07f34c11ab42e337b22afc603470cd298a3240412d770e2b48b46567" exitCode=0
Aug 05 17:00:01.623890 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:01.623835    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq" event={"ID":"7d47a16e-15b6-4fb2-9905-bb4587796483","Type":"ContainerDied","Data":"895ac2bd07f34c11ab42e337b22afc603470cd298a3240412d770e2b48b46567"}
Aug 05 17:00:02.768510 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:02.768480    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq"
Aug 05 17:00:03.637089 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:03.637053    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq" event={"ID":"7d47a16e-15b6-4fb2-9905-bb4587796483","Type":"ContainerDied","Data":"75c8c57199f866126c7a7681794c570c2341f97b33a57dabbcff6782ba521b9f"}
Aug 05 17:00:03.637089 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:03.637082    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-d7nmq"
Aug 05 17:00:03.637310 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:03.637111    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75c8c57199f866126c7a7681794c570c2341f97b33a57dabbcff6782ba521b9f"
Aug 05 17:00:16.778121 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:16.778083    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"]
Aug 05 17:00:16.778573 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:16.778374    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v" podUID="e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" containerName="manager" containerID="cri-o://ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e" gracePeriod=10
Aug 05 17:00:17.034631 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.034563    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 17:00:17.160480 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.160445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c4v9\" (UniqueName: \"kubernetes.io/projected/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-kube-api-access-2c4v9\") pod \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") "
Aug 05 17:00:17.160694 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.160528    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-extensions-socket-volume\") pod \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\" (UID: \"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28\") "
Aug 05 17:00:17.160938 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.160907    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" (UID: "e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:00:17.162709 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.162681    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-kube-api-access-2c4v9" (OuterVolumeSpecName: "kube-api-access-2c4v9") pod "e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" (UID: "e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28"). InnerVolumeSpecName "kube-api-access-2c4v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:00:17.261824 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.261794    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c4v9\" (UniqueName: \"kubernetes.io/projected/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-kube-api-access-2c4v9\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:00:17.261824 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.261820    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28-extensions-socket-volume\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:00:17.716719 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.716672    2576 generic.go:356] "Generic (PLEG): container finished" podID="e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" containerID="ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e" exitCode=0
Aug 05 17:00:17.716719 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.716719    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"
Aug 05 17:00:17.716931 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.716740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v" event={"ID":"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28","Type":"ContainerDied","Data":"ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e"}
Aug 05 17:00:17.716931 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.716795    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v" event={"ID":"e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28","Type":"ContainerDied","Data":"ef332e0688a4114c16dd48e1b5af61c23ebd38739f57edfd867a26285e19f6ef"}
Aug 05 17:00:17.716931 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.716826    2576 scope.go:117] "RemoveContainer" containerID="ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e"
Aug 05 17:00:17.727574 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.727551    2576 scope.go:117] "RemoveContainer" containerID="ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e"
Aug 05 17:00:17.727819 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:00:17.727799    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e\": container with ID starting with ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e not found: ID does not exist" containerID="ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e"
Aug 05 17:00:17.727885 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.727826    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e"} err="failed to get container status \"ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e\": rpc error: code = NotFound desc = could not find container \"ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e\": container with ID starting with ea38c024df2c01d07cb73b816a9acdfb41396253ebb08859f9a129b31c901c7e not found: ID does not exist"
Aug 05 17:00:17.740407 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.740382    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"]
Aug 05 17:00:17.747029 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.747009    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-mvj6v"]
Aug 05 17:00:17.991019 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:00:17.990921    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" path="/var/lib/kubelet/pods/e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28/volumes"
Aug 05 17:01:22.278951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:22.278874    2576 scope.go:117] "RemoveContainer" containerID="bb0ee46c12448c9e65370e97599b55007fb1e3344cd801e98801cc268d66cba2"
Aug 05 17:01:22.287954 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:22.287930    2576 scope.go:117] "RemoveContainer" containerID="15fe92e560522b389b7e4ac83fac4ff98312950ed2ffbabc91e9f642ee078149"
Aug 05 17:01:32.425035 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425005    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"]
Aug 05 17:01:32.425582 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425563    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" containerName="manager"
Aug 05 17:01:32.425666 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425585    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" containerName="manager"
Aug 05 17:01:32.425666 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425602    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d47a16e-15b6-4fb2-9905-bb4587796483" containerName="cleanup"
Aug 05 17:01:32.425666 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425610    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d47a16e-15b6-4fb2-9905-bb4587796483" containerName="cleanup"
Aug 05 17:01:32.425666 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425635    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy"
Aug 05 17:01:32.425666 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425644    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9912fa-4523-47be-a2e0-78ea3a0aa17b" containerName="istio-proxy"
Aug 05 17:01:32.425912 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425779    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b1add0-4414-4fd8-b0cc-8f1dde2d2b28" containerName="manager"
Aug 05 17:01:32.425912 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.425794    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d47a16e-15b6-4fb2-9905-bb4587796483" containerName="cleanup"
Aug 05 17:01:32.428815 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.428796    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:32.431236 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.431213    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5c7kl\""
Aug 05 17:01:32.439432 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.439412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"]
Aug 05 17:01:32.464152 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.464120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jq8\" (UniqueName: \"kubernetes.io/projected/a82e3c24-c8f4-4273-a463-b3d00aa68578-kube-api-access-95jq8\") pod \"kuadrant-operator-controller-manager-68cf589589-n67jf\" (UID: \"a82e3c24-c8f4-4273-a463-b3d00aa68578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:32.464301 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.464260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82e3c24-c8f4-4273-a463-b3d00aa68578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-n67jf\" (UID: \"a82e3c24-c8f4-4273-a463-b3d00aa68578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:32.565319 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.565285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82e3c24-c8f4-4273-a463-b3d00aa68578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-n67jf\" (UID: \"a82e3c24-c8f4-4273-a463-b3d00aa68578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:32.565543 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.565357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jq8\" (UniqueName: \"kubernetes.io/projected/a82e3c24-c8f4-4273-a463-b3d00aa68578-kube-api-access-95jq8\") pod \"kuadrant-operator-controller-manager-68cf589589-n67jf\" (UID: \"a82e3c24-c8f4-4273-a463-b3d00aa68578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:32.565701 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.565676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a82e3c24-c8f4-4273-a463-b3d00aa68578-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-n67jf\" (UID: \"a82e3c24-c8f4-4273-a463-b3d00aa68578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:32.575422 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.575397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jq8\" (UniqueName: \"kubernetes.io/projected/a82e3c24-c8f4-4273-a463-b3d00aa68578-kube-api-access-95jq8\") pod \"kuadrant-operator-controller-manager-68cf589589-n67jf\" (UID: \"a82e3c24-c8f4-4273-a463-b3d00aa68578\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:32.739298 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:32.739202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:33.087989 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:33.087946    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"]
Aug 05 17:01:33.089188 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:01:33.089159    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82e3c24_c8f4_4273_a463_b3d00aa68578.slice/crio-f3fa772a5a23fd83c748a299a02e751a7bd4629f027f000389e68afd4a37be41 WatchSource:0}: Error finding container f3fa772a5a23fd83c748a299a02e751a7bd4629f027f000389e68afd4a37be41: Status 404 returned error can't find the container with id f3fa772a5a23fd83c748a299a02e751a7bd4629f027f000389e68afd4a37be41
Aug 05 17:01:33.112261 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:33.112236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf" event={"ID":"a82e3c24-c8f4-4273-a463-b3d00aa68578","Type":"ContainerStarted","Data":"f3fa772a5a23fd83c748a299a02e751a7bd4629f027f000389e68afd4a37be41"}
Aug 05 17:01:34.119466 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:34.119432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf" event={"ID":"a82e3c24-c8f4-4273-a463-b3d00aa68578","Type":"ContainerStarted","Data":"9b1ae03a505f26c8cddb8ec86937b984f673cc3672234cdc9dd173362ed9209b"}
Aug 05 17:01:34.119849 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:34.119557    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:34.141423 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:34.141377    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf" podStartSLOduration=2.141363051 podStartE2EDuration="2.141363051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:01:34.138430908 +0000 UTC m=+2352.645322620" watchObservedRunningTime="2026-08-05 17:01:34.141363051 +0000 UTC m=+2352.648254763"
Aug 05 17:01:45.127398 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:45.127368    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n67jf"
Aug 05 17:01:52.070789 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.070756    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"]
Aug 05 17:01:52.074583 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.074562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.076723 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.076700    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-febb9564-openshift-default-dockercfg-6kl84\""
Aug 05 17:01:52.085456 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.085430    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"]
Aug 05 17:01:52.148701 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.148667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-credential-socket\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.148866 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.148712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-certs\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.148866 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.148743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-token\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.148866 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.148830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4jk2\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-kube-api-access-m4jk2\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.149017 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.148893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-podinfo\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.149017 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.148916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-socket\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.149017 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.148949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-envoy\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.149181 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.149037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-data\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.149181 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.149074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istiod-ca-cert\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.249944 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.249911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-certs\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250148 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.249962    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-token\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250148 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4jk2\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-kube-api-access-m4jk2\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250148 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-podinfo\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250332 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-socket\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250332 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-envoy\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250332 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-certs\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250475 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-data\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250475 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istiod-ca-cert\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250589 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-credential-socket\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250589 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-socket\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250753 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250734    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-data\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.250860 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.250837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-credential-socket\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.251354 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.251330    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istiod-ca-cert\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.252372 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.252351    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-envoy\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.252621 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.252599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-podinfo\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.260630 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.260598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-token\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.260906 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.260886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4jk2\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-kube-api-access-m4jk2\") pod \"e2e-mt-febb9564-openshift-default-57c7488968-q4gs8\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") " pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.385898 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.385867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:52.542146 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.542113    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"]
Aug 05 17:01:52.543476 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:01:52.543440    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c764529_1b29_4b6b_aa55_fb5fa51070a7.slice/crio-daac8d336b48474a1812112eeb4f4ac299d2b391d8dd18713521771ed2b2a6bb WatchSource:0}: Error finding container daac8d336b48474a1812112eeb4f4ac299d2b391d8dd18713521771ed2b2a6bb: Status 404 returned error can't find the container with id daac8d336b48474a1812112eeb4f4ac299d2b391d8dd18713521771ed2b2a6bb
Aug 05 17:01:52.545700 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.545666    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:01:52.545796 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.545757    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:01:52.545796 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:52.545787    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:01:53.223267 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:53.223229    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" event={"ID":"8c764529-1b29-4b6b-aa55-fb5fa51070a7","Type":"ContainerStarted","Data":"235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded"}
Aug 05 17:01:53.223796 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:53.223282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" event={"ID":"8c764529-1b29-4b6b-aa55-fb5fa51070a7","Type":"ContainerStarted","Data":"daac8d336b48474a1812112eeb4f4ac299d2b391d8dd18713521771ed2b2a6bb"}
Aug 05 17:01:53.245613 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:53.245555    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podStartSLOduration=1.245539497 podStartE2EDuration="1.245539497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:01:53.243540085 +0000 UTC m=+2371.750431821" watchObservedRunningTime="2026-08-05 17:01:53.245539497 +0000 UTC m=+2371.752431209"
Aug 05 17:01:53.386291 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:53.386255    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:53.392431 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:53.392406    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:54.228914 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:54.228884    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:01:54.229843 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:01:54.229826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:02:09.230849 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.230811    2576 patch_prober.go:28] interesting pod/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:02:09.231293 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.230878    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:02:09.319711 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.319673    2576 generic.go:356] "Generic (PLEG): container finished" podID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerID="235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded" exitCode=0
Aug 05 17:02:09.319867 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.319708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" event={"ID":"8c764529-1b29-4b6b-aa55-fb5fa51070a7","Type":"ContainerDied","Data":"235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded"}
Aug 05 17:02:09.320165 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.320142    2576 scope.go:117] "RemoveContainer" containerID="235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded"
Aug 05 17:02:09.321194 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.321166    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:02:09.321282 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.321233    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:02:09.321282 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:09.321273    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:02:10.328359 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:10.328326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" event={"ID":"8c764529-1b29-4b6b-aa55-fb5fa51070a7","Type":"ContainerStarted","Data":"98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599"}
Aug 05 17:02:10.386600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:10.386559    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:02:10.386818 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:10.386687    2576 patch_prober.go:28] interesting pod/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:02:10.386818 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:10.386733    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:02:11.395454 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:11.395412    2576 patch_prober.go:28] interesting pod/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:02:11.395956 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:11.395483    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:02:12.386424 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:12.386378    2576 patch_prober.go:28] interesting pod/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:02:12.386747 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:12.386706    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:02:13.386644 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:13.386602    2576 patch_prober.go:28] interesting pod/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:02:13.387168 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:13.386672    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:02:14.387347 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:14.387303    2576 patch_prober.go:28] interesting pod/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:02:14.387854 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:14.387409    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:02:15.390930 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:15.390898    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:02:15.391323 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:15.391189    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:02:15.391754 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:15.391735    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:02:22.145102 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:22.145073    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:02:22.154407 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:22.154380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:02:22.312183 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:02:22.312149    2576 scope.go:117] "RemoveContainer" containerID="3a2540a4b729d87b4d63c8f6e8958b3bc15ae46a2b0aba2ed91f60cccdf39b7f"
Aug 05 17:03:00.737430 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:00.737389    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"]
Aug 05 17:03:00.741048 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:00.741030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"
Aug 05 17:03:00.743353 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:00.743332    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 17:03:00.749309 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:00.748909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"]
Aug 05 17:03:00.823556 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:00.823513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814fa3b-5c23-486d-8601-19e75ba63e50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-febb9564-5wglr\" (UID: \"5814fa3b-5c23-486d-8601-19e75ba63e50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"
Aug 05 17:03:00.924578 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:00.924542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814fa3b-5c23-486d-8601-19e75ba63e50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-febb9564-5wglr\" (UID: \"5814fa3b-5c23-486d-8601-19e75ba63e50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"
Aug 05 17:03:00.925289 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:00.925267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814fa3b-5c23-486d-8601-19e75ba63e50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-febb9564-5wglr\" (UID: \"5814fa3b-5c23-486d-8601-19e75ba63e50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"
Aug 05 17:03:01.054503 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:01.054411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"
Aug 05 17:03:01.198378 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:01.198343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"]
Aug 05 17:03:01.199792 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:03:01.199765    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5814fa3b_5c23_486d_8601_19e75ba63e50.slice/crio-d72acdc6c5c5f645ea3063f8a0d9726c32f2807a2571dd5236bc921cd55219e2 WatchSource:0}: Error finding container d72acdc6c5c5f645ea3063f8a0d9726c32f2807a2571dd5236bc921cd55219e2: Status 404 returned error can't find the container with id d72acdc6c5c5f645ea3063f8a0d9726c32f2807a2571dd5236bc921cd55219e2
Aug 05 17:03:01.613093 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:01.613051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr" event={"ID":"5814fa3b-5c23-486d-8601-19e75ba63e50","Type":"ContainerStarted","Data":"5bff56356d6c9f20fa0afaa5ad366658140dbb1b309446101341ad7ccfdf71a0"}
Aug 05 17:03:01.613299 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:01.613115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr" event={"ID":"5814fa3b-5c23-486d-8601-19e75ba63e50","Type":"ContainerStarted","Data":"d72acdc6c5c5f645ea3063f8a0d9726c32f2807a2571dd5236bc921cd55219e2"}
Aug 05 17:03:01.630271 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:01.630218    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr" podStartSLOduration=1.630202869 podStartE2EDuration="1.630202869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:03:01.627885839 +0000 UTC m=+2440.134777551" watchObservedRunningTime="2026-08-05 17:03:01.630202869 +0000 UTC m=+2440.137094581"
Aug 05 17:03:02.620605 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:02.620569    2576 generic.go:356] "Generic (PLEG): container finished" podID="5814fa3b-5c23-486d-8601-19e75ba63e50" containerID="5bff56356d6c9f20fa0afaa5ad366658140dbb1b309446101341ad7ccfdf71a0" exitCode=0
Aug 05 17:03:02.621021 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:02.620651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr" event={"ID":"5814fa3b-5c23-486d-8601-19e75ba63e50","Type":"ContainerDied","Data":"5bff56356d6c9f20fa0afaa5ad366658140dbb1b309446101341ad7ccfdf71a0"}
Aug 05 17:03:03.768961 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:03.768936    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"
Aug 05 17:03:03.853381 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:03.853338    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814fa3b-5c23-486d-8601-19e75ba63e50-maas-api-service-ca\") pod \"5814fa3b-5c23-486d-8601-19e75ba63e50\" (UID: \"5814fa3b-5c23-486d-8601-19e75ba63e50\") "
Aug 05 17:03:03.853760 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:03.853739    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5814fa3b-5c23-486d-8601-19e75ba63e50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5814fa3b-5c23-486d-8601-19e75ba63e50" (UID: "5814fa3b-5c23-486d-8601-19e75ba63e50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:03:03.955057 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:03.955018    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5814fa3b-5c23-486d-8601-19e75ba63e50-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:03:04.634344 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:04.634304    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr" event={"ID":"5814fa3b-5c23-486d-8601-19e75ba63e50","Type":"ContainerDied","Data":"d72acdc6c5c5f645ea3063f8a0d9726c32f2807a2571dd5236bc921cd55219e2"}
Aug 05 17:03:04.634344 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:04.634344    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"
Aug 05 17:03:04.634562 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:04.634363    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d72acdc6c5c5f645ea3063f8a0d9726c32f2807a2571dd5236bc921cd55219e2"
Aug 05 17:03:16.643184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:16.643143    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"]
Aug 05 17:03:16.645945 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:16.645898    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-febb9564-5wglr"]
Aug 05 17:03:17.992428 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:17.992386    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5814fa3b-5c23-486d-8601-19e75ba63e50" path="/var/lib/kubelet/pods/5814fa3b-5c23-486d-8601-19e75ba63e50/volumes"
Aug 05 17:03:22.333655 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:03:22.333619    2576 scope.go:117] "RemoveContainer" containerID="2dfaef843a64ca0ca19fe9e4c844395719b80d48ad01a5f54fd7a17985be241f"
Aug 05 17:04:03.000037 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:02.999995    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"]
Aug 05 17:04:03.000571 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:03.000260    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy" containerID="cri-o://98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599" gracePeriod=30
Aug 05 17:04:08.257779 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.257753    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:04:08.269945 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.269877    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-socket\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.269945 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.269920    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-token\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270140 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.269949    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-podinfo\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270140 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.269971    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-certs\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270140 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270026    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-data\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270140 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istiod-ca-cert\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270140 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270082    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-credential-socket\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270140 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270113    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4jk2\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-kube-api-access-m4jk2\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270463 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270146    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-envoy\") pod \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\" (UID: \"8c764529-1b29-4b6b-aa55-fb5fa51070a7\") "
Aug 05 17:04:08.270463 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:08.270463 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270321    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:08.270625 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270505    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.270625 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270523    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.270625 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270574    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:04:08.270625 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270591    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:08.270837 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.270698    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:08.272453 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.272427    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:08.272568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.272483    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-kube-api-access-m4jk2" (OuterVolumeSpecName: "kube-api-access-m4jk2") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "kube-api-access-m4jk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:04:08.272568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.272542    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:04:08.272568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.272543    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c764529-1b29-4b6b-aa55-fb5fa51070a7" (UID: "8c764529-1b29-4b6b-aa55-fb5fa51070a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:04:08.371231 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.371199    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.371231 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.371227    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.371231 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.371240    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.371471 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.371252    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.371471 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.371262    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.371471 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.371274    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4jk2\" (UniqueName: \"kubernetes.io/projected/8c764529-1b29-4b6b-aa55-fb5fa51070a7-kube-api-access-m4jk2\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.371471 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.371286    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c764529-1b29-4b6b-aa55-fb5fa51070a7-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.992103 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.992071    2576 generic.go:356] "Generic (PLEG): container finished" podID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerID="98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599" exitCode=0
Aug 05 17:04:08.992274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.992119    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"
Aug 05 17:04:08.992274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.992127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" event={"ID":"8c764529-1b29-4b6b-aa55-fb5fa51070a7","Type":"ContainerDied","Data":"98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599"}
Aug 05 17:04:08.992274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.992168    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8" event={"ID":"8c764529-1b29-4b6b-aa55-fb5fa51070a7","Type":"ContainerDied","Data":"daac8d336b48474a1812112eeb4f4ac299d2b391d8dd18713521771ed2b2a6bb"}
Aug 05 17:04:08.992274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:08.992189    2576 scope.go:117] "RemoveContainer" containerID="98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599"
Aug 05 17:04:09.002118 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.002100    2576 scope.go:117] "RemoveContainer" containerID="235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded"
Aug 05 17:04:09.010366 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.010346    2576 scope.go:117] "RemoveContainer" containerID="98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599"
Aug 05 17:04:09.010614 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:04:09.010594    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599\": container with ID starting with 98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599 not found: ID does not exist" containerID="98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599"
Aug 05 17:04:09.010683 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.010622    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599"} err="failed to get container status \"98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599\": rpc error: code = NotFound desc = could not find container \"98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599\": container with ID starting with 98500afa78ca2786856b215422d64a8f0691a4db25d3333c411add4f9a7b6599 not found: ID does not exist"
Aug 05 17:04:09.010683 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.010640    2576 scope.go:117] "RemoveContainer" containerID="235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded"
Aug 05 17:04:09.010885 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:04:09.010867    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded\": container with ID starting with 235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded not found: ID does not exist" containerID="235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded"
Aug 05 17:04:09.010933 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.010893    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded"} err="failed to get container status \"235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded\": rpc error: code = NotFound desc = could not find container \"235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded\": container with ID starting with 235b1d8eac55098ac66ea120c8197db4ceccf4285dab1bb591537cd585da1ded not found: ID does not exist"
Aug 05 17:04:09.015234 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.015215    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"]
Aug 05 17:04:09.018917 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.018895    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-febb9564-openshift-default-57c7488968-q4gs8"]
Aug 05 17:04:09.991181 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:04:09.991143    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" path="/var/lib/kubelet/pods/8c764529-1b29-4b6b-aa55-fb5fa51070a7/volumes"
Aug 05 17:05:09.167015 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.166958    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"]
Aug 05 17:05:09.167425 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167393    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy"
Aug 05 17:05:09.167425 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167405    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy"
Aug 05 17:05:09.167425 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167414    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5814fa3b-5c23-486d-8601-19e75ba63e50" containerName="revoke-keys"
Aug 05 17:05:09.167425 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167421    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5814fa3b-5c23-486d-8601-19e75ba63e50" containerName="revoke-keys"
Aug 05 17:05:09.167555 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167430    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy"
Aug 05 17:05:09.167555 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167435    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy"
Aug 05 17:05:09.167555 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167507    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy"
Aug 05 17:05:09.167555 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167514    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c764529-1b29-4b6b-aa55-fb5fa51070a7" containerName="istio-proxy"
Aug 05 17:05:09.167555 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.167522    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5814fa3b-5c23-486d-8601-19e75ba63e50" containerName="revoke-keys"
Aug 05 17:05:09.170692 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.170676    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.173615 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.173594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-deb398-openshift-default-dockercfg-6t7b4\""
Aug 05 17:05:09.184115 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.184091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"]
Aug 05 17:05:09.260680 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-credential-socket\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.260680 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-podinfo\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.260900 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-envoy\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.260900 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istiod-ca-cert\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.260900 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc5q4\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-kube-api-access-kc5q4\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.260900 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-socket\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.260900 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260891    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-certs\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.261122 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-data\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.261122 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.260942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-token\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361695 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-envoy\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361695 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istiod-ca-cert\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc5q4\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-kube-api-access-kc5q4\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-socket\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-certs\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-data\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-token\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.361953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-credential-socket\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.362281 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.361956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-podinfo\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.362502 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.362472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-certs\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.362665 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.362524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-data\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.362665 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.362546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-credential-socket\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.362665 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.362622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istiod-ca-cert\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.362798 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.362747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-socket\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.364166 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.364147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-envoy\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.364369 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.364352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-podinfo\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.369557 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.369535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-token\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.369770 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.369750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc5q4\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-kube-api-access-kc5q4\") pod \"e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") " pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.480505 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.480417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:09.633930 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.633893    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"]
Aug 05 17:05:09.636620 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:05:09.636591    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb056952b_6b13_4a35_9ce5_30cdc6f8f312.slice/crio-453e50d390e16af9b02577fdabcb32f699c69e9705c6e886f9c3e26a15cb9b8b WatchSource:0}: Error finding container 453e50d390e16af9b02577fdabcb32f699c69e9705c6e886f9c3e26a15cb9b8b: Status 404 returned error can't find the container with id 453e50d390e16af9b02577fdabcb32f699c69e9705c6e886f9c3e26a15cb9b8b
Aug 05 17:05:09.639129 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.639099    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:09.639212 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.639163    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:09.639212 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:09.639192    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:10.320919 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:10.320883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" event={"ID":"b056952b-6b13-4a35-9ce5-30cdc6f8f312","Type":"ContainerStarted","Data":"934da7f45c00f4f6d42fdc49c8e7a57fd02b79275074434a619d13f304808cb2"}
Aug 05 17:05:10.321440 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:10.320943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" event={"ID":"b056952b-6b13-4a35-9ce5-30cdc6f8f312","Type":"ContainerStarted","Data":"453e50d390e16af9b02577fdabcb32f699c69e9705c6e886f9c3e26a15cb9b8b"}
Aug 05 17:05:10.343130 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:10.343087    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podStartSLOduration=1.34307181 podStartE2EDuration="1.34307181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:05:10.340934742 +0000 UTC m=+2568.847826454" watchObservedRunningTime="2026-08-05 17:05:10.34307181 +0000 UTC m=+2568.849963521"
Aug 05 17:05:10.481030 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:10.480998    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:10.486876 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:10.486843    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:11.326823 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:11.326793    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:11.327916 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:11.327898    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:22.369256 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:22.369218    2576 scope.go:117] "RemoveContainer" containerID="561c8721ea125f1bc8e5be9aba8b57d0846cbcf02fd71d3ae640b4caed0af25a"
Aug 05 17:05:26.327956 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.327919    2576 patch_prober.go:28] interesting pod/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Aug 05 17:05:26.328418 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.328013    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Aug 05 17:05:26.422031 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.421972    2576 generic.go:356] "Generic (PLEG): container finished" podID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerID="934da7f45c00f4f6d42fdc49c8e7a57fd02b79275074434a619d13f304808cb2" exitCode=0
Aug 05 17:05:26.422195 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.422044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" event={"ID":"b056952b-6b13-4a35-9ce5-30cdc6f8f312","Type":"ContainerDied","Data":"934da7f45c00f4f6d42fdc49c8e7a57fd02b79275074434a619d13f304808cb2"}
Aug 05 17:05:26.422448 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.422434    2576 scope.go:117] "RemoveContainer" containerID="934da7f45c00f4f6d42fdc49c8e7a57fd02b79275074434a619d13f304808cb2"
Aug 05 17:05:26.423494 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.423462    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:26.423857 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.423525    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:26.423857 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:26.423554    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:27.429781 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:27.429750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" event={"ID":"b056952b-6b13-4a35-9ce5-30cdc6f8f312","Type":"ContainerStarted","Data":"0150d0be283ffa72309577355a15ea5de9455a94b834ef93ae40d5d0884b3991"}
Aug 05 17:05:27.481050 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:27.481022    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:27.481202 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:27.481182    2576 patch_prober.go:28] interesting pod/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Aug 05 17:05:27.481247 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:27.481222    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Aug 05 17:05:28.481594 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:28.481561    2576 patch_prober.go:28] interesting pod/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Aug 05 17:05:28.482003 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:28.481611    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Aug 05 17:05:29.481302 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:29.481265    2576 patch_prober.go:28] interesting pod/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Aug 05 17:05:29.481484 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:29.481327    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Aug 05 17:05:30.481162 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:30.481125    2576 patch_prober.go:28] interesting pod/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Aug 05 17:05:30.481618 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:30.481183    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Aug 05 17:05:31.481380 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:31.481348    2576 patch_prober.go:28] interesting pod/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Aug 05 17:05:31.481787 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:31.481396    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Aug 05 17:05:32.485379 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:32.485346    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:32.485854 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:32.485618    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:32.486344 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:32.486324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:05:38.071429 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.071396    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"]
Aug 05 17:05:38.075123 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.075102    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.080543 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.080519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3602fc-openshift-default-dockercfg-l9m2b\""
Aug 05 17:05:38.091229 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.091203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"]
Aug 05 17:05:38.158523 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7zl\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-kube-api-access-9f7zl\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.158726 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-data\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.158726 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-envoy\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.158726 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158665    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-socket\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.158726 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-credential-socket\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.158726 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istiod-ca-cert\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.159057 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-token\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.159057 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-podinfo\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.159057 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.158874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-certs\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260350 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-envoy\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260350 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-socket\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260561 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-credential-socket\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260561 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istiod-ca-cert\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260561 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-token\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260689 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-podinfo\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260689 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-certs\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260689 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7zl\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-kube-api-access-9f7zl\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260843 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-data\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260843 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-socket\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.260955 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.260884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-credential-socket\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.261086 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.261062    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-data\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.261223 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.261202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istiod-ca-cert\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.261299 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.261275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-certs\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.262724 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.262708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-envoy\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.263092 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.263074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-podinfo\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.280643 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.280611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-token\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.281944 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.281925    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7zl\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-kube-api-access-9f7zl\") pod \"e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") " pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.386115 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.386083    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:38.544913 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.541188    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"]
Aug 05 17:05:38.544913 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:05:38.541589    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613f0577_214c_4e86_9c8a_b0ee6ec6dd36.slice/crio-5f9c20e19104e6948c93935bbc25f82589e218cf9616619d060ea31858d594ea WatchSource:0}: Error finding container 5f9c20e19104e6948c93935bbc25f82589e218cf9616619d060ea31858d594ea: Status 404 returned error can't find the container with id 5f9c20e19104e6948c93935bbc25f82589e218cf9616619d060ea31858d594ea
Aug 05 17:05:38.546487 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.546455    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:38.546570 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.546516    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:38.546570 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:38.546543    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:39.497235 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:39.497194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" event={"ID":"613f0577-214c-4e86-9c8a-b0ee6ec6dd36","Type":"ContainerStarted","Data":"ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e"}
Aug 05 17:05:39.497672 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:39.497252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" event={"ID":"613f0577-214c-4e86-9c8a-b0ee6ec6dd36","Type":"ContainerStarted","Data":"5f9c20e19104e6948c93935bbc25f82589e218cf9616619d060ea31858d594ea"}
Aug 05 17:05:39.518135 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:39.518078    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podStartSLOduration=1.518063235 podStartE2EDuration="1.518063235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:05:39.516467186 +0000 UTC m=+2598.023358926" watchObservedRunningTime="2026-08-05 17:05:39.518063235 +0000 UTC m=+2598.024954947"
Aug 05 17:05:40.386514 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:40.386472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:40.393274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:40.393247    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:40.503806 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:40.503778    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:40.504636 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:40.504606    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:55.505550 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.505520    2576 patch_prober.go:28] interesting pod/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:05:55.505946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.505584    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:05:55.588464 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.588436    2576 generic.go:356] "Generic (PLEG): container finished" podID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerID="ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e" exitCode=0
Aug 05 17:05:55.588607 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.588499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" event={"ID":"613f0577-214c-4e86-9c8a-b0ee6ec6dd36","Type":"ContainerDied","Data":"ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e"}
Aug 05 17:05:55.588876 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.588859    2576 scope.go:117] "RemoveContainer" containerID="ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e"
Aug 05 17:05:55.589868 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.589840    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:55.589921 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.589906    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:55.589962 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:55.589939    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:05:56.599946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:56.599898    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" event={"ID":"613f0577-214c-4e86-9c8a-b0ee6ec6dd36","Type":"ContainerStarted","Data":"c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891"}
Aug 05 17:05:57.387358 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:57.387312    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:05:57.387558 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:57.387494    2576 patch_prober.go:28] interesting pod/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:05:57.387628 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:57.387569    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:05:58.387075 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:58.387037    2576 patch_prober.go:28] interesting pod/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:05:58.387664 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:58.387630    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:05:59.386562 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:59.386517    2576 patch_prober.go:28] interesting pod/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:05:59.386743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:05:59.386584    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:06:00.387498 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:06:00.387458    2576 patch_prober.go:28] interesting pod/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:06:00.388131 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:06:00.388094    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:06:01.387478 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:06:01.387441    2576 patch_prober.go:28] interesting pod/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:06:01.387804 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:06:01.387764    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:06:02.390495 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:06:02.390462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:06:02.390912 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:06:02.390747    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:06:02.391537 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:06:02.391522    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:07:22.179527 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:22.179449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:07:22.189493 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:22.189470    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:07:32.712114 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:32.712074    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"]
Aug 05 17:07:32.720404 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:32.720367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"
Aug 05 17:07:32.725388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:32.723611    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 17:07:32.725558 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:32.725501    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"]
Aug 05 17:07:32.795769 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:32.795725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e94fe53-9e20-4601-b386-c63d7a3ac5f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw\" (UID: \"9e94fe53-9e20-4601-b386-c63d7a3ac5f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"
Aug 05 17:07:32.897279 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:32.897233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e94fe53-9e20-4601-b386-c63d7a3ac5f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw\" (UID: \"9e94fe53-9e20-4601-b386-c63d7a3ac5f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"
Aug 05 17:07:32.897928 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:32.897902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e94fe53-9e20-4601-b386-c63d7a3ac5f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw\" (UID: \"9e94fe53-9e20-4601-b386-c63d7a3ac5f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"
Aug 05 17:07:33.035378 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:33.035279    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"
Aug 05 17:07:33.195618 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:33.195594    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"]
Aug 05 17:07:33.198472 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:07:33.198440    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e94fe53_9e20_4601_b386_c63d7a3ac5f8.slice/crio-c25d5359d371722ddc864792145365c683031763f82af06624268e0b6f49d99b WatchSource:0}: Error finding container c25d5359d371722ddc864792145365c683031763f82af06624268e0b6f49d99b: Status 404 returned error can't find the container with id c25d5359d371722ddc864792145365c683031763f82af06624268e0b6f49d99b
Aug 05 17:07:34.160778 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:34.160747    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e94fe53-9e20-4601-b386-c63d7a3ac5f8" containerID="2575b48569246605703ab68ce78c092a62551b3becaa722713cf57151f016596" exitCode=0
Aug 05 17:07:34.161158 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:34.160831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw" event={"ID":"9e94fe53-9e20-4601-b386-c63d7a3ac5f8","Type":"ContainerDied","Data":"2575b48569246605703ab68ce78c092a62551b3becaa722713cf57151f016596"}
Aug 05 17:07:34.161158 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:34.160890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw" event={"ID":"9e94fe53-9e20-4601-b386-c63d7a3ac5f8","Type":"ContainerStarted","Data":"c25d5359d371722ddc864792145365c683031763f82af06624268e0b6f49d99b"}
Aug 05 17:07:35.308053 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:35.308028    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"
Aug 05 17:07:35.423363 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:35.423263    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e94fe53-9e20-4601-b386-c63d7a3ac5f8-maas-api-service-ca\") pod \"9e94fe53-9e20-4601-b386-c63d7a3ac5f8\" (UID: \"9e94fe53-9e20-4601-b386-c63d7a3ac5f8\") "
Aug 05 17:07:35.423707 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:35.423679    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e94fe53-9e20-4601-b386-c63d7a3ac5f8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9e94fe53-9e20-4601-b386-c63d7a3ac5f8" (UID: "9e94fe53-9e20-4601-b386-c63d7a3ac5f8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:35.524926 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:35.524890    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e94fe53-9e20-4601-b386-c63d7a3ac5f8-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:36.173119 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:36.173080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw" event={"ID":"9e94fe53-9e20-4601-b386-c63d7a3ac5f8","Type":"ContainerDied","Data":"c25d5359d371722ddc864792145365c683031763f82af06624268e0b6f49d99b"}
Aug 05 17:07:36.173288 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:36.173135    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c25d5359d371722ddc864792145365c683031763f82af06624268e0b6f49d99b"
Aug 05 17:07:36.173288 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:36.173097    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"
Aug 05 17:07:43.597853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:43.597819    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"]
Aug 05 17:07:43.599833 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:43.599810    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-deb398-k2mbw"]
Aug 05 17:07:43.999692 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:43.999654    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e94fe53-9e20-4601-b386-c63d7a3ac5f8" path="/var/lib/kubelet/pods/9e94fe53-9e20-4601-b386-c63d7a3ac5f8/volumes"
Aug 05 17:07:50.037097 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:50.037054    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"]
Aug 05 17:07:50.037554 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:50.037256    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy" containerID="cri-o://0150d0be283ffa72309577355a15ea5de9455a94b834ef93ae40d5d0884b3991" gracePeriod=30
Aug 05 17:07:55.281764 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.281730    2576 generic.go:356] "Generic (PLEG): container finished" podID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerID="0150d0be283ffa72309577355a15ea5de9455a94b834ef93ae40d5d0884b3991" exitCode=0
Aug 05 17:07:55.282211 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.281792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" event={"ID":"b056952b-6b13-4a35-9ce5-30cdc6f8f312","Type":"ContainerDied","Data":"0150d0be283ffa72309577355a15ea5de9455a94b834ef93ae40d5d0884b3991"}
Aug 05 17:07:55.282211 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.281847    2576 scope.go:117] "RemoveContainer" containerID="934da7f45c00f4f6d42fdc49c8e7a57fd02b79275074434a619d13f304808cb2"
Aug 05 17:07:55.309148 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.309127    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:07:55.411675 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411643    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istiod-ca-cert\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.411853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411688    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-socket\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.411853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411710    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-credential-socket\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.411853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411745    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-podinfo\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.411853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411793    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-token\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.411853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411828    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-envoy\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.411853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411852    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-certs\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.412204 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411886    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc5q4\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-kube-api-access-kc5q4\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.412204 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.411940    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-data\") pod \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\" (UID: \"b056952b-6b13-4a35-9ce5-30cdc6f8f312\") "
Aug 05 17:07:55.412204 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.412020    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:55.412204 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.412127    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:55.412413 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.412343    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-data" (OuterVolumeSpecName: "istio-data") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:55.412413 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.412354    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.412413 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.412408    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.412574 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.412448    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:55.412574 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.412490    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:55.414269 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.414235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-token" (OuterVolumeSpecName: "istio-token") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:55.414403 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.414319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:55.414467 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.414443    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:07:55.414523 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.414509    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-kube-api-access-kc5q4" (OuterVolumeSpecName: "kube-api-access-kc5q4") pod "b056952b-6b13-4a35-9ce5-30cdc6f8f312" (UID: "b056952b-6b13-4a35-9ce5-30cdc6f8f312"). InnerVolumeSpecName "kube-api-access-kc5q4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:55.513543 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.513512    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.513543 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.513537    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.513543 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.513546    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.513543 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.513553    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.513791 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.513563    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc5q4\" (UniqueName: \"kubernetes.io/projected/b056952b-6b13-4a35-9ce5-30cdc6f8f312-kube-api-access-kc5q4\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.513791 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.513571    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:55.513791 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:55.513578    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b056952b-6b13-4a35-9ce5-30cdc6f8f312-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:07:56.288165 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:56.288074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj" event={"ID":"b056952b-6b13-4a35-9ce5-30cdc6f8f312","Type":"ContainerDied","Data":"453e50d390e16af9b02577fdabcb32f699c69e9705c6e886f9c3e26a15cb9b8b"}
Aug 05 17:07:56.288165 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:56.288093    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"
Aug 05 17:07:56.288165 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:56.288142    2576 scope.go:117] "RemoveContainer" containerID="0150d0be283ffa72309577355a15ea5de9455a94b834ef93ae40d5d0884b3991"
Aug 05 17:07:56.326251 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:56.326222    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"]
Aug 05 17:07:56.330431 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:56.330408    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-deb398-openshift-default-84d79b68dd-s5kzj"]
Aug 05 17:07:57.990625 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:07:57.990589    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" path="/var/lib/kubelet/pods/b056952b-6b13-4a35-9ce5-30cdc6f8f312/volumes"
Aug 05 17:08:07.635193 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:07.635157    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"]
Aug 05 17:08:07.635735 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:07.635428    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy" containerID="cri-o://c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891" gracePeriod=30
Aug 05 17:08:08.561791 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.561756    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"]
Aug 05 17:08:08.562452 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562395    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy"
Aug 05 17:08:08.562452 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562421    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy"
Aug 05 17:08:08.562702 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562463    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy"
Aug 05 17:08:08.562702 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562473    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy"
Aug 05 17:08:08.562702 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562490    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e94fe53-9e20-4601-b386-c63d7a3ac5f8" containerName="revoke-keys"
Aug 05 17:08:08.562702 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562499    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e94fe53-9e20-4601-b386-c63d7a3ac5f8" containerName="revoke-keys"
Aug 05 17:08:08.562702 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562621    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy"
Aug 05 17:08:08.562702 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562636    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b056952b-6b13-4a35-9ce5-30cdc6f8f312" containerName="istio-proxy"
Aug 05 17:08:08.562702 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.562656    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e94fe53-9e20-4601-b386-c63d7a3ac5f8" containerName="revoke-keys"
Aug 05 17:08:08.565839 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.565823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.568527 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.568504    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2e153a-openshift-default-dockercfg-s6jhm\""
Aug 05 17:08:08.580763 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.580731    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"]
Aug 05 17:08:08.642746 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.642712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-data\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.642823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5c2\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-kube-api-access-wb5c2\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.642876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-envoy\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.642905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-podinfo\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.642927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-credential-socket\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.643045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-token\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.643106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-socket\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.643147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istiod-ca-cert\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.643253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.643178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-certs\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744187 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5c2\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-kube-api-access-wb5c2\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744373 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-envoy\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744373 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-podinfo\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744493 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-credential-socket\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744493 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-token\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744493 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-socket\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744723 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istiod-ca-cert\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744723 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-certs\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744723 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-data\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744868 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-credential-socket\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.744868 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-socket\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.745010 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.744947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-data\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.745072 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.745030    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-certs\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.745279 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.745259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istiod-ca-cert\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.746689 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.746658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-envoy\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.746804 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.746786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-podinfo\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.751969 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.751941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-token\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.752461 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.752441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5c2\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-kube-api-access-wb5c2\") pod \"e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") " pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:08.876591 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:08.876500    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:09.020310 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.020284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"]
Aug 05 17:08:09.022427 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:08:09.022397    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8b7c64_65d0_4c8f_b1b8_e7c9393d937b.slice/crio-aa65c9891e3e493cc108b500c7a429d52dfc46de52b98d386a8606c2fe469f6a WatchSource:0}: Error finding container aa65c9891e3e493cc108b500c7a429d52dfc46de52b98d386a8606c2fe469f6a: Status 404 returned error can't find the container with id aa65c9891e3e493cc108b500c7a429d52dfc46de52b98d386a8606c2fe469f6a
Aug 05 17:08:09.024899 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.024870    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:09.024996 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.024934    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:09.024996 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.024964    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:09.359820 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.359782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" event={"ID":"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b","Type":"ContainerStarted","Data":"85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71"}
Aug 05 17:08:09.360045 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.359839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" event={"ID":"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b","Type":"ContainerStarted","Data":"aa65c9891e3e493cc108b500c7a429d52dfc46de52b98d386a8606c2fe469f6a"}
Aug 05 17:08:09.380506 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.380454    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podStartSLOduration=1.380437278 podStartE2EDuration="1.380437278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:09.379375066 +0000 UTC m=+2747.886266797" watchObservedRunningTime="2026-08-05 17:08:09.380437278 +0000 UTC m=+2747.887329044"
Aug 05 17:08:09.876912 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:09.876874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:10.882114 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:10.882087    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:11.371410 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:11.371324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:11.372488 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:11.372467    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:12.910388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.910335    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:08:12.984436 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984405    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-credential-socket\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984609 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984449    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istiod-ca-cert\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984609 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984486    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-podinfo\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984609 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984535    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-socket\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984750 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984661    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-data\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984750 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984697    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-token\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984750 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984693    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:12.984913 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f7zl\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-kube-api-access-9f7zl\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984913 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-certs\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.984913 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984851    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:12.984913 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984859    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-envoy\") pod \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\" (UID: \"613f0577-214c-4e86-9c8a-b0ee6ec6dd36\") "
Aug 05 17:08:12.985146 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.984951    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-data" (OuterVolumeSpecName: "istio-data") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:12.985146 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.985031    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:12.985254 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.985149    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:12.985383 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.985336    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:12.985383 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.985362    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:12.985659 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.985500    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:12.985659 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.985521    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:12.985659 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.985534    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:12.987690 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.987654    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-kube-api-access-9f7zl" (OuterVolumeSpecName: "kube-api-access-9f7zl") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "kube-api-access-9f7zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:12.988104 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.988084    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:08:12.988200 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.988096    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:12.988200 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:12.988105    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-token" (OuterVolumeSpecName: "istio-token") pod "613f0577-214c-4e86-9c8a-b0ee6ec6dd36" (UID: "613f0577-214c-4e86-9c8a-b0ee6ec6dd36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:13.088065 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.088026    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:13.088065 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.088063    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:13.088065 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.088073    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:13.088296 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.088082    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f7zl\" (UniqueName: \"kubernetes.io/projected/613f0577-214c-4e86-9c8a-b0ee6ec6dd36-kube-api-access-9f7zl\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:08:13.384675 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.384641    2576 generic.go:356] "Generic (PLEG): container finished" podID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerID="c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891" exitCode=0
Aug 05 17:08:13.384856 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.384696    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"
Aug 05 17:08:13.384856 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.384723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" event={"ID":"613f0577-214c-4e86-9c8a-b0ee6ec6dd36","Type":"ContainerDied","Data":"c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891"}
Aug 05 17:08:13.384856 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.384780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c" event={"ID":"613f0577-214c-4e86-9c8a-b0ee6ec6dd36","Type":"ContainerDied","Data":"5f9c20e19104e6948c93935bbc25f82589e218cf9616619d060ea31858d594ea"}
Aug 05 17:08:13.384856 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.384804    2576 scope.go:117] "RemoveContainer" containerID="c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891"
Aug 05 17:08:13.396484 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.396458    2576 scope.go:117] "RemoveContainer" containerID="ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e"
Aug 05 17:08:13.410128 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.410092    2576 scope.go:117] "RemoveContainer" containerID="c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891"
Aug 05 17:08:13.410485 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:08:13.410427    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891\": container with ID starting with c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891 not found: ID does not exist" containerID="c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891"
Aug 05 17:08:13.410558 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.410498    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891"} err="failed to get container status \"c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891\": rpc error: code = NotFound desc = could not find container \"c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891\": container with ID starting with c4929c32c894c8c237e0c7f0807a649c65912f8b93d7b17c1469bc29edac6891 not found: ID does not exist"
Aug 05 17:08:13.410558 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.410529    2576 scope.go:117] "RemoveContainer" containerID="ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e"
Aug 05 17:08:13.410804 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:08:13.410786    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e\": container with ID starting with ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e not found: ID does not exist" containerID="ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e"
Aug 05 17:08:13.410848 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.410820    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e"} err="failed to get container status \"ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e\": rpc error: code = NotFound desc = could not find container \"ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e\": container with ID starting with ec22fee7b1a7afe36faa5a20b1dbda162f6c79d1921dd01200e221f17da0c92e not found: ID does not exist"
Aug 05 17:08:13.412647 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.412625    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"]
Aug 05 17:08:13.417621 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.417598    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3602fc-openshift-default-84dbc98d6d-xcq9c"]
Aug 05 17:08:13.992259 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:13.992217    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" path="/var/lib/kubelet/pods/613f0577-214c-4e86-9c8a-b0ee6ec6dd36/volumes"
Aug 05 17:08:25.460075 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:25.460040    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerID="85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71" exitCode=0
Aug 05 17:08:25.460564 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:25.460119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" event={"ID":"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b","Type":"ContainerDied","Data":"85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71"}
Aug 05 17:08:25.460564 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:25.460537    2576 scope.go:117] "RemoveContainer" containerID="85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71"
Aug 05 17:08:25.461549 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:25.461525    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:25.461615 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:25.461590    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:25.461658 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:25.461619    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:26.372190 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:26.372145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:26.467168 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:26.467132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" event={"ID":"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b","Type":"ContainerStarted","Data":"65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652"}
Aug 05 17:08:26.877122 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:26.877087    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:26.878489 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:26.878464    2576 patch_prober.go:28] interesting pod/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 05 17:08:26.878597 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:26.878532    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 05 17:08:27.877316 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:27.877279    2576 patch_prober.go:28] interesting pod/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 05 17:08:27.877700 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:27.877344    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 05 17:08:28.877368 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:28.877331    2576 patch_prober.go:28] interesting pod/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 05 17:08:28.877813 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:28.877386    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 05 17:08:29.877423 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:29.877387    2576 patch_prober.go:28] interesting pod/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 05 17:08:29.877810 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:29.877440    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 05 17:08:30.877809 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:30.877776    2576 patch_prober.go:28] interesting pod/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 05 17:08:30.878201 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:30.877830    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 05 17:08:31.881447 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:31.881411    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:31.881828 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:31.881677    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:31.882528 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:31.882509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:08:37.095368 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.095336    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"]
Aug 05 17:08:37.096064 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.096038    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy"
Aug 05 17:08:37.096253 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.096228    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy"
Aug 05 17:08:37.096400 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.096383    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy"
Aug 05 17:08:37.096477 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.096402    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy"
Aug 05 17:08:37.099502 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.099486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.102139 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.102118    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2eaba9-openshift-default-dockercfg-fj2br\""
Aug 05 17:08:37.108617 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.108594    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"]
Aug 05 17:08:37.134029 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.133962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-credential-socket\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134192 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-data\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134192 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c98b261-9a96-484e-bb44-3b8405082a56-istiod-ca-cert\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134192 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnvc\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-kube-api-access-9cnvc\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134192 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-envoy\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134451 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-certs\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134451 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-istio-token\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134451 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c98b261-9a96-484e-bb44-3b8405082a56-istio-podinfo\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.134451 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.134304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-socket\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235096 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-istio-token\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235254 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c98b261-9a96-484e-bb44-3b8405082a56-istio-podinfo\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235254 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-socket\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235254 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-credential-socket\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235367 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-data\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235367 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c98b261-9a96-484e-bb44-3b8405082a56-istiod-ca-cert\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235367 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnvc\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-kube-api-access-9cnvc\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235367 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-envoy\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235522 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-certs\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235653 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-socket\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235787 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-certs\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.235915 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-credential-socket\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.236014 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.235951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-data\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.236088 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.236054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c98b261-9a96-484e-bb44-3b8405082a56-istiod-ca-cert\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.237664 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.237639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-envoy\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.237803 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.237784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c98b261-9a96-484e-bb44-3b8405082a56-istio-podinfo\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.244007 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.243964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-istio-token\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.244322 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.244305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnvc\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-kube-api-access-9cnvc\") pod \"e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") " pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.413286 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.413255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:37.552820 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.552796    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"]
Aug 05 17:08:37.554667 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:08:37.554640    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c98b261_9a96_484e_bb44_3b8405082a56.slice/crio-ac504991c7e6f3ff5965ba695249bdb16e9f526f2eccfaeb97e13aebb4e15154 WatchSource:0}: Error finding container ac504991c7e6f3ff5965ba695249bdb16e9f526f2eccfaeb97e13aebb4e15154: Status 404 returned error can't find the container with id ac504991c7e6f3ff5965ba695249bdb16e9f526f2eccfaeb97e13aebb4e15154
Aug 05 17:08:37.556993 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.556952    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:37.557064 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.557033    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:37.557099 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:37.557062    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:38.533717 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:38.533681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" event={"ID":"8c98b261-9a96-484e-bb44-3b8405082a56","Type":"ContainerStarted","Data":"fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387"}
Aug 05 17:08:38.534171 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:38.533733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" event={"ID":"8c98b261-9a96-484e-bb44-3b8405082a56","Type":"ContainerStarted","Data":"ac504991c7e6f3ff5965ba695249bdb16e9f526f2eccfaeb97e13aebb4e15154"}
Aug 05 17:08:38.554111 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:38.554065    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podStartSLOduration=1.554049419 podStartE2EDuration="1.554049419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:38.553121527 +0000 UTC m=+2777.060013246" watchObservedRunningTime="2026-08-05 17:08:38.554049419 +0000 UTC m=+2777.060941130"
Aug 05 17:08:39.414274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:39.414239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:39.419190 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:39.419161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:39.539452 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:39.539418    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:39.540495 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:39.540475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:54.541066 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.540961    2576 patch_prober.go:28] interesting pod/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:08:54.541471 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.541069    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:08:54.631163 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.631131    2576 generic.go:356] "Generic (PLEG): container finished" podID="8c98b261-9a96-484e-bb44-3b8405082a56" containerID="fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387" exitCode=0
Aug 05 17:08:54.631329 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.631175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" event={"ID":"8c98b261-9a96-484e-bb44-3b8405082a56","Type":"ContainerDied","Data":"fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387"}
Aug 05 17:08:54.631567 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.631554    2576 scope.go:117] "RemoveContainer" containerID="fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387"
Aug 05 17:08:54.632664 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.632638    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:54.632719 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.632705    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:54.632759 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:54.632737    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:55.639953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:55.639914    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" event={"ID":"8c98b261-9a96-484e-bb44-3b8405082a56","Type":"ContainerStarted","Data":"4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f"}
Aug 05 17:08:56.414280 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:56.414238    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:08:56.414493 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:56.414417    2576 patch_prober.go:28] interesting pod/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:08:56.414570 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:56.414484    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:08:57.414644 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:57.414603    2576 patch_prober.go:28] interesting pod/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:08:57.415051 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:57.414678    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:08:58.414708 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:58.414669    2576 patch_prober.go:28] interesting pod/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:08:58.415134 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:58.414722    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:08:59.414065 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:59.414027    2576 patch_prober.go:28] interesting pod/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:08:59.414241 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:08:59.414086    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:09:00.414182 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:00.414140    2576 patch_prober.go:28] interesting pod/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:09:00.414668 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:00.414257    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:09:01.418245 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:01.418214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:09:01.418684 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:01.418598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:09:01.419426 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:01.419406    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:09:22.427685 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:22.427655    2576 scope.go:117] "RemoveContainer" containerID="5bff56356d6c9f20fa0afaa5ad366658140dbb1b309446101341ad7ccfdf71a0"
Aug 05 17:09:31.473733 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:31.473698    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"]
Aug 05 17:09:31.474374 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:31.473922    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy" containerID="cri-o://65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652" gracePeriod=30
Aug 05 17:09:31.890769 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:31.890733    2576 patch_prober.go:28] interesting pod/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:09:31.890962 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:31.890808    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:09:36.727290 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.727261    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:09:36.838110 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838013    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-envoy\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838110 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838096    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-podinfo\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838347 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838152    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-token\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838347 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-certs\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838347 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838230    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-data\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838347 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838257    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istiod-ca-cert\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838347 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838311    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb5c2\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-kube-api-access-wb5c2\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838601 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838352    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-credential-socket\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838601 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-socket\") pod \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\" (UID: \"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b\") "
Aug 05 17:09:36.838601 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838556    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:36.838844 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:36.838844 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838805    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:36.838844 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.838813    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.839112 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.839086    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:36.839243 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.839114    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:36.840473 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.840450    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:36.840567 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.840521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:36.840699 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.840680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:09:36.840770 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.840717    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-kube-api-access-wb5c2" (OuterVolumeSpecName: "kube-api-access-wb5c2") pod "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" (UID: "9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b"). InnerVolumeSpecName "kube-api-access-wb5c2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:36.860358 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.860330    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerID="65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652" exitCode=0
Aug 05 17:09:36.860458 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.860383    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"
Aug 05 17:09:36.860458 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.860412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" event={"ID":"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b","Type":"ContainerDied","Data":"65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652"}
Aug 05 17:09:36.860551 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.860467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f" event={"ID":"9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b","Type":"ContainerDied","Data":"aa65c9891e3e493cc108b500c7a429d52dfc46de52b98d386a8606c2fe469f6a"}
Aug 05 17:09:36.860551 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.860489    2576 scope.go:117] "RemoveContainer" containerID="65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652"
Aug 05 17:09:36.869916 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.869899    2576 scope.go:117] "RemoveContainer" containerID="85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71"
Aug 05 17:09:36.878712 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.878692    2576 scope.go:117] "RemoveContainer" containerID="65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652"
Aug 05 17:09:36.879004 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:09:36.878966    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652\": container with ID starting with 65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652 not found: ID does not exist" containerID="65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652"
Aug 05 17:09:36.879061 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.879007    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652"} err="failed to get container status \"65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652\": rpc error: code = NotFound desc = could not find container \"65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652\": container with ID starting with 65536241dd5630f4ef15519b6228b077c20d7eb3ccf0d3cb69fb02ac460b0652 not found: ID does not exist"
Aug 05 17:09:36.879061 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.879033    2576 scope.go:117] "RemoveContainer" containerID="85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71"
Aug 05 17:09:36.879256 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:09:36.879239    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71\": container with ID starting with 85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71 not found: ID does not exist" containerID="85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71"
Aug 05 17:09:36.879290 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.879263    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71"} err="failed to get container status \"85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71\": rpc error: code = NotFound desc = could not find container \"85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71\": container with ID starting with 85cc88ca5cb474e1359634292fdba89092d10492a02fefa2a40d5c5390968e71 not found: ID does not exist"
Aug 05 17:09:36.884655 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.884632    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"]
Aug 05 17:09:36.892048 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.892027    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2e153a-openshift-default-65b8784946-7dj2f"]
Aug 05 17:09:36.939951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.939916    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.939951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.939947    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.940178 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.939961    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.940178 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.939973    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.940178 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.940013    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.940178 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.940025    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.940178 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.940036    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:36.940178 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:36.940047    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb5c2\" (UniqueName: \"kubernetes.io/projected/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b-kube-api-access-wb5c2\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:37.998108 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:37.998071    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" path="/var/lib/kubelet/pods/9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b/volumes"
Aug 05 17:09:50.028582 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:50.028536    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"]
Aug 05 17:09:50.029111 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:50.028813    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy" containerID="cri-o://4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f" gracePeriod=30
Aug 05 17:09:51.025433 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025399    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"]
Aug 05 17:09:51.025857 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025843    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy"
Aug 05 17:09:51.025909 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025858    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="613f0577-214c-4e86-9c8a-b0ee6ec6dd36" containerName="istio-proxy"
Aug 05 17:09:51.025909 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025875    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy"
Aug 05 17:09:51.025909 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025881    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy"
Aug 05 17:09:51.025909 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025889    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy"
Aug 05 17:09:51.025909 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025895    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy"
Aug 05 17:09:51.026106 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025966    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy"
Aug 05 17:09:51.026106 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.025993    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c8b7c64-65d0-4c8f-b1b8-e7c9393d937b" containerName="istio-proxy"
Aug 05 17:09:51.030539 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.030519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.033482 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.033457    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-92434d-openshift-default-dockercfg-7c94h\""
Aug 05 17:09:51.049868 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.049842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"]
Aug 05 17:09:51.073606 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-token\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb24h\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-kube-api-access-rb24h\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/967e341f-69ba-4f90-9f52-db4ab8031eec-istiod-ca-cert\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-socket\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-data\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-credential-socket\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-podinfo\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.073925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-envoy\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.074388 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.074067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-certs\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175082 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-socket\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175278 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-data\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175278 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-credential-socket\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175278 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-podinfo\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175278 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-envoy\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175278 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-certs\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175553 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-token\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175553 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb24h\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-kube-api-access-rb24h\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175553 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/967e341f-69ba-4f90-9f52-db4ab8031eec-istiod-ca-cert\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175553 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-socket\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175745 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-credential-socket\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175745 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-certs\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.175852 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.175775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-data\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.176251 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.176228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/967e341f-69ba-4f90-9f52-db4ab8031eec-istiod-ca-cert\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.177612 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.177589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-envoy\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.177781 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.177765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-podinfo\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.184321 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.184300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb24h\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-kube-api-access-rb24h\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.184441 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.184425    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-token\") pod \"e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") " pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.341149 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.341110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:51.486740 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.486713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"]
Aug 05 17:09:51.488948 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:09:51.488921    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967e341f_69ba_4f90_9f52_db4ab8031eec.slice/crio-82e2daee77e77be9199bfec5c14c783d43f3612718493ecfc13ad1b20215e6e0 WatchSource:0}: Error finding container 82e2daee77e77be9199bfec5c14c783d43f3612718493ecfc13ad1b20215e6e0: Status 404 returned error can't find the container with id 82e2daee77e77be9199bfec5c14c783d43f3612718493ecfc13ad1b20215e6e0
Aug 05 17:09:51.491587 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.491550    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:51.491671 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.491630    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:51.491725 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.491669    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:51.956465 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.956435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" event={"ID":"967e341f-69ba-4f90-9f52-db4ab8031eec","Type":"ContainerStarted","Data":"f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b"}
Aug 05 17:09:51.956662 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:51.956482    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" event={"ID":"967e341f-69ba-4f90-9f52-db4ab8031eec","Type":"ContainerStarted","Data":"82e2daee77e77be9199bfec5c14c783d43f3612718493ecfc13ad1b20215e6e0"}
Aug 05 17:09:52.341870 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:52.341786    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:52.346852 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:52.346830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:52.379397 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:52.379342    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podStartSLOduration=1.3793269000000001 podStartE2EDuration="1.3793269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:51.99856096 +0000 UTC m=+2850.505452672" watchObservedRunningTime="2026-08-05 17:09:52.3793269 +0000 UTC m=+2850.886218611"
Aug 05 17:09:52.962040 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:52.962012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:52.963086 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:52.963068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:09:55.294223 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.294164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:09:55.417969 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.417937    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c98b261-9a96-484e-bb44-3b8405082a56-istio-podinfo\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.417969 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.417999    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-data\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418257 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418030    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c98b261-9a96-484e-bb44-3b8405082a56-istiod-ca-cert\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418257 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418072    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-certs\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418257 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418109    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cnvc\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-kube-api-access-9cnvc\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418257 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-socket\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418257 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-istio-token\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418257 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-credential-socket\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418295    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-envoy\") pod \"8c98b261-9a96-484e-bb44-3b8405082a56\" (UID: \"8c98b261-9a96-484e-bb44-3b8405082a56\") "
Aug 05 17:09:55.418568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418341    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:55.418568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418479    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:55.418568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418513    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c98b261-9a96-484e-bb44-3b8405082a56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:55.418568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418496    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:55.418568 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418550    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:55.418888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418664    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.418888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418677    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.418888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418686    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c98b261-9a96-484e-bb44-3b8405082a56-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.418888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418696    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.418888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.418708    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.420362 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.420337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c98b261-9a96-484e-bb44-3b8405082a56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:09:55.420476 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.420399    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-kube-api-access-9cnvc" (OuterVolumeSpecName: "kube-api-access-9cnvc") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "kube-api-access-9cnvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:55.420813 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.420795    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:55.420873 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.420814    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c98b261-9a96-484e-bb44-3b8405082a56" (UID: "8c98b261-9a96-484e-bb44-3b8405082a56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:55.519304 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.519265    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cnvc\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-kube-api-access-9cnvc\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.519304 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.519299    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c98b261-9a96-484e-bb44-3b8405082a56-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.519304 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.519308    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c98b261-9a96-484e-bb44-3b8405082a56-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.519304 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.519316    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c98b261-9a96-484e-bb44-3b8405082a56-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:09:55.988128 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.988079    2576 generic.go:356] "Generic (PLEG): container finished" podID="8c98b261-9a96-484e-bb44-3b8405082a56" containerID="4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f" exitCode=0
Aug 05 17:09:55.988323 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.988190    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"
Aug 05 17:09:55.992129 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.992102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" event={"ID":"8c98b261-9a96-484e-bb44-3b8405082a56","Type":"ContainerDied","Data":"4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f"}
Aug 05 17:09:55.992270 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.992148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m" event={"ID":"8c98b261-9a96-484e-bb44-3b8405082a56","Type":"ContainerDied","Data":"ac504991c7e6f3ff5965ba695249bdb16e9f526f2eccfaeb97e13aebb4e15154"}
Aug 05 17:09:55.992270 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:55.992196    2576 scope.go:117] "RemoveContainer" containerID="4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f"
Aug 05 17:09:56.002890 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:56.002873    2576 scope.go:117] "RemoveContainer" containerID="fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387"
Aug 05 17:09:56.011229 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:56.011207    2576 scope.go:117] "RemoveContainer" containerID="4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f"
Aug 05 17:09:56.011463 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:09:56.011443    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f\": container with ID starting with 4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f not found: ID does not exist" containerID="4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f"
Aug 05 17:09:56.011537 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:56.011476    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f"} err="failed to get container status \"4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f\": rpc error: code = NotFound desc = could not find container \"4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f\": container with ID starting with 4456c3ac4ad9f9fdb538973a53b66019507614696ae828b77afb378f65eb208f not found: ID does not exist"
Aug 05 17:09:56.011537 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:56.011500    2576 scope.go:117] "RemoveContainer" containerID="fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387"
Aug 05 17:09:56.011743 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:09:56.011726    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387\": container with ID starting with fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387 not found: ID does not exist" containerID="fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387"
Aug 05 17:09:56.011783 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:56.011748    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387"} err="failed to get container status \"fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387\": rpc error: code = NotFound desc = could not find container \"fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387\": container with ID starting with fc161eacbcc22c8c82cf9f598df07dee80734e68e574f5998daf448615e61387 not found: ID does not exist"
Aug 05 17:09:56.019591 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:56.019565    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"]
Aug 05 17:09:56.028038 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:56.028014    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2eaba9-openshift-default-b8dbf7df4-zrl6m"]
Aug 05 17:09:57.990258 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:09:57.990218    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" path="/var/lib/kubelet/pods/8c98b261-9a96-484e-bb44-3b8405082a56/volumes"
Aug 05 17:10:08.108819 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:08.108787    2576 patch_prober.go:28] interesting pod/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": read tcp 10.132.0.2:50056->10.132.0.79:15021: read: connection reset by peer" start-of-body=
Aug 05 17:10:08.109385 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:08.108869    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": read tcp 10.132.0.2:50056->10.132.0.79:15021: read: connection reset by peer"
Aug 05 17:10:09.069065 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:09.069032    2576 generic.go:356] "Generic (PLEG): container finished" podID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerID="f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b" exitCode=0
Aug 05 17:10:09.069246 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:09.069110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" event={"ID":"967e341f-69ba-4f90-9f52-db4ab8031eec","Type":"ContainerDied","Data":"f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b"}
Aug 05 17:10:09.069532 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:09.069518    2576 scope.go:117] "RemoveContainer" containerID="f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b"
Aug 05 17:10:09.070581 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:09.070554    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:09.070657 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:09.070640    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:09.070693 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:09.070682    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:10.077266 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:10.077228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" event={"ID":"967e341f-69ba-4f90-9f52-db4ab8031eec","Type":"ContainerStarted","Data":"39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55"}
Aug 05 17:10:10.341573 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:10.341481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:10:10.341729 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:10.341694    2576 patch_prober.go:28] interesting pod/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:10:10.341774 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:10.341738    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:10:11.342128 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:11.342093    2576 patch_prober.go:28] interesting pod/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:10:11.342516 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:11.342151    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:10:12.341566 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:12.341531    2576 patch_prober.go:28] interesting pod/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:10:12.341750 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:12.341611    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:10:13.342254 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:13.342214    2576 patch_prober.go:28] interesting pod/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:10:13.342655 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:13.342274    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:10:14.342442 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:14.342359    2576 patch_prober.go:28] interesting pod/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:10:14.342442 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:14.342423    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:10:15.345844 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:15.345814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:10:15.346244 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:15.346084    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:10:15.346813 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:15.346794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:10:19.827921 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.827885    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"]
Aug 05 17:10:19.828362 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.828347    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy"
Aug 05 17:10:19.828413 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.828364    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy"
Aug 05 17:10:19.828470 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.828437    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy"
Aug 05 17:10:19.830846 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.830826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.833447 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.833425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-57997e-openshift-default-dockercfg-749d2\""
Aug 05 17:10:19.845466 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.845445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"]
Aug 05 17:10:19.869481 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-certs\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.869644 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-data\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.869722 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-socket\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.869782 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-istio-token\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.869838 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddqnn\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-kube-api-access-ddqnn\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.869838 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02705d2b-9f23-4716-a134-ab41a56b3760-istio-podinfo\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.869951 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-envoy\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.870033 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.869952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-credential-socket\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.870033 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.870009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02705d2b-9f23-4716-a134-ab41a56b3760-istiod-ca-cert\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971100 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-socket\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971100 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-istio-token\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971310 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddqnn\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-kube-api-access-ddqnn\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971310 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02705d2b-9f23-4716-a134-ab41a56b3760-istio-podinfo\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971310 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-envoy\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971310 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-credential-socket\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971310 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02705d2b-9f23-4716-a134-ab41a56b3760-istiod-ca-cert\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971578 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-certs\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971578 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-data\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971578 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971499    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-socket\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971578 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-credential-socket\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971802 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-certs\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.971802 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.971782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-data\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.972166 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.972138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02705d2b-9f23-4716-a134-ab41a56b3760-istiod-ca-cert\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.973442 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.973422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-envoy\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.974046 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.974027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02705d2b-9f23-4716-a134-ab41a56b3760-istio-podinfo\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.981106 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.981082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-istio-token\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:19.981222 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:19.981145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddqnn\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-kube-api-access-ddqnn\") pod \"e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") " pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:20.142110 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:20.142078    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:20.297170 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:20.296935    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"]
Aug 05 17:10:20.299656 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:10:20.299620    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02705d2b_9f23_4716_a134_ab41a56b3760.slice/crio-344af0bfc1c53e543a19ac521110839d3ac4663578b4466dc040c16600759ce7 WatchSource:0}: Error finding container 344af0bfc1c53e543a19ac521110839d3ac4663578b4466dc040c16600759ce7: Status 404 returned error can't find the container with id 344af0bfc1c53e543a19ac521110839d3ac4663578b4466dc040c16600759ce7
Aug 05 17:10:20.301737 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:20.301705    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:20.301835 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:20.301787    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:20.301902 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:20.301852    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:21.147658 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:21.147618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" event={"ID":"02705d2b-9f23-4716-a134-ab41a56b3760","Type":"ContainerStarted","Data":"71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe"}
Aug 05 17:10:21.148065 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:21.147675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" event={"ID":"02705d2b-9f23-4716-a134-ab41a56b3760","Type":"ContainerStarted","Data":"344af0bfc1c53e543a19ac521110839d3ac4663578b4466dc040c16600759ce7"}
Aug 05 17:10:21.191482 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:21.191411    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podStartSLOduration=2.191391051 podStartE2EDuration="2.191391051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:10:21.190003111 +0000 UTC m=+2879.696894824" watchObservedRunningTime="2026-08-05 17:10:21.191391051 +0000 UTC m=+2879.698282767"
Aug 05 17:10:22.143338 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:22.143308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:22.148877 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:22.148850    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:22.153256 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:22.153234    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:22.154038 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:22.154020    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:37.155159 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.155126    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Aug 05 17:10:37.155563 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.155180    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Aug 05 17:10:37.251390 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.251355    2576 generic.go:356] "Generic (PLEG): container finished" podID="02705d2b-9f23-4716-a134-ab41a56b3760" containerID="71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe" exitCode=0
Aug 05 17:10:37.251556 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.251427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" event={"ID":"02705d2b-9f23-4716-a134-ab41a56b3760","Type":"ContainerDied","Data":"71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe"}
Aug 05 17:10:37.251823 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.251805    2576 scope.go:117] "RemoveContainer" containerID="71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe"
Aug 05 17:10:37.252805 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.252778    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:37.252897 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.252845    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:37.252897 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:37.252877    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:38.258861 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:38.258826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" event={"ID":"02705d2b-9f23-4716-a134-ab41a56b3760","Type":"ContainerStarted","Data":"769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737"}
Aug 05 17:10:39.143067 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:39.143030    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:39.143308 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:39.143287    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Aug 05 17:10:39.143358 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:39.143336    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Aug 05 17:10:40.142994 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:40.142944    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Aug 05 17:10:40.143485 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:40.143046    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Aug 05 17:10:41.142578 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:41.142539    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Aug 05 17:10:41.142764 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:41.142595    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Aug 05 17:10:42.142779 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:42.142733    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Aug 05 17:10:42.143231 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:42.142800    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Aug 05 17:10:43.143480 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:43.143436    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Aug 05 17:10:43.143888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:43.143498    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Aug 05 17:10:44.147300 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:44.147271    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:44.147670 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:44.147614    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:10:44.148320 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:10:44.148306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:12:22.214662 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:12:22.214634    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:12:22.225585 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:12:22.225563    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:14:22.488227 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:14:22.488191    2576 scope.go:117] "RemoveContainer" containerID="2575b48569246605703ab68ce78c092a62551b3becaa722713cf57151f016596"
Aug 05 17:15:00.137589 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.137557    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"]
Aug 05 17:15:00.138239 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.138219    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy"
Aug 05 17:15:00.138329 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.138241    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy"
Aug 05 17:15:00.138386 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.138364    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c98b261-9a96-484e-bb44-3b8405082a56" containerName="istio-proxy"
Aug 05 17:15:00.142107 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.142068    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"]
Aug 05 17:15:00.142259 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.142195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"
Aug 05 17:15:00.144623 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.144602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 17:15:00.146331 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.146311    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm"]
Aug 05 17:15:00.146466 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.146448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"
Aug 05 17:15:00.149824 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.149806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm"
Aug 05 17:15:00.155724 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.155704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"
Aug 05 17:15:00.159355 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.159287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"]
Aug 05 17:15:00.162476 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.162398    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"]
Aug 05 17:15:00.165782 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.165759    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm"]
Aug 05 17:15:00.166562 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.166396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"
Aug 05 17:15:00.214622 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.214343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm"
Aug 05 17:15:00.400026 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.399999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm"]
Aug 05 17:15:00.401073 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:15:00.401044    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762f50da_04b9_4318_ac64_8ed74de043a3.slice/crio-54b1cf1671bdb9c02d71c33c8e426ca6ebcbda55f430105b1c3df8e6010c97aa WatchSource:0}: Error finding container 54b1cf1671bdb9c02d71c33c8e426ca6ebcbda55f430105b1c3df8e6010c97aa: Status 404 returned error can't find the container with id 54b1cf1671bdb9c02d71c33c8e426ca6ebcbda55f430105b1c3df8e6010c97aa
Aug 05 17:15:00.545761 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.545734    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"]
Aug 05 17:15:00.546935 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:15:00.546903    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14999870_7558_4468_be44_6e0f41200d7c.slice/crio-8a99c62f7e63776c1b2ff838dfd7da36e6ba497c69f19f1f1ccefb78e997a9c8 WatchSource:0}: Error finding container 8a99c62f7e63776c1b2ff838dfd7da36e6ba497c69f19f1f1ccefb78e997a9c8: Status 404 returned error can't find the container with id 8a99c62f7e63776c1b2ff838dfd7da36e6ba497c69f19f1f1ccefb78e997a9c8
Aug 05 17:15:00.575477 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.575454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"]
Aug 05 17:15:00.585747 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:15:00.585721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7530a10_6781_4703_8ad5_d0f3f6bffe8f.slice/crio-4464544f48aedb33603dbb6f56b7af5dd4f9ba161a0151677efd9601f22e37a1 WatchSource:0}: Error finding container 4464544f48aedb33603dbb6f56b7af5dd4f9ba161a0151677efd9601f22e37a1: Status 404 returned error can't find the container with id 4464544f48aedb33603dbb6f56b7af5dd4f9ba161a0151677efd9601f22e37a1
Aug 05 17:15:00.691664 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.691634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp" event={"ID":"a7530a10-6781-4703-8ad5-d0f3f6bffe8f","Type":"ContainerStarted","Data":"4464544f48aedb33603dbb6f56b7af5dd4f9ba161a0151677efd9601f22e37a1"}
Aug 05 17:15:00.693471 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.693190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm" event={"ID":"762f50da-04b9-4318-ac64-8ed74de043a3","Type":"ContainerStarted","Data":"54b1cf1671bdb9c02d71c33c8e426ca6ebcbda55f430105b1c3df8e6010c97aa"}
Aug 05 17:15:00.694792 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:00.694760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv" event={"ID":"14999870-7558-4468-be44-6e0f41200d7c","Type":"ContainerStarted","Data":"8a99c62f7e63776c1b2ff838dfd7da36e6ba497c69f19f1f1ccefb78e997a9c8"}
Aug 05 17:15:01.703128 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:01.703097    2576 generic.go:356] "Generic (PLEG): container finished" podID="a7530a10-6781-4703-8ad5-d0f3f6bffe8f" containerID="ebbfff5ef7da1500e6a8019195ddfbe6f9db29d9a54841453f72f11778bd3e70" exitCode=0
Aug 05 17:15:01.703504 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:01.703184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp" event={"ID":"a7530a10-6781-4703-8ad5-d0f3f6bffe8f","Type":"ContainerDied","Data":"ebbfff5ef7da1500e6a8019195ddfbe6f9db29d9a54841453f72f11778bd3e70"}
Aug 05 17:15:01.704668 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:01.704646    2576 generic.go:356] "Generic (PLEG): container finished" podID="762f50da-04b9-4318-ac64-8ed74de043a3" containerID="5de27aa412f2dd67617c633be9a04b44e4892d40d5686e1e71b0b10573d86e68" exitCode=0
Aug 05 17:15:01.704758 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:01.704710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm" event={"ID":"762f50da-04b9-4318-ac64-8ed74de043a3","Type":"ContainerDied","Data":"5de27aa412f2dd67617c633be9a04b44e4892d40d5686e1e71b0b10573d86e68"}
Aug 05 17:15:01.706002 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:01.705957    2576 generic.go:356] "Generic (PLEG): container finished" podID="14999870-7558-4468-be44-6e0f41200d7c" containerID="0f650f85b8f71281c033b1a9b10d77e8c7322e9e5eb1e5c65e305e9ca79eef83" exitCode=0
Aug 05 17:15:01.706103 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:01.706013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv" event={"ID":"14999870-7558-4468-be44-6e0f41200d7c","Type":"ContainerDied","Data":"0f650f85b8f71281c033b1a9b10d77e8c7322e9e5eb1e5c65e305e9ca79eef83"}
Aug 05 17:15:02.866003 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:02.865958    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"
Aug 05 17:15:02.910243 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:02.910210    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm"
Aug 05 17:15:02.913528 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:02.913501    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"
Aug 05 17:15:03.718132 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.718102    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm"
Aug 05 17:15:03.718343 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.718102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-c58wm" event={"ID":"762f50da-04b9-4318-ac64-8ed74de043a3","Type":"ContainerDied","Data":"54b1cf1671bdb9c02d71c33c8e426ca6ebcbda55f430105b1c3df8e6010c97aa"}
Aug 05 17:15:03.718343 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.718234    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54b1cf1671bdb9c02d71c33c8e426ca6ebcbda55f430105b1c3df8e6010c97aa"
Aug 05 17:15:03.719403 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.719379    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"
Aug 05 17:15:03.719506 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.719421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv" event={"ID":"14999870-7558-4468-be44-6e0f41200d7c","Type":"ContainerDied","Data":"8a99c62f7e63776c1b2ff838dfd7da36e6ba497c69f19f1f1ccefb78e997a9c8"}
Aug 05 17:15:03.719506 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.719461    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a99c62f7e63776c1b2ff838dfd7da36e6ba497c69f19f1f1ccefb78e997a9c8"
Aug 05 17:15:03.720820 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.720797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp" event={"ID":"a7530a10-6781-4703-8ad5-d0f3f6bffe8f","Type":"ContainerDied","Data":"4464544f48aedb33603dbb6f56b7af5dd4f9ba161a0151677efd9601f22e37a1"}
Aug 05 17:15:03.720906 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.720843    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4464544f48aedb33603dbb6f56b7af5dd4f9ba161a0151677efd9601f22e37a1"
Aug 05 17:15:03.720906 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:15:03.720809    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"
Aug 05 17:17:22.249386 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:17:22.249354    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:17:22.261878 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:17:22.261856    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:19:25.317428 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317343    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:25.317875 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317823    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14999870-7558-4468-be44-6e0f41200d7c" containerName="cleanup"
Aug 05 17:19:25.317875 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317836    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14999870-7558-4468-be44-6e0f41200d7c" containerName="cleanup"
Aug 05 17:19:25.317875 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317845    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="762f50da-04b9-4318-ac64-8ed74de043a3" containerName="cleanup"
Aug 05 17:19:25.317875 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317851    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="762f50da-04b9-4318-ac64-8ed74de043a3" containerName="cleanup"
Aug 05 17:19:25.317875 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317858    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7530a10-6781-4703-8ad5-d0f3f6bffe8f" containerName="cleanup"
Aug 05 17:19:25.317875 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317863    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7530a10-6781-4703-8ad5-d0f3f6bffe8f" containerName="cleanup"
Aug 05 17:19:25.318091 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317938    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="762f50da-04b9-4318-ac64-8ed74de043a3" containerName="cleanup"
Aug 05 17:19:25.318091 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317945    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="14999870-7558-4468-be44-6e0f41200d7c" containerName="cleanup"
Aug 05 17:19:25.318091 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.317955    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7530a10-6781-4703-8ad5-d0f3f6bffe8f" containerName="cleanup"
Aug 05 17:19:25.321233 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.321215    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:25.323944 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.323917    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7c4nd\""
Aug 05 17:19:25.325908 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.325879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:25.422637 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.422601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2gv\" (UniqueName: \"kubernetes.io/projected/33fb0f11-36dd-4108-9520-12319c824674-kube-api-access-cj2gv\") pod \"test-curl-7748-140073044127008\" (UID: \"33fb0f11-36dd-4108-9520-12319c824674\") " pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:25.523786 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.523751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2gv\" (UniqueName: \"kubernetes.io/projected/33fb0f11-36dd-4108-9520-12319c824674-kube-api-access-cj2gv\") pod \"test-curl-7748-140073044127008\" (UID: \"33fb0f11-36dd-4108-9520-12319c824674\") " pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:25.533326 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.533294    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2gv\" (UniqueName: \"kubernetes.io/projected/33fb0f11-36dd-4108-9520-12319c824674-kube-api-access-cj2gv\") pod \"test-curl-7748-140073044127008\" (UID: \"33fb0f11-36dd-4108-9520-12319c824674\") " pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:25.632584 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.632560    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:25.772874 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.772847    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:25.774501 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:19:25.774474    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33fb0f11_36dd_4108_9520_12319c824674.slice/crio-9e0485fda6c019d50aab6dde8b66dfa2edc4def1ba5f4b451f669f627493b3a1 WatchSource:0}: Error finding container 9e0485fda6c019d50aab6dde8b66dfa2edc4def1ba5f4b451f669f627493b3a1: Status 404 returned error can't find the container with id 9e0485fda6c019d50aab6dde8b66dfa2edc4def1ba5f4b451f669f627493b3a1
Aug 05 17:19:25.775797 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:25.775780    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:19:26.195464 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:26.195426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140073044127008" event={"ID":"33fb0f11-36dd-4108-9520-12319c824674","Type":"ContainerStarted","Data":"9e0485fda6c019d50aab6dde8b66dfa2edc4def1ba5f4b451f669f627493b3a1"}
Aug 05 17:19:27.201955 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:27.201919    2576 generic.go:356] "Generic (PLEG): container finished" podID="33fb0f11-36dd-4108-9520-12319c824674" containerID="a5e29c05af2acfa2aa2913808811e95c32ec5185672787bf52f9080bd1aecb56" exitCode=0
Aug 05 17:19:27.202381 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:27.202011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140073044127008" event={"ID":"33fb0f11-36dd-4108-9520-12319c824674","Type":"ContainerDied","Data":"a5e29c05af2acfa2aa2913808811e95c32ec5185672787bf52f9080bd1aecb56"}
Aug 05 17:19:28.346303 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.346275    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:28.383519 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.383490    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140073044127008_33fb0f11-36dd-4108-9520-12319c824674/test-curl-7748-140073044127008/0.log"
Aug 05 17:19:28.410296 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.410266    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:28.414429 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.414403    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:28.455212 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.455182    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj2gv\" (UniqueName: \"kubernetes.io/projected/33fb0f11-36dd-4108-9520-12319c824674-kube-api-access-cj2gv\") pod \"33fb0f11-36dd-4108-9520-12319c824674\" (UID: \"33fb0f11-36dd-4108-9520-12319c824674\") "
Aug 05 17:19:28.457275 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.457250    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33fb0f11-36dd-4108-9520-12319c824674-kube-api-access-cj2gv" (OuterVolumeSpecName: "kube-api-access-cj2gv") pod "33fb0f11-36dd-4108-9520-12319c824674" (UID: "33fb0f11-36dd-4108-9520-12319c824674"). InnerVolumeSpecName "kube-api-access-cj2gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:19:28.556665 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.556629    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj2gv\" (UniqueName: \"kubernetes.io/projected/33fb0f11-36dd-4108-9520-12319c824674-kube-api-access-cj2gv\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:19:28.559874 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.559844    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:28.560308 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.560295    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fb0f11-36dd-4108-9520-12319c824674" containerName="test-curl-7748-140073044127008"
Aug 05 17:19:28.560356 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.560310    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fb0f11-36dd-4108-9520-12319c824674" containerName="test-curl-7748-140073044127008"
Aug 05 17:19:28.560408 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.560399    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="33fb0f11-36dd-4108-9520-12319c824674" containerName="test-curl-7748-140073044127008"
Aug 05 17:19:28.563488 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.563473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:28.568584 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.568560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:28.657647 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.657611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlrbx\" (UniqueName: \"kubernetes.io/projected/9725c4ee-69d0-4c5d-8f86-4aede965cd7f-kube-api-access-xlrbx\") pod \"test-curl-7748-140073044127008\" (UID: \"9725c4ee-69d0-4c5d-8f86-4aede965cd7f\") " pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:28.758866 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.758783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlrbx\" (UniqueName: \"kubernetes.io/projected/9725c4ee-69d0-4c5d-8f86-4aede965cd7f-kube-api-access-xlrbx\") pod \"test-curl-7748-140073044127008\" (UID: \"9725c4ee-69d0-4c5d-8f86-4aede965cd7f\") " pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:28.767384 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.767360    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlrbx\" (UniqueName: \"kubernetes.io/projected/9725c4ee-69d0-4c5d-8f86-4aede965cd7f-kube-api-access-xlrbx\") pod \"test-curl-7748-140073044127008\" (UID: \"9725c4ee-69d0-4c5d-8f86-4aede965cd7f\") " pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:28.874851 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:28.874817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:29.012142 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:29.012111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:29.013724 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:19:29.013689    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9725c4ee_69d0_4c5d_8f86_4aede965cd7f.slice/crio-5a4b735dec16018f7cd1eeb2eb5bf87b5b9e47353a7446bac433f4bcf30b6c0c WatchSource:0}: Error finding container 5a4b735dec16018f7cd1eeb2eb5bf87b5b9e47353a7446bac433f4bcf30b6c0c: Status 404 returned error can't find the container with id 5a4b735dec16018f7cd1eeb2eb5bf87b5b9e47353a7446bac433f4bcf30b6c0c
Aug 05 17:19:29.214001 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:29.213935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140073044127008" event={"ID":"9725c4ee-69d0-4c5d-8f86-4aede965cd7f","Type":"ContainerStarted","Data":"5a4b735dec16018f7cd1eeb2eb5bf87b5b9e47353a7446bac433f4bcf30b6c0c"}
Aug 05 17:19:29.215122 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:29.215103    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e0485fda6c019d50aab6dde8b66dfa2edc4def1ba5f4b451f669f627493b3a1"
Aug 05 17:19:29.215122 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:29.215113    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:29.226898 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:29.226865    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7748-140073044127008" oldPodUID="33fb0f11-36dd-4108-9520-12319c824674" podUID="9725c4ee-69d0-4c5d-8f86-4aede965cd7f"
Aug 05 17:19:29.994135 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:29.992194    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33fb0f11-36dd-4108-9520-12319c824674" path="/var/lib/kubelet/pods/33fb0f11-36dd-4108-9520-12319c824674/volumes"
Aug 05 17:19:30.221592 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:30.221556    2576 generic.go:356] "Generic (PLEG): container finished" podID="9725c4ee-69d0-4c5d-8f86-4aede965cd7f" containerID="18a8ea0d8b2a05c222007681fbb162b9179ced9068978d53d2f82730c0a8fc74" exitCode=0
Aug 05 17:19:30.221768 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:30.221639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140073044127008" event={"ID":"9725c4ee-69d0-4c5d-8f86-4aede965cd7f","Type":"ContainerDied","Data":"18a8ea0d8b2a05c222007681fbb162b9179ced9068978d53d2f82730c0a8fc74"}
Aug 05 17:19:31.366729 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.366703    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:31.391517 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.391485    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140073044127008_9725c4ee-69d0-4c5d-8f86-4aede965cd7f/test-curl-7748-140073044127008/0.log"
Aug 05 17:19:31.422975 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.422941    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:31.427028 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.427003    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140073044127008"]
Aug 05 17:19:31.487630 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.487544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlrbx\" (UniqueName: \"kubernetes.io/projected/9725c4ee-69d0-4c5d-8f86-4aede965cd7f-kube-api-access-xlrbx\") pod \"9725c4ee-69d0-4c5d-8f86-4aede965cd7f\" (UID: \"9725c4ee-69d0-4c5d-8f86-4aede965cd7f\") "
Aug 05 17:19:31.489540 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.489513    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9725c4ee-69d0-4c5d-8f86-4aede965cd7f-kube-api-access-xlrbx" (OuterVolumeSpecName: "kube-api-access-xlrbx") pod "9725c4ee-69d0-4c5d-8f86-4aede965cd7f" (UID: "9725c4ee-69d0-4c5d-8f86-4aede965cd7f"). InnerVolumeSpecName "kube-api-access-xlrbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:19:31.565486 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.565451    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7748-140073044054352"]
Aug 05 17:19:31.565874 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.565861    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9725c4ee-69d0-4c5d-8f86-4aede965cd7f" containerName="test-curl-7748-140073044127008"
Aug 05 17:19:31.565915 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.565875    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9725c4ee-69d0-4c5d-8f86-4aede965cd7f" containerName="test-curl-7748-140073044127008"
Aug 05 17:19:31.565971 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.565962    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9725c4ee-69d0-4c5d-8f86-4aede965cd7f" containerName="test-curl-7748-140073044127008"
Aug 05 17:19:31.569095 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.569078    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:31.580815 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.580786    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140073044054352"]
Aug 05 17:19:31.589466 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.589439    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlrbx\" (UniqueName: \"kubernetes.io/projected/9725c4ee-69d0-4c5d-8f86-4aede965cd7f-kube-api-access-xlrbx\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:19:31.690091 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.690035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqsc\" (UniqueName: \"kubernetes.io/projected/5eb68756-deb2-4203-8e08-2c58f288b225-kube-api-access-zkqsc\") pod \"test-curl-7748-140073044054352\" (UID: \"5eb68756-deb2-4203-8e08-2c58f288b225\") " pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:31.791069 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.790967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqsc\" (UniqueName: \"kubernetes.io/projected/5eb68756-deb2-4203-8e08-2c58f288b225-kube-api-access-zkqsc\") pod \"test-curl-7748-140073044054352\" (UID: \"5eb68756-deb2-4203-8e08-2c58f288b225\") " pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:31.801798 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.801768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqsc\" (UniqueName: \"kubernetes.io/projected/5eb68756-deb2-4203-8e08-2c58f288b225-kube-api-access-zkqsc\") pod \"test-curl-7748-140073044054352\" (UID: \"5eb68756-deb2-4203-8e08-2c58f288b225\") " pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:31.880243 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.880206    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:31.994124 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:31.994085    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9725c4ee-69d0-4c5d-8f86-4aede965cd7f" path="/var/lib/kubelet/pods/9725c4ee-69d0-4c5d-8f86-4aede965cd7f/volumes"
Aug 05 17:19:32.020219 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:32.020194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7748-140073044054352"]
Aug 05 17:19:32.022112 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:19:32.022085    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5eb68756_deb2_4203_8e08_2c58f288b225.slice/crio-9b8bf9d7674ecb5f8be3104099e126887efa2374bc0ea44b3e6fc8fb0d23429c WatchSource:0}: Error finding container 9b8bf9d7674ecb5f8be3104099e126887efa2374bc0ea44b3e6fc8fb0d23429c: Status 404 returned error can't find the container with id 9b8bf9d7674ecb5f8be3104099e126887efa2374bc0ea44b3e6fc8fb0d23429c
Aug 05 17:19:32.234044 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:32.234021    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044127008"
Aug 05 17:19:32.234218 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:32.234024    2576 scope.go:117] "RemoveContainer" containerID="18a8ea0d8b2a05c222007681fbb162b9179ced9068978d53d2f82730c0a8fc74"
Aug 05 17:19:32.235545 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:32.235517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140073044054352" event={"ID":"5eb68756-deb2-4203-8e08-2c58f288b225","Type":"ContainerStarted","Data":"9b8bf9d7674ecb5f8be3104099e126887efa2374bc0ea44b3e6fc8fb0d23429c"}
Aug 05 17:19:33.243517 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:33.243481    2576 generic.go:356] "Generic (PLEG): container finished" podID="5eb68756-deb2-4203-8e08-2c58f288b225" containerID="84f7664d953ac7104052a4f5aac8c5f38b217b3d35e8981c55f01f4848289431" exitCode=0
Aug 05 17:19:33.244004 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:33.243564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7748-140073044054352" event={"ID":"5eb68756-deb2-4203-8e08-2c58f288b225","Type":"ContainerDied","Data":"84f7664d953ac7104052a4f5aac8c5f38b217b3d35e8981c55f01f4848289431"}
Aug 05 17:19:34.392298 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:34.392273    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:34.411771 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:34.411747    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7748-140073044054352_5eb68756-deb2-4203-8e08-2c58f288b225/test-curl-7748-140073044054352/0.log"
Aug 05 17:19:34.436266 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:34.436178    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7748-140073044054352"]
Aug 05 17:19:34.438793 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:34.438764    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7748-140073044054352"]
Aug 05 17:19:34.520113 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:34.520039    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkqsc\" (UniqueName: \"kubernetes.io/projected/5eb68756-deb2-4203-8e08-2c58f288b225-kube-api-access-zkqsc\") pod \"5eb68756-deb2-4203-8e08-2c58f288b225\" (UID: \"5eb68756-deb2-4203-8e08-2c58f288b225\") "
Aug 05 17:19:34.522221 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:34.522194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb68756-deb2-4203-8e08-2c58f288b225-kube-api-access-zkqsc" (OuterVolumeSpecName: "kube-api-access-zkqsc") pod "5eb68756-deb2-4203-8e08-2c58f288b225" (UID: "5eb68756-deb2-4203-8e08-2c58f288b225"). InnerVolumeSpecName "kube-api-access-zkqsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:19:34.621741 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:34.621698    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkqsc\" (UniqueName: \"kubernetes.io/projected/5eb68756-deb2-4203-8e08-2c58f288b225-kube-api-access-zkqsc\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:19:35.264501 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:35.264473    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:35.264674 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:35.264503    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b8bf9d7674ecb5f8be3104099e126887efa2374bc0ea44b3e6fc8fb0d23429c"
Aug 05 17:19:35.275088 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:19:35.275060    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7748-140073044054352\" is forbidden: User \"system:node:ip-10-0-128-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-82.ec2.internal' and this object" podUID="5eb68756-deb2-4203-8e08-2c58f288b225" pod="opendatahub/test-curl-7748-140073044054352"
Aug 05 17:19:35.990855 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:35.990821    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb68756-deb2-4203-8e08-2c58f288b225" path="/var/lib/kubelet/pods/5eb68756-deb2-4203-8e08-2c58f288b225/volumes"
Aug 05 17:19:38.110700 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.110668    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"]
Aug 05 17:19:38.111150 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.111136    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb68756-deb2-4203-8e08-2c58f288b225" containerName="test-curl-7748-140073044054352"
Aug 05 17:19:38.111207 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.111152    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb68756-deb2-4203-8e08-2c58f288b225" containerName="test-curl-7748-140073044054352"
Aug 05 17:19:38.111243 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.111220    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb68756-deb2-4203-8e08-2c58f288b225" containerName="test-curl-7748-140073044054352"
Aug 05 17:19:38.114530 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.114512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.116930 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.116907    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-0b8087-openshift-default-dockercfg-hwnmc\""
Aug 05 17:19:38.128666 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.128642    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"]
Aug 05 17:19:38.258833 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.258797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-data\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259048 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.258842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-istio-token\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259048 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.258946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-certs\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259048 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.259028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfv2w\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-kube-api-access-vfv2w\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259185 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.259070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a39d4a75-1648-4667-b5fb-c88183d11325-istiod-ca-cert\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259185 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.259088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a39d4a75-1648-4667-b5fb-c88183d11325-istio-podinfo\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259185 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.259115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-credential-socket\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259185 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.259141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-socket\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.259185 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.259182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-envoy\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360655 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-istio-token\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360891 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-certs\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360891 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfv2w\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-kube-api-access-vfv2w\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360891 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a39d4a75-1648-4667-b5fb-c88183d11325-istiod-ca-cert\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360891 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a39d4a75-1648-4667-b5fb-c88183d11325-istio-podinfo\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360891 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-credential-socket\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360891 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-socket\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.360891 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-envoy\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.361297 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.360927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-data\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.361297 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.361246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-credential-socket\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.361407 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.361293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-certs\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.361407 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.361359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-socket\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.361513 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.361464    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-data\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.361569 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.361547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a39d4a75-1648-4667-b5fb-c88183d11325-istiod-ca-cert\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.363354 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.363332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-envoy\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.363510 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.363491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a39d4a75-1648-4667-b5fb-c88183d11325-istio-podinfo\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.368497 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.368476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-istio-token\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.368588 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.368539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfv2w\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-kube-api-access-vfv2w\") pod \"e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") " pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.425147 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.425112    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:38.573548 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.573518    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"]
Aug 05 17:19:38.575045 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:19:38.575014    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39d4a75_1648_4667_b5fb_c88183d11325.slice/crio-94f736e181c693cb39b6702f67f4e0eab276489d68bf8d5d9eb91c2148473577 WatchSource:0}: Error finding container 94f736e181c693cb39b6702f67f4e0eab276489d68bf8d5d9eb91c2148473577: Status 404 returned error can't find the container with id 94f736e181c693cb39b6702f67f4e0eab276489d68bf8d5d9eb91c2148473577
Aug 05 17:19:38.577295 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.577264    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:38.577378 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.577333    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:38.577378 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:38.577361    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:39.288706 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:39.288671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" event={"ID":"a39d4a75-1648-4667-b5fb-c88183d11325","Type":"ContainerStarted","Data":"db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e"}
Aug 05 17:19:39.289166 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:39.288739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" event={"ID":"a39d4a75-1648-4667-b5fb-c88183d11325","Type":"ContainerStarted","Data":"94f736e181c693cb39b6702f67f4e0eab276489d68bf8d5d9eb91c2148473577"}
Aug 05 17:19:39.324341 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:39.324286    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podStartSLOduration=1.32426887 podStartE2EDuration="1.32426887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:39.321464688 +0000 UTC m=+3437.828356399" watchObservedRunningTime="2026-08-05 17:19:39.32426887 +0000 UTC m=+3437.831160582"
Aug 05 17:19:39.425358 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:39.425318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:39.430559 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:39.430535    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:40.299130 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:40.299100    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:40.300188 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:40.300163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:55.300208 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.300176    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Aug 05 17:19:55.300661 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.300235    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Aug 05 17:19:55.388589 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.388555    2576 generic.go:356] "Generic (PLEG): container finished" podID="a39d4a75-1648-4667-b5fb-c88183d11325" containerID="db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e" exitCode=0
Aug 05 17:19:55.388782 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.388635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" event={"ID":"a39d4a75-1648-4667-b5fb-c88183d11325","Type":"ContainerDied","Data":"db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e"}
Aug 05 17:19:55.389163 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.389145    2576 scope.go:117] "RemoveContainer" containerID="db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e"
Aug 05 17:19:55.390242 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.390193    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:55.390299 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.390256    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:55.390336 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:55.390309    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:56.400704 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:56.400659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" event={"ID":"a39d4a75-1648-4667-b5fb-c88183d11325","Type":"ContainerStarted","Data":"488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734"}
Aug 05 17:19:56.425851 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:56.425817    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:19:56.426076 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:56.426055    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Aug 05 17:19:56.426130 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:56.426102    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Aug 05 17:19:57.425464 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:57.425433    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Aug 05 17:19:57.425853 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:57.425483    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Aug 05 17:19:58.426339 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:58.426306    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Aug 05 17:19:58.426717 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:58.426370    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Aug 05 17:19:59.425685 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:59.425651    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Aug 05 17:19:59.425865 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:19:59.425704    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Aug 05 17:20:00.425410 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:00.425377    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Aug 05 17:20:00.425875 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:00.425437    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Aug 05 17:20:01.426342 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:01.426295    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Aug 05 17:20:01.426829 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:01.426360    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Aug 05 17:20:02.429619 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:02.429588    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:20:02.430097 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:02.429972    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:20:02.430578 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:02.430561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:20:42.074498 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:20:42.074466    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-zhmcq_8081823a-db7a-48e3-bfd2-1e2889d2c9c2/payload-processing/0.log"
Aug 05 17:21:32.186427 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:32.186401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-zhmcq_8081823a-db7a-48e3-bfd2-1e2889d2c9c2/payload-processing/0.log"
Aug 05 17:21:32.938671 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:32.938635    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"]
Aug 05 17:21:32.942508 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:32.942486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:32.946450 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:32.946432    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-32fc6e-openshift-default-dockercfg-m4x47\""
Aug 05 17:21:32.969572 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:32.969544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"]
Aug 05 17:21:33.100760 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.100719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-token\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.100968 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.100792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzkc\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-kube-api-access-2hzkc\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.100968 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.100837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-envoy\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.100968 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.100855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-socket\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.100968 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.100914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-data\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.100968 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.100941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istiod-ca-cert\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.100968 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.100960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-credential-socket\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.101350 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.101034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-podinfo\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.101350 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.101073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-certs\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202076 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.201965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-podinfo\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202076 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-certs\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-token\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzkc\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-kube-api-access-2hzkc\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-envoy\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-socket\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-data\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istiod-ca-cert\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-credential-socket\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.202600 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202525    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-data\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.203066 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-certs\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.203066 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202696    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-socket\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.203066 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.202807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-credential-socket\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.203066 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.203043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istiod-ca-cert\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.204410 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.204385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-envoy\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.204744 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.204720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-podinfo\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.211923 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.211900    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzkc\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-kube-api-access-2hzkc\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.213033 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.213013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-token\") pod \"e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") " pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.253181 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.253153    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:33.608783 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.608751    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"]
Aug 05 17:21:33.609570 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:21:33.609545    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7ea2e6_9e88_4df9_816a_fce6aae57464.slice/crio-1d197e8889164ed9f1276adc2b5f7382b7ffadc94375f8428f58ed60edaa4ce0 WatchSource:0}: Error finding container 1d197e8889164ed9f1276adc2b5f7382b7ffadc94375f8428f58ed60edaa4ce0: Status 404 returned error can't find the container with id 1d197e8889164ed9f1276adc2b5f7382b7ffadc94375f8428f58ed60edaa4ce0
Aug 05 17:21:33.611776 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.611746    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:33.611883 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.611812    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:33.611883 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.611843    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:33.971577 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.971531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" event={"ID":"0a7ea2e6-9e88-4df9-816a-fce6aae57464","Type":"ContainerStarted","Data":"cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea"}
Aug 05 17:21:33.971785 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.971603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" event={"ID":"0a7ea2e6-9e88-4df9-816a-fce6aae57464","Type":"ContainerStarted","Data":"1d197e8889164ed9f1276adc2b5f7382b7ffadc94375f8428f58ed60edaa4ce0"}
Aug 05 17:21:33.997478 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:33.997426    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podStartSLOduration=1.99740829 podStartE2EDuration="1.99740829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:21:33.994266955 +0000 UTC m=+3552.501158666" watchObservedRunningTime="2026-08-05 17:21:33.99740829 +0000 UTC m=+3552.504300001"
Aug 05 17:21:34.253898 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:34.253817    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:34.258947 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:34.258921    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:34.977296 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:34.977268    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:34.978363 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:34.978342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:51.019186 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:51.019142    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 05 17:21:51.019672 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:51.019206    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 05 17:21:53.085685 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:53.085647    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerID="cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea" exitCode=0
Aug 05 17:21:53.086229 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:53.085705    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" event={"ID":"0a7ea2e6-9e88-4df9-816a-fce6aae57464","Type":"ContainerDied","Data":"cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea"}
Aug 05 17:21:53.086229 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:53.086208    2576 scope.go:117] "RemoveContainer" containerID="cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea"
Aug 05 17:21:53.087518 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:53.087489    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:53.087601 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:53.087556    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:53.087601 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:53.087589    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:54.116159 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:54.116128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" event={"ID":"0a7ea2e6-9e88-4df9-816a-fce6aae57464","Type":"ContainerStarted","Data":"dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3"}
Aug 05 17:21:54.254402 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:54.254369    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:54.254584 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:54.254561    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Aug 05 17:21:54.254629 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:54.254605    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Aug 05 17:21:55.254180 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:55.254132    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Aug 05 17:21:55.254569 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:55.254214    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Aug 05 17:21:56.253733 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:56.253693    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Aug 05 17:21:56.253887 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:56.253760    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Aug 05 17:21:57.253638 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:57.253602    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Aug 05 17:21:57.254044 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:57.253666    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Aug 05 17:21:58.253942 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:58.253899    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Aug 05 17:21:58.254433 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:58.253968    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Aug 05 17:21:59.257732 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:59.257697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:59.258225 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:59.258205    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:21:59.258740 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:21:59.258724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:22:01.590926 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.590892    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"]
Aug 05 17:22:01.594715 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.594696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"
Aug 05 17:22:01.596969 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.596949    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 17:22:01.604017 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.603967    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"]
Aug 05 17:22:01.686854 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.686821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ce51c-768f-43bb-b8aa-745ad7d9f22d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs\" (UID: \"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"
Aug 05 17:22:01.788562 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.788529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ce51c-768f-43bb-b8aa-745ad7d9f22d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs\" (UID: \"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"
Aug 05 17:22:01.789267 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.789239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ce51c-768f-43bb-b8aa-745ad7d9f22d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs\" (UID: \"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"
Aug 05 17:22:01.907225 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:01.907193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"
Aug 05 17:22:02.256887 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:02.256857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"]
Aug 05 17:22:02.258086 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:22:02.258055    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9ce51c_768f_43bb_b8aa_745ad7d9f22d.slice/crio-3b0f06f99966abbcd16e1ac150f617895b0b50ad4af27e1f5163b6e30f53de42 WatchSource:0}: Error finding container 3b0f06f99966abbcd16e1ac150f617895b0b50ad4af27e1f5163b6e30f53de42: Status 404 returned error can't find the container with id 3b0f06f99966abbcd16e1ac150f617895b0b50ad4af27e1f5163b6e30f53de42
Aug 05 17:22:03.170506 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:03.170468    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec9ce51c-768f-43bb-b8aa-745ad7d9f22d" containerID="33e8a9b17f8641d88e7d694c047ec0b6cae8527cda5e28672368e81bcd31e2ff" exitCode=0
Aug 05 17:22:03.170953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:03.170565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs" event={"ID":"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d","Type":"ContainerDied","Data":"33e8a9b17f8641d88e7d694c047ec0b6cae8527cda5e28672368e81bcd31e2ff"}
Aug 05 17:22:03.170953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:03.170672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs" event={"ID":"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d","Type":"ContainerStarted","Data":"3b0f06f99966abbcd16e1ac150f617895b0b50ad4af27e1f5163b6e30f53de42"}
Aug 05 17:22:04.316453 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:04.316426    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"
Aug 05 17:22:04.414009 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:04.413956    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ce51c-768f-43bb-b8aa-745ad7d9f22d-maas-api-service-ca\") pod \"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d\" (UID: \"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d\") "
Aug 05 17:22:04.414321 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:04.414297    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec9ce51c-768f-43bb-b8aa-745ad7d9f22d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec9ce51c-768f-43bb-b8aa-745ad7d9f22d" (UID: "ec9ce51c-768f-43bb-b8aa-745ad7d9f22d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:22:04.514973 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:04.514884    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9ce51c-768f-43bb-b8aa-745ad7d9f22d-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:05.183292 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:05.183263    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"
Aug 05 17:22:05.183497 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:05.183262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs" event={"ID":"ec9ce51c-768f-43bb-b8aa-745ad7d9f22d","Type":"ContainerDied","Data":"3b0f06f99966abbcd16e1ac150f617895b0b50ad4af27e1f5163b6e30f53de42"}
Aug 05 17:22:05.183497 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:05.183392    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b0f06f99966abbcd16e1ac150f617895b0b50ad4af27e1f5163b6e30f53de42"
Aug 05 17:22:07.811485 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:07.811448    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"]
Aug 05 17:22:07.813735 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:07.813706    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-32fc6e-22bfs"]
Aug 05 17:22:07.995006 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:07.994960    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9ce51c-768f-43bb-b8aa-745ad7d9f22d" path="/var/lib/kubelet/pods/ec9ce51c-768f-43bb-b8aa-745ad7d9f22d/volumes"
Aug 05 17:22:14.355655 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:14.355573    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"]
Aug 05 17:22:14.356144 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:14.355821    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy" containerID="cri-o://dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3" gracePeriod=30
Aug 05 17:22:19.623042 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.622947    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:22:19.770711 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.770676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istiod-ca-cert\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.770711 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.770714    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-data\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.770965 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.770766    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-token\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.770965 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.770799    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hzkc\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-kube-api-access-2hzkc\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.770965 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.770919    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-envoy\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.771184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-podinfo\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.771184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771104    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:19.771184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771108    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-credential-socket\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.771343 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771165    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:22:19.771343 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771309    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:19.771343 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771327    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-socket\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.771503 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771360    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-certs\") pod \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\" (UID: \"0a7ea2e6-9e88-4df9-816a-fce6aae57464\") "
Aug 05 17:22:19.771618 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771565    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:19.771688 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771665    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:19.771804 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771785    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.771878 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771804    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.771878 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771814    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.771878 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771823    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.771878 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.771831    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.773205 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.773178    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:22:19.773335 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.773243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:19.773399 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.773378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-kube-api-access-2hzkc" (OuterVolumeSpecName: "kube-api-access-2hzkc") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "kube-api-access-2hzkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:22:19.773457 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.773394    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a7ea2e6-9e88-4df9-816a-fce6aae57464" (UID: "0a7ea2e6-9e88-4df9-816a-fce6aae57464"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:22:19.873249 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.873169    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.873249 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.873200    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hzkc\" (UniqueName: \"kubernetes.io/projected/0a7ea2e6-9e88-4df9-816a-fce6aae57464-kube-api-access-2hzkc\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.873249 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.873210    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:19.873249 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:19.873221    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a7ea2e6-9e88-4df9-816a-fce6aae57464-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:22:20.283933 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.283896    2576 generic.go:356] "Generic (PLEG): container finished" podID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerID="dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3" exitCode=0
Aug 05 17:22:20.284349 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.284033    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"
Aug 05 17:22:20.284349 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.284052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" event={"ID":"0a7ea2e6-9e88-4df9-816a-fce6aae57464","Type":"ContainerDied","Data":"dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3"}
Aug 05 17:22:20.284349 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.284152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl" event={"ID":"0a7ea2e6-9e88-4df9-816a-fce6aae57464","Type":"ContainerDied","Data":"1d197e8889164ed9f1276adc2b5f7382b7ffadc94375f8428f58ed60edaa4ce0"}
Aug 05 17:22:20.284349 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.284180    2576 scope.go:117] "RemoveContainer" containerID="dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3"
Aug 05 17:22:20.294341 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.294320    2576 scope.go:117] "RemoveContainer" containerID="cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea"
Aug 05 17:22:20.301828 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.301806    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"]
Aug 05 17:22:20.305897 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.305872    2576 scope.go:117] "RemoveContainer" containerID="dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3"
Aug 05 17:22:20.306246 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:22:20.306224    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3\": container with ID starting with dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3 not found: ID does not exist" containerID="dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3"
Aug 05 17:22:20.306353 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.306253    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3"} err="failed to get container status \"dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3\": rpc error: code = NotFound desc = could not find container \"dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3\": container with ID starting with dd9f6d6937799b40fd11687d4d0d17068a1ac296e96bcf88fbc0f4b1629977e3 not found: ID does not exist"
Aug 05 17:22:20.306353 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.306278    2576 scope.go:117] "RemoveContainer" containerID="cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea"
Aug 05 17:22:20.306621 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:22:20.306595    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea\": container with ID starting with cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea not found: ID does not exist" containerID="cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea"
Aug 05 17:22:20.306701 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.306632    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea"} err="failed to get container status \"cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea\": rpc error: code = NotFound desc = could not find container \"cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea\": container with ID starting with cd6e5eeac9faa745b84c17a60a9cc47d825b7872dedc8a19d725fe615371edea not found: ID does not exist"
Aug 05 17:22:20.306780 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:20.306765    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-32fc6e-openshift-default-6968bdb754-z2tvl"]
Aug 05 17:22:21.992574 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:21.992530    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" path="/var/lib/kubelet/pods/0a7ea2e6-9e88-4df9-816a-fce6aae57464/volumes"
Aug 05 17:22:22.286400 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:22.286313    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:22:22.301488 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:22:22.301463    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:23:15.916328 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:15.916294    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"]
Aug 05 17:23:15.916813 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:15.916559    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" containerID="cri-o://488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734" gracePeriod=30
Aug 05 17:23:17.432721 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:17.432679    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:23:17.433111 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:17.432752    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:23:21.173451 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.173429    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:23:21.290042 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.289950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-certs\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290042 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290006    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-data\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290273 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290057    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a39d4a75-1648-4667-b5fb-c88183d11325-istio-podinfo\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290273 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290094    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-envoy\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290273 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfv2w\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-kube-api-access-vfv2w\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290273 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290164    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-istio-token\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290273 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290197    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-socket\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290273 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290219    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a39d4a75-1648-4667-b5fb-c88183d11325-istiod-ca-cert\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290273 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290234    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-credential-socket\") pod \"a39d4a75-1648-4667-b5fb-c88183d11325\" (UID: \"a39d4a75-1648-4667-b5fb-c88183d11325\") "
Aug 05 17:23:21.290602 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290249    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:21.290602 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-data" (OuterVolumeSpecName: "istio-data") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:21.290715 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290664    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.290715 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290683    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.290813 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290747    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:21.290813 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290780    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39d4a75-1648-4667-b5fb-c88183d11325-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:21.290813 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.290808    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:21.292705 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.292683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-istio-token" (OuterVolumeSpecName: "istio-token") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:21.292840 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.292817    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-kube-api-access-vfv2w" (OuterVolumeSpecName: "kube-api-access-vfv2w") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "kube-api-access-vfv2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:21.292893 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.292842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a39d4a75-1648-4667-b5fb-c88183d11325-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:23:21.292933 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.292900    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a39d4a75-1648-4667-b5fb-c88183d11325" (UID: "a39d4a75-1648-4667-b5fb-c88183d11325"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:21.391935 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.391901    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a39d4a75-1648-4667-b5fb-c88183d11325-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.391935 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.391929    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.391935 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.391939    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfv2w\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-kube-api-access-vfv2w\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.392184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.391949    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a39d4a75-1648-4667-b5fb-c88183d11325-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.392184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.391958    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.392184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.391965    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a39d4a75-1648-4667-b5fb-c88183d11325-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.392184 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.391974    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a39d4a75-1648-4667-b5fb-c88183d11325-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:21.647100 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.647071    2576 generic.go:356] "Generic (PLEG): container finished" podID="a39d4a75-1648-4667-b5fb-c88183d11325" containerID="488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734" exitCode=0
Aug 05 17:23:21.647283 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.647123    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"
Aug 05 17:23:21.647283 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.647165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" event={"ID":"a39d4a75-1648-4667-b5fb-c88183d11325","Type":"ContainerDied","Data":"488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734"}
Aug 05 17:23:21.647283 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.647221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj" event={"ID":"a39d4a75-1648-4667-b5fb-c88183d11325","Type":"ContainerDied","Data":"94f736e181c693cb39b6702f67f4e0eab276489d68bf8d5d9eb91c2148473577"}
Aug 05 17:23:21.647283 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.647243    2576 scope.go:117] "RemoveContainer" containerID="488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734"
Aug 05 17:23:21.656779 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.656763    2576 scope.go:117] "RemoveContainer" containerID="db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e"
Aug 05 17:23:21.664758 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.664743    2576 scope.go:117] "RemoveContainer" containerID="488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734"
Aug 05 17:23:21.665006 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:23:21.664972    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734\": container with ID starting with 488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734 not found: ID does not exist" containerID="488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734"
Aug 05 17:23:21.665050 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.665015    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734"} err="failed to get container status \"488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734\": rpc error: code = NotFound desc = could not find container \"488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734\": container with ID starting with 488f0ea30794060c6e394c6686ea4bd3a96f8d03460a7f2253edbd2919c7f734 not found: ID does not exist"
Aug 05 17:23:21.665050 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.665035    2576 scope.go:117] "RemoveContainer" containerID="db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e"
Aug 05 17:23:21.665243 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:23:21.665228    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e\": container with ID starting with db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e not found: ID does not exist" containerID="db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e"
Aug 05 17:23:21.665285 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.665247    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e"} err="failed to get container status \"db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e\": rpc error: code = NotFound desc = could not find container \"db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e\": container with ID starting with db490c6e3fc0729226416187aa09fa2241b8010070216818f36bb7eeb357f09e not found: ID does not exist"
Aug 05 17:23:21.671067 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.671047    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"]
Aug 05 17:23:21.675379 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.675360    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-0b8087-openshift-default-f969fc55b-h4zcj"]
Aug 05 17:23:21.990369 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:21.990296    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" path="/var/lib/kubelet/pods/a39d4a75-1648-4667-b5fb-c88183d11325/volumes"
Aug 05 17:23:34.047795 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.047759    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"]
Aug 05 17:23:34.048735 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.048713    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9ce51c-768f-43bb-b8aa-745ad7d9f22d" containerName="revoke-keys"
Aug 05 17:23:34.048735 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.048736    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9ce51c-768f-43bb-b8aa-745ad7d9f22d" containerName="revoke-keys"
Aug 05 17:23:34.048929 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.048762    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy"
Aug 05 17:23:34.048929 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.048770    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy"
Aug 05 17:23:34.048929 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.048803    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy"
Aug 05 17:23:34.048929 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.048813    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy"
Aug 05 17:23:34.049151 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.049090    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy"
Aug 05 17:23:34.049151 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.049108    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9ce51c-768f-43bb-b8aa-745ad7d9f22d" containerName="revoke-keys"
Aug 05 17:23:34.049151 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.049133    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy"
Aug 05 17:23:34.049151 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.049149    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy"
Aug 05 17:23:34.049351 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.049159    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy"
Aug 05 17:23:34.055530 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.055508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"
Aug 05 17:23:34.058627 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.058586    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-68wxh\""
Aug 05 17:23:34.060616 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.060589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"]
Aug 05 17:23:34.120028 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.119991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c327755-4054-45aa-8298-4b03f6c8e1d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-92434d-pldgh\" (UID: \"4c327755-4054-45aa-8298-4b03f6c8e1d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"
Aug 05 17:23:34.220658 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.220625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c327755-4054-45aa-8298-4b03f6c8e1d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-92434d-pldgh\" (UID: \"4c327755-4054-45aa-8298-4b03f6c8e1d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"
Aug 05 17:23:34.221288 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.221260    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c327755-4054-45aa-8298-4b03f6c8e1d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-92434d-pldgh\" (UID: \"4c327755-4054-45aa-8298-4b03f6c8e1d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"
Aug 05 17:23:34.368856 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.368778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"
Aug 05 17:23:34.732821 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:34.732798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"]
Aug 05 17:23:34.734824 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:23:34.734799    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c327755_4054_45aa_8298_4b03f6c8e1d1.slice/crio-2700d160b1650b69e1550566e98a3a65a740ce129bd1b2d15fd72b0f026b8302 WatchSource:0}: Error finding container 2700d160b1650b69e1550566e98a3a65a740ce129bd1b2d15fd72b0f026b8302: Status 404 returned error can't find the container with id 2700d160b1650b69e1550566e98a3a65a740ce129bd1b2d15fd72b0f026b8302
Aug 05 17:23:35.730452 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:35.730372    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c327755-4054-45aa-8298-4b03f6c8e1d1" containerID="ffa79c3b85b885566805f969aa7c08095c7433583ed7a5532760ca2829e09387" exitCode=0
Aug 05 17:23:35.730805 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:35.730464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh" event={"ID":"4c327755-4054-45aa-8298-4b03f6c8e1d1","Type":"ContainerDied","Data":"ffa79c3b85b885566805f969aa7c08095c7433583ed7a5532760ca2829e09387"}
Aug 05 17:23:35.730805 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:35.730522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh" event={"ID":"4c327755-4054-45aa-8298-4b03f6c8e1d1","Type":"ContainerStarted","Data":"2700d160b1650b69e1550566e98a3a65a740ce129bd1b2d15fd72b0f026b8302"}
Aug 05 17:23:36.875992 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:36.875953    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"
Aug 05 17:23:36.945644 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:36.945611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c327755-4054-45aa-8298-4b03f6c8e1d1-maas-api-service-ca\") pod \"4c327755-4054-45aa-8298-4b03f6c8e1d1\" (UID: \"4c327755-4054-45aa-8298-4b03f6c8e1d1\") "
Aug 05 17:23:36.945949 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:36.945927    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c327755-4054-45aa-8298-4b03f6c8e1d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c327755-4054-45aa-8298-4b03f6c8e1d1" (UID: "4c327755-4054-45aa-8298-4b03f6c8e1d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:37.046688 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:37.046601    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c327755-4054-45aa-8298-4b03f6c8e1d1-maas-api-service-ca\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:37.743325 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:37.743298    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"
Aug 05 17:23:37.743502 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:37.743292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh" event={"ID":"4c327755-4054-45aa-8298-4b03f6c8e1d1","Type":"ContainerDied","Data":"2700d160b1650b69e1550566e98a3a65a740ce129bd1b2d15fd72b0f026b8302"}
Aug 05 17:23:37.743502 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:37.743421    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2700d160b1650b69e1550566e98a3a65a740ce129bd1b2d15fd72b0f026b8302"
Aug 05 17:23:44.671191 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:44.671075    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"]
Aug 05 17:23:44.673652 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:44.673628    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-92434d-29765835-7fwmp"]
Aug 05 17:23:44.861289 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:44.861252    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"]
Aug 05 17:23:44.864357 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:44.864335    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-92434d-pldgh"]
Aug 05 17:23:45.991488 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:45.991455    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c327755-4054-45aa-8298-4b03f6c8e1d1" path="/var/lib/kubelet/pods/4c327755-4054-45aa-8298-4b03f6c8e1d1/volumes"
Aug 05 17:23:45.991852 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:45.991750    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7530a10-6781-4703-8ad5-d0f3f6bffe8f" path="/var/lib/kubelet/pods/a7530a10-6781-4703-8ad5-d0f3f6bffe8f/volumes"
Aug 05 17:23:51.563296 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:51.563265    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"]
Aug 05 17:23:51.563803 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:51.563459    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy" containerID="cri-o://39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55" gracePeriod=30
Aug 05 17:23:56.821445 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.821416    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:23:56.862921 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.862837    2576 generic.go:356] "Generic (PLEG): container finished" podID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerID="39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55" exitCode=0
Aug 05 17:23:56.862921 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.862881    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"
Aug 05 17:23:56.863147 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.862913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" event={"ID":"967e341f-69ba-4f90-9f52-db4ab8031eec","Type":"ContainerDied","Data":"39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55"}
Aug 05 17:23:56.863147 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.862973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj" event={"ID":"967e341f-69ba-4f90-9f52-db4ab8031eec","Type":"ContainerDied","Data":"82e2daee77e77be9199bfec5c14c783d43f3612718493ecfc13ad1b20215e6e0"}
Aug 05 17:23:56.863147 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.863013    2576 scope.go:117] "RemoveContainer" containerID="39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55"
Aug 05 17:23:56.874144 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.874126    2576 scope.go:117] "RemoveContainer" containerID="f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b"
Aug 05 17:23:56.885176 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.885157    2576 scope.go:117] "RemoveContainer" containerID="39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55"
Aug 05 17:23:56.885448 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:23:56.885430    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55\": container with ID starting with 39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55 not found: ID does not exist" containerID="39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55"
Aug 05 17:23:56.885533 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.885460    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55"} err="failed to get container status \"39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55\": rpc error: code = NotFound desc = could not find container \"39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55\": container with ID starting with 39d83af0243334c2cc988ac57e0409f558781f19d31fa930b8e5ae7c4ec5ad55 not found: ID does not exist"
Aug 05 17:23:56.885533 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.885485    2576 scope.go:117] "RemoveContainer" containerID="f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b"
Aug 05 17:23:56.885782 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:23:56.885762    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b\": container with ID starting with f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b not found: ID does not exist" containerID="f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b"
Aug 05 17:23:56.885827 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.885787    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b"} err="failed to get container status \"f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b\": rpc error: code = NotFound desc = could not find container \"f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b\": container with ID starting with f41612c1e4c5c0f1136861573a7bfb2e70855eaba3c04431d1d7a57439e59d4b not found: ID does not exist"
Aug 05 17:23:56.942292 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942245    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-certs\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942487 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942322    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-credential-socket\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942487 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942384    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-podinfo\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942487 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb24h\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-kube-api-access-rb24h\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942656 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-socket\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942656 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942534    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/967e341f-69ba-4f90-9f52-db4ab8031eec-istiod-ca-cert\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942656 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942523    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:56.942812 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-token\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942865 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-data\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942920 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942893    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-envoy\") pod \"967e341f-69ba-4f90-9f52-db4ab8031eec\" (UID: \"967e341f-69ba-4f90-9f52-db4ab8031eec\") "
Aug 05 17:23:56.942974 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942945    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:56.942974 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.942960    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:56.943274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.943240    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-data" (OuterVolumeSpecName: "istio-data") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:56.943903 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.943638    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967e341f-69ba-4f90-9f52-db4ab8031eec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:56.943903 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.943867    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:56.944106 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.943915    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:56.944106 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.943928    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:56.945421 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.945395    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-token" (OuterVolumeSpecName: "istio-token") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:56.945524 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.945433    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-kube-api-access-rb24h" (OuterVolumeSpecName: "kube-api-access-rb24h") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "kube-api-access-rb24h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:56.945935 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.945909    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:56.945935 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:56.945913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "967e341f-69ba-4f90-9f52-db4ab8031eec" (UID: "967e341f-69ba-4f90-9f52-db4ab8031eec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:23:57.044558 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.044522    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/967e341f-69ba-4f90-9f52-db4ab8031eec-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:57.044558 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.044552    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:57.044558 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.044562    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:57.044888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.044574    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:57.044888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.044584    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/967e341f-69ba-4f90-9f52-db4ab8031eec-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:57.044888 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.044592    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb24h\" (UniqueName: \"kubernetes.io/projected/967e341f-69ba-4f90-9f52-db4ab8031eec-kube-api-access-rb24h\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:23:57.203476 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.203443    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"]
Aug 05 17:23:57.212119 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.212094    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-92434d-openshift-default-bd866cf8d-rhltj"]
Aug 05 17:23:57.991303 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:23:57.991269    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" path="/var/lib/kubelet/pods/967e341f-69ba-4f90-9f52-db4ab8031eec/volumes"
Aug 05 17:24:02.513798 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:02.513761    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"]
Aug 05 17:24:02.523776 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:02.523750    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-57997e-29765835-s54cv"]
Aug 05 17:24:03.991363 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:03.991329    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14999870-7558-4468-be44-6e0f41200d7c" path="/var/lib/kubelet/pods/14999870-7558-4468-be44-6e0f41200d7c/volumes"
Aug 05 17:24:09.560290 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:09.560254    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"]
Aug 05 17:24:09.560852 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:09.560518    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" containerID="cri-o://769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737" gracePeriod=30
Aug 05 17:24:14.150254 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.150211    2576 patch_prober.go:28] interesting pod/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:24:14.150652 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.150299    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:24:14.822286 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.822258    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:24:14.913065 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02705d2b-9f23-4716-a134-ab41a56b3760-istio-podinfo\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913365 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913075    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-credential-socket\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913365 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-istio-token\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913365 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913127    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-certs\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913365 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913212    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02705d2b-9f23-4716-a134-ab41a56b3760-istiod-ca-cert\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913365 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913246    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-envoy\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913365 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-data\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913365 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913345    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddqnn\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-kube-api-access-ddqnn\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913751 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913361    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:24:14.913751 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-socket\") pod \"02705d2b-9f23-4716-a134-ab41a56b3760\" (UID: \"02705d2b-9f23-4716-a134-ab41a56b3760\") "
Aug 05 17:24:14.913751 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913545    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:24:14.913751 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913560    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-data" (OuterVolumeSpecName: "istio-data") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:24:14.913751 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913630    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02705d2b-9f23-4716-a134-ab41a56b3760-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:24:14.914010 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913841    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-credential-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:14.914010 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913864    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-certs\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:14.914010 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913863    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:24:14.914010 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913878    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02705d2b-9f23-4716-a134-ab41a56b3760-istiod-ca-cert\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:14.914010 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.913892    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-data\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:14.915461 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.915437    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-istio-token" (OuterVolumeSpecName: "istio-token") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:24:14.915461 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.915453    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:24:14.915740 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.915720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02705d2b-9f23-4716-a134-ab41a56b3760-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:24:14.915805 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.915720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-kube-api-access-ddqnn" (OuterVolumeSpecName: "kube-api-access-ddqnn") pod "02705d2b-9f23-4716-a134-ab41a56b3760" (UID: "02705d2b-9f23-4716-a134-ab41a56b3760"). InnerVolumeSpecName "kube-api-access-ddqnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:24:14.969369 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.969339    2576 generic.go:356] "Generic (PLEG): container finished" podID="02705d2b-9f23-4716-a134-ab41a56b3760" containerID="769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737" exitCode=0
Aug 05 17:24:14.969520 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.969387    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"
Aug 05 17:24:14.969520 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.969417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" event={"ID":"02705d2b-9f23-4716-a134-ab41a56b3760","Type":"ContainerDied","Data":"769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737"}
Aug 05 17:24:14.969520 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.969468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb" event={"ID":"02705d2b-9f23-4716-a134-ab41a56b3760","Type":"ContainerDied","Data":"344af0bfc1c53e543a19ac521110839d3ac4663578b4466dc040c16600759ce7"}
Aug 05 17:24:14.969520 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.969490    2576 scope.go:117] "RemoveContainer" containerID="769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737"
Aug 05 17:24:14.978864 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.978846    2576 scope.go:117] "RemoveContainer" containerID="71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe"
Aug 05 17:24:14.987244 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.987227    2576 scope.go:117] "RemoveContainer" containerID="769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737"
Aug 05 17:24:14.987509 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:24:14.987491    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737\": container with ID starting with 769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737 not found: ID does not exist" containerID="769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737"
Aug 05 17:24:14.987581 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.987518    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737"} err="failed to get container status \"769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737\": rpc error: code = NotFound desc = could not find container \"769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737\": container with ID starting with 769c3dc5e556d04fb40f3b2d9418388656e71269422c7656e192ee016df29737 not found: ID does not exist"
Aug 05 17:24:14.987581 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.987537    2576 scope.go:117] "RemoveContainer" containerID="71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe"
Aug 05 17:24:14.987793 ip-10-0-128-82 kubenswrapper[2576]: E0805 17:24:14.987775    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe\": container with ID starting with 71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe not found: ID does not exist" containerID="71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe"
Aug 05 17:24:14.987831 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.987800    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe"} err="failed to get container status \"71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe\": rpc error: code = NotFound desc = could not find container \"71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe\": container with ID starting with 71f9142c7e9a4393e0e3071e606e1fa6afc592d906468595913fa96b712c1efe not found: ID does not exist"
Aug 05 17:24:14.992820 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.992798    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"]
Aug 05 17:24:14.999690 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:14.999667    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-57997e-openshift-default-79d4bbd7d8-g5zqb"]
Aug 05 17:24:15.014509 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.014474    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-istio-envoy\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:15.014509 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.014509    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddqnn\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-kube-api-access-ddqnn\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:15.014691 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.014525    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02705d2b-9f23-4716-a134-ab41a56b3760-workload-socket\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:15.014691 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.014538    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02705d2b-9f23-4716-a134-ab41a56b3760-istio-podinfo\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:15.014691 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.014551    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02705d2b-9f23-4716-a134-ab41a56b3760-istio-token\") on node \"ip-10-0-128-82.ec2.internal\" DevicePath \"\""
Aug 05 17:24:15.478406 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.478375    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pmbs6_57cb29a0-cb0a-4ecd-9287-287eb2edbc7a/manager/0.log"
Aug 05 17:24:15.605463 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.605428    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jggqf_37ff8c29-1e2a-4da0-892a-1c99c684c552/manager/0.log"
Aug 05 17:24:15.729644 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.729572    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b9f57f8bb-qvd49_df524f16-b86f-4243-8a19-4900b05821b3/manager/0.log"
Aug 05 17:24:15.991180 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:15.991101    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" path="/var/lib/kubelet/pods/02705d2b-9f23-4716-a134-ab41a56b3760/volumes"
Aug 05 17:24:16.373818 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:16.373748    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfc779b6-m9fbk_f8020f8a-3144-4c24-8034-1bcd5b46bb44/manager/0.log"
Aug 05 17:24:16.379953 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:16.379937    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfc779b6-m9fbk_f8020f8a-3144-4c24-8034-1bcd5b46bb44/copy-manifests/0.log"
Aug 05 17:24:16.708204 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:16.708178    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6475fbf58c-g78gl_9eda3e3f-002e-4fab-befa-b8864d2299fd/maas-api/0.log"
Aug 05 17:24:16.816131 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:16.816105    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765805-4lvfp_d23556a6-7602-42d0-8524-2fce033c6f4f/cleanup/0.log"
Aug 05 17:24:16.925835 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:16.925807    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765820-d7nmq_7d47a16e-15b6-4fb2-9905-bb4587796483/cleanup/0.log"
Aug 05 17:24:17.027274 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:17.027196    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765835-c58wm_762f50da-04b9-4318-ac64-8ed74de043a3/cleanup/0.log"
Aug 05 17:24:17.140657 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:17.140631    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jjqlb_e53cac40-d5a7-4d45-8b34-b99c10fe8c96/postgres/0.log"
Aug 05 17:24:18.035634 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:18.035604    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-g72bj_4b615823-dcef-4a57-a65b-42b434f83046/manager/0.log"
Aug 05 17:24:18.146448 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:18.146423    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-pbk8f_a7416d14-acd6-4cc1-a0a6-0eb325c9da27/manager/0.log"
Aug 05 17:24:18.252068 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:18.252040    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-jrhc7_f301ba05-a7bf-4397-9c18-c8f8d0787cb0/kuadrant-console-plugin/0.log"
Aug 05 17:24:18.368560 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:18.368483    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-n67jf_a82e3c24-c8f4-4273-a463-b3d00aa68578/manager/0.log"
Aug 05 17:24:18.594603 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:18.594576    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-td74n_1a89dd82-d12b-4d06-9eba-46c44cbd3759/manager/0.log"
Aug 05 17:24:19.197819 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:19.197790    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65879f568d-mb5rv_7dcb32ce-e6e4-4150-a0f3-41407ee4fd29/kube-auth-proxy/0.log"
Aug 05 17:24:19.429711 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:19.429684    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkxwq_06bca3d3-50ae-4d86-8af0-338c929bbdc4/istio-proxy/1.log"
Aug 05 17:24:19.541599 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:19.541521    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2frhk_fc3e577c-8e7d-4b73-bcd3-eb02dff189ed/payload-pre-processing/0.log"
Aug 05 17:24:19.661718 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:19.661687    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-zhmcq_8081823a-db7a-48e3-bfd2-1e2889d2c9c2/payload-processing/0.log"
Aug 05 17:24:19.769475 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:19.769446    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b94f5687b-gj2pp_3858c9d9-3eb0-4d72-81dc-22c6923d59c9/router/0.log"
Aug 05 17:24:20.226673 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:20.226645    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-79ggv_d3b0c5bb-72cc-4c7f-926b-1bb96d36f4e4/main/0.log"
Aug 05 17:24:20.445491 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:20.445464    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsbc67_9d4d8c5b-fc52-47ff-ba26-d299bd3b55e3/main/0.log"
Aug 05 17:24:22.606707 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:22.606674    2576 scope.go:117] "RemoveContainer" containerID="0f650f85b8f71281c033b1a9b10d77e8c7322e9e5eb1e5c65e305e9ca79eef83"
Aug 05 17:24:22.615668 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:22.615648    2576 scope.go:117] "RemoveContainer" containerID="ebbfff5ef7da1500e6a8019195ddfbe6f9db29d9a54841453f72f11778bd3e70"
Aug 05 17:24:26.480269 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480235    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pbkcv/must-gather-79qt4"]
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480637    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480648    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39d4a75-1648-4667-b5fb-c88183d11325" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480659    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480666    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480674    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480680    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480691    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c327755-4054-45aa-8298-4b03f6c8e1d1" containerName="revoke-keys"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480696    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c327755-4054-45aa-8298-4b03f6c8e1d1" containerName="revoke-keys"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480703    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480710    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480717    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480722    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480733    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy"
Aug 05 17:24:26.480743 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480738    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7ea2e6-9e88-4df9-816a-fce6aae57464" containerName="istio-proxy"
Aug 05 17:24:26.481320 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480811    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy"
Aug 05 17:24:26.481320 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480818    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="967e341f-69ba-4f90-9f52-db4ab8031eec" containerName="istio-proxy"
Aug 05 17:24:26.481320 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480825    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy"
Aug 05 17:24:26.481320 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480835    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c327755-4054-45aa-8298-4b03f6c8e1d1" containerName="revoke-keys"
Aug 05 17:24:26.481320 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.480943    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="02705d2b-9f23-4716-a134-ab41a56b3760" containerName="istio-proxy"
Aug 05 17:24:26.485542 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.485522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.488210 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.488188    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pbkcv\"/\"default-dockercfg-fv2mn\""
Aug 05 17:24:26.488210 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.488200    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pbkcv\"/\"openshift-service-ca.crt\""
Aug 05 17:24:26.488809 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.488795    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pbkcv\"/\"kube-root-ca.crt\""
Aug 05 17:24:26.493898 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.493876    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pbkcv/must-gather-79qt4"]
Aug 05 17:24:26.522625 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.522595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc4fb362-ffb2-4618-9e73-4c87cc50e24c-must-gather-output\") pod \"must-gather-79qt4\" (UID: \"fc4fb362-ffb2-4618-9e73-4c87cc50e24c\") " pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.522773 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.522749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtlf\" (UniqueName: \"kubernetes.io/projected/fc4fb362-ffb2-4618-9e73-4c87cc50e24c-kube-api-access-cbtlf\") pod \"must-gather-79qt4\" (UID: \"fc4fb362-ffb2-4618-9e73-4c87cc50e24c\") " pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.623597 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.623562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtlf\" (UniqueName: \"kubernetes.io/projected/fc4fb362-ffb2-4618-9e73-4c87cc50e24c-kube-api-access-cbtlf\") pod \"must-gather-79qt4\" (UID: \"fc4fb362-ffb2-4618-9e73-4c87cc50e24c\") " pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.623766 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.623612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc4fb362-ffb2-4618-9e73-4c87cc50e24c-must-gather-output\") pod \"must-gather-79qt4\" (UID: \"fc4fb362-ffb2-4618-9e73-4c87cc50e24c\") " pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.623959 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.623941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc4fb362-ffb2-4618-9e73-4c87cc50e24c-must-gather-output\") pod \"must-gather-79qt4\" (UID: \"fc4fb362-ffb2-4618-9e73-4c87cc50e24c\") " pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.633959 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.633933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtlf\" (UniqueName: \"kubernetes.io/projected/fc4fb362-ffb2-4618-9e73-4c87cc50e24c-kube-api-access-cbtlf\") pod \"must-gather-79qt4\" (UID: \"fc4fb362-ffb2-4618-9e73-4c87cc50e24c\") " pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.795391 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.795314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbkcv/must-gather-79qt4"
Aug 05 17:24:26.936546 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.930481    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pbkcv/must-gather-79qt4"]
Aug 05 17:24:26.938037 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:26.938001    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:24:27.036629 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:27.036592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbkcv/must-gather-79qt4" event={"ID":"fc4fb362-ffb2-4618-9e73-4c87cc50e24c","Type":"ContainerStarted","Data":"e5cf63629425c8116fe3e20780d8203ebbacd99d046a6baff380fbeee39a2dfe"}
Aug 05 17:24:28.045475 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:28.045394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbkcv/must-gather-79qt4" event={"ID":"fc4fb362-ffb2-4618-9e73-4c87cc50e24c","Type":"ContainerStarted","Data":"a551075c4b2cc20412c7265496cbf46c3e5f8255845214f8a2898ddd6097a319"}
Aug 05 17:24:28.045475 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:28.045439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbkcv/must-gather-79qt4" event={"ID":"fc4fb362-ffb2-4618-9e73-4c87cc50e24c","Type":"ContainerStarted","Data":"bf80fdaafd610ed550ca43af6ea0d06491a4157a761ad37566b59dd871e40b4b"}
Aug 05 17:24:28.063116 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:28.063051    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pbkcv/must-gather-79qt4" podStartSLOduration=1.270429119 podStartE2EDuration="2.063022717s" totalImagesPullingTime="792.593598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:28.061851701 +0000 UTC m=+3726.568743437" watchObservedRunningTime="2026-08-05 17:24:28.063022717 +0000 UTC m=+3726.569914431"
Aug 05 17:24:29.366618 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:29.366590    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jl6qt_64fe61ce-f5f6-4d9a-b957-fb2591c24cac/global-pull-secret-syncer/0.log"
Aug 05 17:24:29.541480 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:29.541451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tvzzl_7bf36976-dce4-4748-a01f-67b0df83fb95/konnectivity-agent/0.log"
Aug 05 17:24:29.588168 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:29.588135    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-82.ec2.internal_38682c8c45872d6ae76d00eb5809d129/haproxy/0.log"
Aug 05 17:24:34.982336 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:34.982251    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-g72bj_4b615823-dcef-4a57-a65b-42b434f83046/manager/0.log"
Aug 05 17:24:35.023168 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:35.023131    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-pbk8f_a7416d14-acd6-4cc1-a0a6-0eb325c9da27/manager/0.log"
Aug 05 17:24:35.065069 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:35.065030    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-jrhc7_f301ba05-a7bf-4397-9c18-c8f8d0787cb0/kuadrant-console-plugin/0.log"
Aug 05 17:24:35.192698 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:35.192667    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-n67jf_a82e3c24-c8f4-4273-a463-b3d00aa68578/manager/0.log"
Aug 05 17:24:35.333686 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:35.333561    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-td74n_1a89dd82-d12b-4d06-9eba-46c44cbd3759/manager/0.log"
Aug 05 17:24:37.101706 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.101674    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-w6dkv_608fee0d-7fa3-4397-88fe-c7d67b280042/cluster-monitoring-operator/0.log"
Aug 05 17:24:37.198539 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.198454    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b44ff65bb-j9kt2_c4ac68a1-f28b-40ca-927f-349a0b23f3a8/metrics-server/0.log"
Aug 05 17:24:37.228851 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.228714    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-rcpjr_b835cda7-c356-4e0c-882e-8297835168bd/monitoring-plugin/0.log"
Aug 05 17:24:37.368698 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.368649    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k8rg_8dfad0db-3a6e-48e6-868c-dd7293b64314/node-exporter/0.log"
Aug 05 17:24:37.392353 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.392321    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k8rg_8dfad0db-3a6e-48e6-868c-dd7293b64314/kube-rbac-proxy/0.log"
Aug 05 17:24:37.417434 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.417409    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k8rg_8dfad0db-3a6e-48e6-868c-dd7293b64314/init-textfile/0.log"
Aug 05 17:24:37.528491 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.528409    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-wf58c_1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51/kube-rbac-proxy-main/0.log"
Aug 05 17:24:37.553440 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.553412    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-wf58c_1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51/kube-rbac-proxy-self/0.log"
Aug 05 17:24:37.582025 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.581973    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-wf58c_1dc4c9cd-bec7-4e30-9ea8-b22020ba2d51/openshift-state-metrics/0.log"
Aug 05 17:24:37.623652 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.623623    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6aea029-dca6-4c6c-9907-969420170c4f/prometheus/0.log"
Aug 05 17:24:37.650541 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.650512    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6aea029-dca6-4c6c-9907-969420170c4f/config-reloader/0.log"
Aug 05 17:24:37.676797 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.676741    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6aea029-dca6-4c6c-9907-969420170c4f/thanos-sidecar/0.log"
Aug 05 17:24:37.709067 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.708955    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6aea029-dca6-4c6c-9907-969420170c4f/kube-rbac-proxy-web/0.log"
Aug 05 17:24:37.732390 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.732349    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6aea029-dca6-4c6c-9907-969420170c4f/kube-rbac-proxy/0.log"
Aug 05 17:24:37.759508 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.759480    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6aea029-dca6-4c6c-9907-969420170c4f/kube-rbac-proxy-thanos/0.log"
Aug 05 17:24:37.784712 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:37.784618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6aea029-dca6-4c6c-9907-969420170c4f/init-config-reloader/0.log"
Aug 05 17:24:39.527668 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.527627    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"]
Aug 05 17:24:39.537015 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.536971    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.543557 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.543522    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"]
Aug 05 17:24:39.677740 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.677710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-proc\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.677912 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.677775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-lib-modules\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.677912 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.677850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-sys\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.678023 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.677922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-podres\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.678023 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.678001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm9ks\" (UniqueName: \"kubernetes.io/projected/aba0f690-ab62-492b-975e-141148d424df-kube-api-access-dm9ks\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779264 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm9ks\" (UniqueName: \"kubernetes.io/projected/aba0f690-ab62-492b-975e-141148d424df-kube-api-access-dm9ks\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-proc\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-lib-modules\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-sys\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-proc\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-podres\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-podres\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.779946 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-sys\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.780419 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.779967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aba0f690-ab62-492b-975e-141148d424df-lib-modules\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.789593 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.789563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm9ks\" (UniqueName: \"kubernetes.io/projected/aba0f690-ab62-492b-975e-141148d424df-kube-api-access-dm9ks\") pod \"perf-node-gather-daemonset-nnj4t\" (UID: \"aba0f690-ab62-492b-975e-141148d424df\") " pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:39.853432 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:39.853400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:40.072092 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:40.065461    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"]
Aug 05 17:24:40.072092 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:40.067011    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/2.log"
Aug 05 17:24:40.072962 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:40.072941    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-4psc6_60998130-d018-493b-8caa-71e8a0dee61e/console-operator/3.log"
Aug 05 17:24:40.074411 ip-10-0-128-82 kubenswrapper[2576]: W0805 17:24:40.074387    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaba0f690_ab62_492b_975e_141148d424df.slice/crio-b055800c37e9fbaddb3bf0d7ab146de0ed0dced358bc9962371a5b99741ad96a WatchSource:0}: Error finding container b055800c37e9fbaddb3bf0d7ab146de0ed0dced358bc9962371a5b99741ad96a: Status 404 returned error can't find the container with id b055800c37e9fbaddb3bf0d7ab146de0ed0dced358bc9962371a5b99741ad96a
Aug 05 17:24:40.157490 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:40.157460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t" event={"ID":"aba0f690-ab62-492b-975e-141148d424df","Type":"ContainerStarted","Data":"b055800c37e9fbaddb3bf0d7ab146de0ed0dced358bc9962371a5b99741ad96a"}
Aug 05 17:24:41.178614 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:41.178573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t" event={"ID":"aba0f690-ab62-492b-975e-141148d424df","Type":"ContainerStarted","Data":"9716102d9fb6320317f25085a54193a5002c259fe7b058b0174fc35ed4c75f99"}
Aug 05 17:24:41.179037 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:41.178770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:41.196132 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:41.196078    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t" podStartSLOduration=2.196061517 podStartE2EDuration="2.196061517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:24:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:41.194098174 +0000 UTC m=+3739.700989889" watchObservedRunningTime="2026-08-05 17:24:41.196061517 +0000 UTC m=+3739.702953228"
Aug 05 17:24:41.364030 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:41.363997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-rzq6x_d781f794-dbf8-496c-8884-d59e320178e5/volume-data-source-validator/0.log"
Aug 05 17:24:42.526849 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:42.526820    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dklqq_d6835bd1-ecd0-4a31-90f6-edccc631c8d6/dns/0.log"
Aug 05 17:24:42.553201 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:42.553159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dklqq_d6835bd1-ecd0-4a31-90f6-edccc631c8d6/kube-rbac-proxy/0.log"
Aug 05 17:24:42.602561 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:42.602530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k2qmn_14837c1d-5229-403d-9250-0b77cafea91b/dns-node-resolver/0.log"
Aug 05 17:24:43.248924 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:43.248893    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ll2k_f5e15f84-cc68-4adc-b8b7-67ac3d82aba3/node-ca/0.log"
Aug 05 17:24:44.532639 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:44.532613    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65879f568d-mb5rv_7dcb32ce-e6e4-4150-a0f3-41407ee4fd29/kube-auth-proxy/0.log"
Aug 05 17:24:44.600291 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:44.600258    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkxwq_06bca3d3-50ae-4d86-8af0-338c929bbdc4/istio-proxy/0.log"
Aug 05 17:24:44.611594 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:44.611568    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkxwq_06bca3d3-50ae-4d86-8af0-338c929bbdc4/istio-proxy/1.log"
Aug 05 17:24:44.647526 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:44.647489    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2frhk_fc3e577c-8e7d-4b73-bcd3-eb02dff189ed/payload-pre-processing/0.log"
Aug 05 17:24:44.680651 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:44.680618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-zhmcq_8081823a-db7a-48e3-bfd2-1e2889d2c9c2/payload-processing/0.log"
Aug 05 17:24:44.704919 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:44.704895    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b94f5687b-gj2pp_3858c9d9-3eb0-4d72-81dc-22c6923d59c9/router/0.log"
Aug 05 17:24:45.602364 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:45.602339    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dvc7r_9aa21ce2-397f-46ee-a08f-074c0f91fc93/serve-healthcheck-canary/0.log"
Aug 05 17:24:46.144654 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:46.144592    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-kn6sw_9dc97b96-a1b3-4d7c-9b86-643f7541c35d/insights-operator/0.log"
Aug 05 17:24:46.145855 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:46.145831    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-kn6sw_9dc97b96-a1b3-4d7c-9b86-643f7541c35d/insights-operator/1.log"
Aug 05 17:24:46.316163 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:46.316139    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zm2dr_2522728c-8d34-4b05-9070-5dc1021bb091/kube-rbac-proxy/0.log"
Aug 05 17:24:46.341958 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:46.341929    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zm2dr_2522728c-8d34-4b05-9070-5dc1021bb091/exporter/0.log"
Aug 05 17:24:46.366763 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:46.366734    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zm2dr_2522728c-8d34-4b05-9070-5dc1021bb091/extractor/0.log"
Aug 05 17:24:47.195475 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:47.195443    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pbkcv/perf-node-gather-daemonset-nnj4t"
Aug 05 17:24:48.705791 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:48.705770    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pmbs6_57cb29a0-cb0a-4ecd-9287-287eb2edbc7a/manager/0.log"
Aug 05 17:24:49.022457 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:49.022428    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jggqf_37ff8c29-1e2a-4da0-892a-1c99c684c552/manager/0.log"
Aug 05 17:24:49.260017 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:49.259925    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b9f57f8bb-qvd49_df524f16-b86f-4243-8a19-4900b05821b3/manager/0.log"
Aug 05 17:24:49.573698 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:49.573667    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfc779b6-m9fbk_f8020f8a-3144-4c24-8034-1bcd5b46bb44/manager/0.log"
Aug 05 17:24:49.596157 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:49.596129    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfc779b6-m9fbk_f8020f8a-3144-4c24-8034-1bcd5b46bb44/copy-manifests/0.log"
Aug 05 17:24:50.503307 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:50.503272    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65879f568d-mb5rv_7dcb32ce-e6e4-4150-a0f3-41407ee4fd29/kube-auth-proxy/0.log"
Aug 05 17:24:50.544111 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:50.544073    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkxwq_06bca3d3-50ae-4d86-8af0-338c929bbdc4/istio-proxy/0.log"
Aug 05 17:24:50.553881 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:50.553855    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkxwq_06bca3d3-50ae-4d86-8af0-338c929bbdc4/istio-proxy/1.log"
Aug 05 17:24:50.577392 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:50.577361    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2frhk_fc3e577c-8e7d-4b73-bcd3-eb02dff189ed/payload-pre-processing/0.log"
Aug 05 17:24:50.603192 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:50.603166    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-zhmcq_8081823a-db7a-48e3-bfd2-1e2889d2c9c2/payload-processing/0.log"
Aug 05 17:24:50.618107 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:50.618078    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b94f5687b-gj2pp_3858c9d9-3eb0-4d72-81dc-22c6923d59c9/router/0.log"
Aug 05 17:24:52.248207 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:52.248181    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65879f568d-mb5rv_7dcb32ce-e6e4-4150-a0f3-41407ee4fd29/kube-auth-proxy/0.log"
Aug 05 17:24:52.293864 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:52.293834    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkxwq_06bca3d3-50ae-4d86-8af0-338c929bbdc4/istio-proxy/0.log"
Aug 05 17:24:52.303896 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:52.303870    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkxwq_06bca3d3-50ae-4d86-8af0-338c929bbdc4/istio-proxy/1.log"
Aug 05 17:24:52.328966 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:52.328937    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-2frhk_fc3e577c-8e7d-4b73-bcd3-eb02dff189ed/payload-pre-processing/0.log"
Aug 05 17:24:52.353603 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:52.353574    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-zhmcq_8081823a-db7a-48e3-bfd2-1e2889d2c9c2/payload-processing/0.log"
Aug 05 17:24:52.367845 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:52.367820    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b94f5687b-gj2pp_3858c9d9-3eb0-4d72-81dc-22c6923d59c9/router/0.log"
Aug 05 17:24:56.356040 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:56.356011    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-7cxzq_f9f3aacc-e968-4225-9bbd-8c78937ae8d5/kube-storage-version-migrator-operator/1.log"
Aug 05 17:24:56.356774 ip-10-0-128-82 kubenswrapper[2576]: I0805 17:24:56.356755    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-7cxzq_f9f3aacc-e968-4225-9bbd-8c78937ae8d5/kube-storage-version-migrator-operator/0.log"