Jul 06 13:42:53.474516 ip-10-0-142-56 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 13:42:53.474530 ip-10-0-142-56 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 13:42:53.474539 ip-10-0-142-56 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 13:42:53.474843 ip-10-0-142-56 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 13:43:03.683279 ip-10-0-142-56 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 13:43:03.683297 ip-10-0-142-56 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5b24a2c01b284514868f78a4b85516ba --
Jul 06 13:44:59.068566 ip-10-0-142-56 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 13:44:59.521808 ip-10-0-142-56 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:44:59.521808 ip-10-0-142-56 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 13:44:59.521808 ip-10-0-142-56 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:44:59.521808 ip-10-0-142-56 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 13:44:59.521808 ip-10-0-142-56 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 13:44:59.522780 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.522697    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 13:44:59.529048 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529024    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:44:59.529048 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529043    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:44:59.529048 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529048    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:44:59.529048 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529052    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529057    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529062    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529066    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529070    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529074    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529078    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529081    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529085    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529089    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529093    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529097    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529101    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529104    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529111    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529117    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529122    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529126    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529131    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:44:59.529304 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529136    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529140    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529145    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529150    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529154    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529158    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529162    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529166    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529170    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529176    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529180    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529184    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529188    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529192    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529196    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529202    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529206    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529210    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529215    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529219    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:44:59.530068 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529223    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529227    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529231    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529235    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529240    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529244    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529248    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529252    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529257    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529261    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529265    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529288    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529293    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529297    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529301    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529306    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529310    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529314    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529319    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529323    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:44:59.530900 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529327    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529331    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529336    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529340    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529344    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529349    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529353    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529359    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529363    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529367    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529372    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529376    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529380    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529389    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529395    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529399    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529404    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529408    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529412    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:44:59.531729 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529416    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529421    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529426    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529431    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529435    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529440    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529443    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529447    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529452    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529456    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529460    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529464    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529468    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529472    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529477    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529483    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529489    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.529493    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530651    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:44:59.532547 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530661    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530667    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530672    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530676    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530681    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530685    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530691    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530695    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530698    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530703    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530707    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530711    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530716    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530723    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530729    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530734    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530740    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530745    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530750    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:44:59.533368 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530755    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530759    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530764    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530768    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530772    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530777    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530783    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530788    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530793    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530798    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530802    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530807    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530811    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530816    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530820    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530825    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530829    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530833    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530838    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530842    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:44:59.534018 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530846    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530850    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530854    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530858    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530863    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530867    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530871    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530877    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530881    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530885    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530890    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530894    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530898    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530902    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530906    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530910    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530915    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530919    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530923    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:44:59.534586 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530929    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530934    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530938    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530942    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530947    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530951    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530955    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530960    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530964    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530969    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530973    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530977    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530981    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530986    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530990    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530994    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.530998    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531003    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531007    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531012    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:44:59.535122 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531015    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531020    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531024    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531029    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531034    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531038    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531045    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531049    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531053    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531058    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531062    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531066    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531070    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531074    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531078    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531083    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531087    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531091    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531096    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531100    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:44:59.535827 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531772    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531782    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531787    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531793    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531798    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531802    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531808    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531815    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531820    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531824    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531829    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531833    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531838    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531842    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531846    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531850    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531856    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531860    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531866    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:44:59.536332 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531870    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531874    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531879    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531883    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531887    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531892    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531896    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531900    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531904    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531908    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531912    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531919    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531923    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531927    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531931    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531935    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531939    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531944    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531949    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531953    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:44:59.536893 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531957    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531961    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531965    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531970    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531974    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531979    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531983    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531987    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531991    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.531995    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532004    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532009    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532013    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532018    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532022    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532026    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532030    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532035    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532039    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532043    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:44:59.537398 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532047    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532051    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532055    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532062    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532066    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532070    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532075    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532079    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532083    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532087    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532091    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532095    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532099    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532103    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532107    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532111    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532116    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532120    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532124    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:44:59.537932 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532128    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532137    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532142    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532147    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532155    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532160    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532165    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532169    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532173    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532178    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532182    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532188    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532192    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532196    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532200    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532204    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532210    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532214    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532218    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:44:59.538424 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532222    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.532226    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532339    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532356    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532366    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532373    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532379    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532385    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532391    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532397    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532402    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532407    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532412    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532418    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532423    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532427    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532432    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532439    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532445    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532450    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532456    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532460    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532465    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532470    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 13:44:59.538883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532476    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532481    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532486    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532491    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532496    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532503    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532508    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532513    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532518    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532523    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532530    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532534    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532539    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532543    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532547    2572 flags.go:64] FLAG: --enable-server="true"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532552    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532559    2572 flags.go:64] FLAG: --event-burst="100"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532564    2572 flags.go:64] FLAG: --event-qps="50"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532568    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532573    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532578    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532584    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532588    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532593    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532598    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 06 13:44:59.539551 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532605    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532609    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532615    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532619    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532624    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532628    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532633    2572 flags.go:64] FLAG: --feature-gates=""
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532639    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532644    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532649    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532653    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532658    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532664    2572 flags.go:64] FLAG: --help="false"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532668    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-142-56.ec2.internal"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532673    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532678    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532683    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532688    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532693    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532698    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532702    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532707    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532711    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 13:44:59.540176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532716    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532721    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532725    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532730    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532734    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532739    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532743    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532747    2572 flags.go:64] FLAG: --lock-file=""
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532752    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532759    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532764    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532772    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532777    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532781    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532787    2572 flags.go:64] FLAG: --logging-format="text"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532791    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532797    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532801    2572 flags.go:64] FLAG: --manifest-url=""
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532805    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532812    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532816    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532823    2572 flags.go:64] FLAG: --max-pods="110"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532829    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532833    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532838    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 13:44:59.540770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532843    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532847    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532852    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532857    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532868    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532873    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532878    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532882    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532887    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532895    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532900    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532904    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532909    2572 flags.go:64] FLAG: --port="10250"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532914    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532919    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a9ec0e71b48ca47a"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532924    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532930    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532935    2572 flags.go:64] FLAG: --register-node="true"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532939    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532945    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532951    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532955    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532960    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532966    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532971    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 13:44:59.541387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532975    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532980    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532984    2572 flags.go:64] FLAG: --runonce="false"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532989    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532994    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.532999    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533003    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533008    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533012    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533017    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533022    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533026    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533031    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533036    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533040    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533045    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533050    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533054    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533062    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533067    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533071    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533077    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533082    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533088    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533093    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 13:44:59.541987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533097    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533102    2572 flags.go:64] FLAG: --v="2"
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533108    2572 flags.go:64] FLAG: --version="false"
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533115    2572 flags.go:64] FLAG: --vmodule=""
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533120    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.533126    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533321    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533330    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533335    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533339    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533343    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533350    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533356    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533361    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533365    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533370    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533374    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533379    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533383    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533387    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533392    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:44:59.542606 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533396    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533400    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533404    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533409    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533413    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533417    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533421    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533425    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533430    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533436    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533441    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533445    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533449    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533453    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533457    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533462    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533466    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533471    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533476    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533480    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:44:59.543136 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533484    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533488    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533494    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533498    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533503    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533507    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533511    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533515    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533519    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533523    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533527    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533531    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533535    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533540    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533544    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533548    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533553    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533557    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533561    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533566    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:44:59.543646 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533570    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533576    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533580    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533584    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533588    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533592    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533597    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533601    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533606    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533611    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533615    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533619    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533623    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533627    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533633    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533637    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533641    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533645    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533649    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533654    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:44:59.544132 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533658    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533663    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533668    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533673    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533677    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533681    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533685    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533691    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533695    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533699    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533703    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533707    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533711    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533717    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533721    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533725    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533730    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533734    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533740    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:44:59.544715 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533745    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533750    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533756    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533761    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.533765    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.534438    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.541002    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.541025    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.541042    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.541050    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541104    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541109    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541113    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541116    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:44:59.545178 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541119    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541122    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541124    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541127    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541130    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541132    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541135    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541138    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541140    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541143    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541146    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541148    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541152    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541154    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541157    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541159    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541162    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541165    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541167    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541170    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:44:59.545543 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541172    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541175    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541178    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541180    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541183    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541187    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541190    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541192    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541195    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541198    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541200    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541203    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541206    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541208    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541211    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541214    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541216    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541219    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541221    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541224    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:44:59.546022 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541226    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541229    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541231    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541234    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541236    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541239    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541242    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541244    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541247    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541251    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541253    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541256    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541258    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541261    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541263    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541266    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541268    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541288    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541294    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:44:59.546514 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541298    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541302    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541305    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541308    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541311    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541313    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541316    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541318    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541321    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541324    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541326    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541329    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541332    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541334    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541337    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541339    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541342    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541345    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541347    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:44:59.546964 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541350    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541352    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541355    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541357    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541360    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541362    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541365    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541367    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541370    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541372    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541375    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541377    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541380    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541385    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541388    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541391    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:44:59.547432 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541394    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.541398    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541516    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541521    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541524    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541527    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541529    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541532    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541534    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541537    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541539    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541541    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541544    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541546    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541549    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541551    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 13:44:59.547822 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541554    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541556    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541559    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541561    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541564    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541566    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541569    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541571    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541574    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541576    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541578    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541582    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541586    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541589    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541592    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541594    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541597    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541600    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541602    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541605    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 13:44:59.548220 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541607    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541609    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541612    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541615    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541617    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541621    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541624    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541626    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541629    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541631    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541634    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541637    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541639    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541641    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541644    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541646    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541649    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541651    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541655    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 13:44:59.548776 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541658    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541660    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541663    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541666    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541669    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541671    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541674    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541677    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541680    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541683    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541685    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541688    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541690    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541692    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541695    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541698    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541701    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541703    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541706    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541708    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 13:44:59.549224 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541710    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541713    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541715    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541718    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541720    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541723    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541725    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541728    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541730    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541733    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541735    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541738    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541740    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541742    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541745    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541747    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541750    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541753    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541755    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541757    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 13:44:59.549726 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541760    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541763    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541765    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541768    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541770    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:44:59.541772    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.541777    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.541871    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.543854    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.545608    2572 server.go:1019] "Starting client certificate rotation"
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.545709    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.545746    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 13:44:59.550193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.548826    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 13:44:59.550508 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.550266    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 13:44:59.561381 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.561362    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 06 13:44:59.563306 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.563293    2572 log.go:25] "Validated CRI v1 image API"
Jul 06 13:44:59.564773 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.564756    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 13:44:59.569235 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.569219    2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b8f0d821-fe5d-4d26-bc51-43dcd5ad14c1:/dev/nvme0n1p3 e711f944-391e-4497-a269-1b3994ac97d0:/dev/nvme0n1p4]
Jul 06 13:44:59.569297 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:44:59.569235    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 13:45:00.601315 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.601189    2572 manager.go:216] Machine: {Timestamp:2026-07-06 13:45:00.599843312 +0000 UTC m=+0.359815225 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092013 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26954ae0a1242ae4c0dfd7e258ee62 SystemUUID:ec26954a-e0a1-242a-e4c0-dfd7e258ee62 BootID:5b24a2c0-1b28-4514-868f-78a4b85516ba Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:e4:60:47:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:e4:60:47:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:55:83:3a:aa:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 13:45:00.601315 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.601307    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 13:45:00.601439 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.601380    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 13:45:00.604540 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.604516    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 13:45:00.604667 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.604543    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-56.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 13:45:00.605223 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.605197    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 13:45:00.605910 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.605899    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 13:45:00.605941 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.605914    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 13:45:00.605941 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.605922    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 13:45:00.606454 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.606444    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 13:45:00.607675 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.607664    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 13:45:00.610614 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.610603    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 13:45:00.610887 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.610877    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 13:45:00.610922 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.610909    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 13:45:00.610922 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.610918    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 13:45:00.610972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.610928    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 13:45:00.610972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.610937    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 06 13:45:00.610972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.610945    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 13:45:00.611357 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.611343    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 13:45:00.611413 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.611365    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 13:45:00.613479 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.613464    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 13:45:00.615197 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.615183    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 13:45:00.615260 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.615245    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 13:45:00.616426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616415    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 13:45:00.616469 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616432    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 13:45:00.616469 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616438    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 13:45:00.616469 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616444    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 13:45:00.616469 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616455    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 13:45:00.616469 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616464    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 13:45:00.616622 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616613    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 13:45:00.616622 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616622    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 13:45:00.616699 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616629    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 13:45:00.616699 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616635    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 13:45:00.616699 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616643    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 13:45:00.616699 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.616652    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 13:45:00.617483 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.617474    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 13:45:00.617483 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.617483    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 13:45:00.620932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.620916    2572 server.go:1268] "Started kubelet"
Jul 06 13:45:00.621014 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.620991    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 13:45:00.621526 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.621507    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-56.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 13:45:00.621610 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.621562    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 13:45:00.621663 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.621631    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 13:45:00.621910 ip-10-0-142-56 systemd[1]: Started Kubernetes Kubelet.
Jul 06 13:45:00.622150 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.622121    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 13:45:00.622312 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.622262    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 13:45:00.623101 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.623087    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 13:45:00.623332 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.623317    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 13:45:00.627010 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.626992    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 13:45:00.628367 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.627434    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-56.ec2.internal.18bfb748c44c9961  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-56.ec2.internal,UID:ip-10-0-142-56.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-56.ec2.internal,},FirstTimestamp:2026-07-06 13:45:00.620888417 +0000 UTC m=+0.380860329,LastTimestamp:2026-07-06 13:45:00.620888417 +0000 UTC m=+0.380860329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-56.ec2.internal,}"
Jul 06 13:45:00.629389 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.629369    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 13:45:00.629389 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.629379    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 13:45:00.629584 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.629503    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:00.630960 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.630942    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 13:45:00.632253 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.632239    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 13:45:00.632429 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.631915    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 13:45:00.632514 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.632500    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 13:45:00.632577 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.632516    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 13:45:00.632879 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.632861    2572 factory.go:55] Registering systemd factory
Jul 06 13:45:00.632955 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.632904    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 06 13:45:00.633329 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.633239    2572 factory.go:153] Registering CRI-O factory
Jul 06 13:45:00.633329 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.633254    2572 factory.go:223] Registration of the crio container factory successfully
Jul 06 13:45:00.633329 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.633321    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 13:45:00.633499 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.633344    2572 factory.go:103] Registering Raw factory
Jul 06 13:45:00.633499 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.633361    2572 manager.go:1196] Started watching for new ooms in manager
Jul 06 13:45:00.634437 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.634385    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 13:45:00.634437 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.634416    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 13:45:00.634573 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.634454    2572 manager.go:349] Starting recovery of all containers
Jul 06 13:45:00.638002 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.637979    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86z28"
Jul 06 13:45:00.645333 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.645199    2572 manager.go:354] Recovery completed
Jul 06 13:45:00.646076 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.646049    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86z28"
Jul 06 13:45:00.646596 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.646579    2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 06 13:45:00.649627 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.649610    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:45:00.651539 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.651523    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:45:00.651628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.651553    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:45:00.651628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.651567    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:45:00.652043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.652030    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 13:45:00.652043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.652042    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 13:45:00.652129 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.652057    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 13:45:00.652129 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.652072    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:45:00.652688 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.652674    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:45:00.652755 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.652700    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:45:00.652755 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.652712    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:45:00.653120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.653106    2572 policy_none.go:49] "None policy: Start"
Jul 06 13:45:00.653234 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.653124    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 13:45:00.653234 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.653136    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 13:45:00.653365 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.653198    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-56.ec2.internal.18bfb748c6204502  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-56.ec2.internal,UID:ip-10-0-142-56.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-56.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-56.ec2.internal,},FirstTimestamp:2026-07-06 13:45:00.651537666 +0000 UTC m=+0.411509579,LastTimestamp:2026-07-06 13:45:00.651537666 +0000 UTC m=+0.411509579,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-56.ec2.internal,}"
Jul 06 13:45:00.654062 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.654051    2572 policy_none.go:47] "Start"
Jul 06 13:45:00.689792 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.689779    2572 manager.go:337] "Starting Device Plugin manager"
Jul 06 13:45:00.689857 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.689805    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 13:45:00.689857 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.689817    2572 server.go:87] "Starting device plugin registration server"
Jul 06 13:45:00.690024 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.690011    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 13:45:00.690081 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.690025    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 13:45:00.690133 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.690122    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 13:45:00.690201 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.690188    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 13:45:00.690281 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.690202    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 13:45:00.690678 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.690659    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 13:45:00.690752 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.690711    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:00.753553 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.753529    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 13:45:00.755506 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.754659    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 13:45:00.755506 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.754707    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 13:45:00.755506 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.754731    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 13:45:00.755506 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.754769    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 13:45:00.757267 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.757247    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:45:00.790383 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.790365    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:45:00.792939 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.792925    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:45:00.793000 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.792955    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:45:00.793000 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.792968    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:45:00.793000 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.792990    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.806144 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.806096    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.806144 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.806120    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-56.ec2.internal\": node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:00.816878 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.816858    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:00.855487 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.855463    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"]
Jul 06 13:45:00.855594 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.855531    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:45:00.856924 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.856910    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:45:00.857003 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.856939    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:45:00.857003 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.856950    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:45:00.859142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859129    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:45:00.859295 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.859357 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859315    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:45:00.859903 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859888    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:45:00.859965 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859910    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:45:00.859965 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859890    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:45:00.859965 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859944    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:45:00.859965 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859954    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:45:00.860135 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.859924    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:45:00.862239 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.862225    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.862298 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.862250    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 13:45:00.862931 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.862917    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 13:45:00.863000 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.862941    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 13:45:00.863000 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.862956    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 06 13:45:00.888926 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.888900    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-56.ec2.internal\" not found" node="ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.893381 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.893364    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-56.ec2.internal\" not found" node="ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.917434 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:00.917417    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:00.934606 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.934588    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bb30839cb03c9062603e1f5c43528128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"bb30839cb03c9062603e1f5c43528128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.934674 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.934611    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb30839cb03c9062603e1f5c43528128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"bb30839cb03c9062603e1f5c43528128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:00.934674 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:00.934629    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab9d31aec28a733c64bba49d46efd8ad-config\") pod \"kube-apiserver-proxy-ip-10-0-142-56.ec2.internal\" (UID: \"ab9d31aec28a733c64bba49d46efd8ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.018367 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.018326    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.034771 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.034751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bb30839cb03c9062603e1f5c43528128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"bb30839cb03c9062603e1f5c43528128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.034851 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.034778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb30839cb03c9062603e1f5c43528128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"bb30839cb03c9062603e1f5c43528128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.034851 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.034798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab9d31aec28a733c64bba49d46efd8ad-config\") pod \"kube-apiserver-proxy-ip-10-0-142-56.ec2.internal\" (UID: \"ab9d31aec28a733c64bba49d46efd8ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.034851 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.034843    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ab9d31aec28a733c64bba49d46efd8ad-config\") pod \"kube-apiserver-proxy-ip-10-0-142-56.ec2.internal\" (UID: \"ab9d31aec28a733c64bba49d46efd8ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.034969 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.034852    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb30839cb03c9062603e1f5c43528128-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"bb30839cb03c9062603e1f5c43528128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.034969 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.034865    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bb30839cb03c9062603e1f5c43528128-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"bb30839cb03c9062603e1f5c43528128\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.119182 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.119143    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.193742 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.193712    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.196891 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.196864    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:01.219662 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.219642    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.320324 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.320278    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.421003 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.420910    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.480215 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.480190    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:45:01.521907 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.521881    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.571523 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.571490    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 13:45:01.572114 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.571662    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 13:45:01.572114 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.571663    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 13:45:01.621993 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.621955    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.648671 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.648643    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 13:40:00 +0000 UTC" deadline="2028-02-10 11:35:07.076312814 +0000 UTC"
Jul 06 13:45:01.648671 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.648670    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14013h50m5.427646067s"
Jul 06 13:45:01.722996 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.722971    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.725567 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.725550    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:45:01.823799 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.823777    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:01.831248 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:01.831204    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb30839cb03c9062603e1f5c43528128.slice/crio-48c99f82f4321c64b4072802b8447f3cf1e2716f2fe3dba4c7a20373f13fc050 WatchSource:0}: Error finding container 48c99f82f4321c64b4072802b8447f3cf1e2716f2fe3dba4c7a20373f13fc050: Status 404 returned error can't find the container with id 48c99f82f4321c64b4072802b8447f3cf1e2716f2fe3dba4c7a20373f13fc050
Jul 06 13:45:01.840463 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:01.840445    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:45:01.852707 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:01.852684    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9d31aec28a733c64bba49d46efd8ad.slice/crio-cf912ca6ea52b98d57b7b794f7e02f87f6c60bb32025dc4227443593add8d55d WatchSource:0}: Error finding container cf912ca6ea52b98d57b7b794f7e02f87f6c60bb32025dc4227443593add8d55d: Status 404 returned error can't find the container with id cf912ca6ea52b98d57b7b794f7e02f87f6c60bb32025dc4227443593add8d55d
Jul 06 13:45:01.924913 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:01.924873    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:02.025535 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.025468    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 06 13:45:02.112061 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.112035    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:45:02.130498 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.130477    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:02.141604 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.141587    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 13:45:02.142653 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.142641    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 06 13:45:02.151100 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.151088    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 13:45:02.463178 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.463147    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:45:02.612273 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.612232    2572 apiserver.go:52] "Watching apiserver"
Jul 06 13:45:02.617958 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.617933    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 13:45:02.621992 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.621628    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l","openshift-cluster-node-tuning-operator/tuned-ggcfw","openshift-dns/node-resolver-7cs2v","openshift-image-registry/node-ca-q8tb2","openshift-multus/multus-additional-cni-plugins-ctrfd","openshift-network-diagnostics/network-check-target-pjkk2","openshift-network-operator/iptables-alerter-s5lf2","kube-system/global-pull-secret-syncer-5dktc","kube-system/konnectivity-agent-tg8s4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal","openshift-multus/multus-rvp4l","openshift-multus/network-metrics-daemon-chsg7","openshift-ovn-kubernetes/ovnkube-node-8brz4"]
Jul 06 13:45:02.624407 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.624389    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:02.624513 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.624456    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:02.626546 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.626521    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:02.626650 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.626629    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:02.630393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.629993    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.630393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.630351    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 13:45:02.631899 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.631875    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:45:02.631994 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.631956    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2rrh\""
Jul 06 13:45:02.632815 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.632157    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.632815 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.632194    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 13:45:02.634507 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.634156    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 13:45:02.634507 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.634248    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 13:45:02.634507 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.634374    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ff7tj\""
Jul 06 13:45:02.636101 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.635401    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.637523 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.636952    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 13:45:02.637523 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.637249    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.638518    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h9bt7\""
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.638822    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.639083    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.639879    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.640125    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.640348    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g6t25\""
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.640561    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 13:45:02.641077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.640788    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 13:45:02.653972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.649696    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.653972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.649965    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.653972 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.650039    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:02.653972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.653424    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 13:45:02.653972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.653540    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.653972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.653678    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 13:45:02.653972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.653764    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 13:45:02.656222 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.656187    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 13:45:02.656324 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.656228    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 13:45:02.656387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.656359    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 13:45:02.656506 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.656447    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 13:45:02.656689 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.656674    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w4smv\""
Jul 06 13:45:02.656891 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.656837    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658038    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv648\" (UniqueName: \"kubernetes.io/projected/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-kube-api-access-sv648\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658335    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658360    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-host\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658406    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-modprobe-d\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658428    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-systemd\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79815274-4934-4461-96c6-4d18508d4482-etc-tuned\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgh4\" (UniqueName: \"kubernetes.io/projected/c892e645-514e-4b1f-9900-7f1ad7e03424-kube-api-access-ktgh4\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658559    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysconfig\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-sys\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2lnm\" (UniqueName: \"kubernetes.io/projected/3b4ded86-3754-4f04-9b08-77550d187284-kube-api-access-d2lnm\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658634    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-kubernetes\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658649    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysctl-d\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658654    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-run\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658681    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-lib-modules\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.658884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658703    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79815274-4934-4461-96c6-4d18508d4482-tmp\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c892e645-514e-4b1f-9900-7f1ad7e03424-hosts-file\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c892e645-514e-4b1f-9900-7f1ad7e03424-tmp-dir\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysctl-conf\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-var-lib-kubelet\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658821    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmz7\" (UniqueName: \"kubernetes.io/projected/79815274-4934-4461-96c6-4d18508d4482-kube-api-access-hvmz7\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-host\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.658864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-serviceca\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.659094    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.659335    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 13:45:02.659835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.659641    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xbwb2\""
Jul 06 13:45:02.660369 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.660270    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-skx7r\""
Jul 06 13:45:02.660539 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.660467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 13:45:02.662345 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.662326    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.664390 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.664371    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.664483 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.664407    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:45:02.664539 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.664505    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j7khd\""
Jul 06 13:45:02.664800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.664781    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 13:45:02.665134 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.665117    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 13:45:02.666196 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.666180    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 13:45:02.666751 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.666703    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxfs9\""
Jul 06 13:45:02.671493 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.671472    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jldkr"
Jul 06 13:45:02.680223 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.680184    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jldkr"
Jul 06 13:45:02.734177 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.734130    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 13:45:02.759051 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-serviceca\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.759222 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759070    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-ovn\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.759222 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759098    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4dc813de-ff33-4883-87e4-a91974e198ed-iptables-alerter-script\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.759222 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759173    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-conf-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.759387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759226    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-systemd\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.759387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-cnibin\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.759387 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759344    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-systemd\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.759527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-kubelet\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.759527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-sys\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.759527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759457    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7ea257d-bd74-4818-8bfd-42784778a617-dbus\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.759527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-run-netns\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.759527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759502    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.759527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-device-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4da1556-1259-4b19-918f-5fbf29dacc74-konnectivity-ca\") pod \"konnectivity-agent-tg8s4\" (UID: \"c4da1556-1259-4b19-918f-5fbf29dacc74\") " pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759556    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-serviceca\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759573    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dc813de-ff33-4883-87e4-a91974e198ed-host-slash\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-multus-certs\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759573    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-sys\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7ea257d-bd74-4818-8bfd-42784778a617-kubelet-config\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-var-lib-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-cni-bin\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.759798 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl7fs\" (UniqueName: \"kubernetes.io/projected/4dc813de-ff33-4883-87e4-a91974e198ed-kube-api-access-cl7fs\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759827    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-hostroot\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.759843    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759854    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-registration-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-host\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759927    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-host\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.759936    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:03.259890001 +0000 UTC m=+3.019861921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.759976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-env-overrides\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-socket-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-system-cni-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760122    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-cni-bin\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr2jc\" (UniqueName: \"kubernetes.io/projected/644a213a-11d6-4957-bfed-d2e268ac3979-kube-api-access-mr2jc\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.760199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-modprobe-d\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760254    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79815274-4934-4461-96c6-4d18508d4482-etc-tuned\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-kubelet\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760315    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cni-binary-copy\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-systemd-units\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760388    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovnkube-config\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-sys-fs\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760458    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-k8s-cni-cncf-io\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760344    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-modprobe-d\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-etc-kubernetes\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2lnm\" (UniqueName: \"kubernetes.io/projected/3b4ded86-3754-4f04-9b08-77550d187284-kube-api-access-d2lnm\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760558    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-kubernetes\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760559    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal" event={"ID":"ab9d31aec28a733c64bba49d46efd8ad","Type":"ContainerStarted","Data":"cf912ca6ea52b98d57b7b794f7e02f87f6c60bb32025dc4227443593add8d55d"}
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-log-socket\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760653    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-kubernetes\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.760889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760696    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovn-node-metrics-cert\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760782    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-socket-dir-parent\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysctl-conf\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-cni-netd\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760901    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4da1556-1259-4b19-918f-5fbf29dacc74-agent-certs\") pod \"konnectivity-agent-tg8s4\" (UID: \"c4da1556-1259-4b19-918f-5fbf29dacc74\") " pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-os-release\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-netns\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.760967    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-system-cni-dir\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cnibin\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761044    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysctl-conf\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgh4\" (UniqueName: \"kubernetes.io/projected/c892e645-514e-4b1f-9900-7f1ad7e03424-kube-api-access-ktgh4\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761091    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-cni-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761188    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qftv\" (UniqueName: \"kubernetes.io/projected/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-kube-api-access-6qftv\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.761649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9dx\" (UniqueName: \"kubernetes.io/projected/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-kube-api-access-rh9dx\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysctl-d\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761305    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c892e645-514e-4b1f-9900-7f1ad7e03424-hosts-file\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761338    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv648\" (UniqueName: \"kubernetes.io/projected/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-kube-api-access-sv648\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761362    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c892e645-514e-4b1f-9900-7f1ad7e03424-hosts-file\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-slash\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-node-log\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761568    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysctl-d\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761638    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-var-lib-kubelet\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmz7\" (UniqueName: \"kubernetes.io/projected/79815274-4934-4461-96c6-4d18508d4482-kube-api-access-hvmz7\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761690    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-etc-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761717    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-var-lib-kubelet\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-daemon-config\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgd8x\" (UniqueName: \"kubernetes.io/projected/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-kube-api-access-kgd8x\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-os-release\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.762398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761873    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-host\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.763230 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.763230 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.763230 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.762232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysconfig\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.763230 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.762274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-systemd\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.763230 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.762306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovnkube-script-lib\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.761961    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-host\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.762337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-cni-binary-copy\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.763908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-cni-multus\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.763940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-run\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.763950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" event={"ID":"bb30839cb03c9062603e1f5c43528128","Type":"ContainerStarted","Data":"48c99f82f4321c64b4072802b8447f3cf1e2716f2fe3dba4c7a20373f13fc050"}
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.763958    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-etc-sysconfig\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.763972    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-lib-modules\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.764052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.764003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79815274-4934-4461-96c6-4d18508d4482-tmp\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.764506 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.764131    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-run\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.764506 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.764248    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79815274-4934-4461-96c6-4d18508d4482-lib-modules\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.764506 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.764287    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c892e645-514e-4b1f-9900-7f1ad7e03424-tmp-dir\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.764648 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.764600    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c892e645-514e-4b1f-9900-7f1ad7e03424-tmp-dir\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.766219 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.764950    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79815274-4934-4461-96c6-4d18508d4482-etc-tuned\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.768782 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.768752    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79815274-4934-4461-96c6-4d18508d4482-tmp\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.775450 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.774941    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:45:02.775450 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.774967    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:45:02.775450 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.774981    2572 projected.go:196] Error preparing data for projected volume kube-api-access-q7trc for pod openshift-network-diagnostics/network-check-target-pjkk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:02.775450 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.775044    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc podName:65cecc0b-4040-41ff-8f67-0d7815c5588c nodeName:}" failed. No retries permitted until 2026-07-06 13:45:03.275028143 +0000 UTC m=+3.035000062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q7trc" (UniqueName: "kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc") pod "network-check-target-pjkk2" (UID: "65cecc0b-4040-41ff-8f67-0d7815c5588c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:02.776479 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.776437    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2lnm\" (UniqueName: \"kubernetes.io/projected/3b4ded86-3754-4f04-9b08-77550d187284-kube-api-access-d2lnm\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:02.777689 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.777599    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmz7\" (UniqueName: \"kubernetes.io/projected/79815274-4934-4461-96c6-4d18508d4482-kube-api-access-hvmz7\") pod \"tuned-ggcfw\" (UID: \"79815274-4934-4461-96c6-4d18508d4482\") " pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.778319 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.778297    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv648\" (UniqueName: \"kubernetes.io/projected/85d53bd5-9d3e-470e-9ca7-c8ffd85daba1-kube-api-access-sv648\") pod \"node-ca-q8tb2\" (UID: \"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1\") " pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.778555 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.778476    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgh4\" (UniqueName: \"kubernetes.io/projected/c892e645-514e-4b1f-9900-7f1ad7e03424-kube-api-access-ktgh4\") pod \"node-resolver-7cs2v\" (UID: \"c892e645-514e-4b1f-9900-7f1ad7e03424\") " pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.865176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865120    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-cni-binary-copy\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865176 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-cni-multus\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-ovn\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865258    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-ovn\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865300    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-cni-multus\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4dc813de-ff33-4883-87e4-a91974e198ed-iptables-alerter-script\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-conf-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865369    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-cnibin\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865391    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-kubelet\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865426 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7ea257d-bd74-4818-8bfd-42784778a617-dbus\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865436    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-run-netns\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-device-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865487    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-cnibin\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865509    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4da1556-1259-4b19-918f-5fbf29dacc74-konnectivity-ca\") pod \"konnectivity-agent-tg8s4\" (UID: \"c4da1556-1259-4b19-918f-5fbf29dacc74\") " pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dc813de-ff33-4883-87e4-a91974e198ed-host-slash\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865555    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-multus-certs\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865554    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-kubelet\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7ea257d-bd74-4818-8bfd-42784778a617-kubelet-config\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-var-lib-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865636    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7ea257d-bd74-4818-8bfd-42784778a617-dbus\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-cni-bin\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865658    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-run-netns\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865674    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-cni-bin\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865697    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865615    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-conf-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.865802 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865719    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dc813de-ff33-4883-87e4-a91974e198ed-host-slash\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865723    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-device-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865745    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-multus-certs\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865676    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl7fs\" (UniqueName: \"kubernetes.io/projected/4dc813de-ff33-4883-87e4-a91974e198ed-kube-api-access-cl7fs\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865746    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-cni-binary-copy\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865769    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-var-lib-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-hostroot\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865780    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7ea257d-bd74-4818-8bfd-42784778a617-kubelet-config\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865806    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-registration-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865859    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-env-overrides\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865877    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-hostroot\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865890    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-registration-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865897    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4dc813de-ff33-4883-87e4-a91974e198ed-iptables-alerter-script\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865881    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-socket-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865913    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-system-cni-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.866747 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-cni-bin\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr2jc\" (UniqueName: \"kubernetes.io/projected/644a213a-11d6-4957-bfed-d2e268ac3979-kube-api-access-mr2jc\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.865988    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-socket-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866005    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-kubelet\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866028    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-var-lib-cni-bin\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866033    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-system-cni-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cni-binary-copy\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866072    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-kubelet\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866093    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-systemd-units\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866116    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovnkube-config\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-sys-fs\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866161    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-k8s-cni-cncf-io\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866170    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-systemd-units\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.866142    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866234    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-etc-kubernetes\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866241    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-sys-fs\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866268    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4da1556-1259-4b19-918f-5fbf29dacc74-konnectivity-ca\") pod \"konnectivity-agent-tg8s4\" (UID: \"c4da1556-1259-4b19-918f-5fbf29dacc74\") " pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:02.867578 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866276    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-k8s-cni-cncf-io\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-etc-kubernetes\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:02.866272    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret podName:b7ea257d-bd74-4818-8bfd-42784778a617 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:03.366254805 +0000 UTC m=+3.126226719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret") pod "global-pull-secret-syncer-5dktc" (UID: "b7ea257d-bd74-4818-8bfd-42784778a617") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-log-socket\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866356    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-env-overrides\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovn-node-metrics-cert\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866432    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-socket-dir-parent\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866434    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-log-socket\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866489    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-socket-dir-parent\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-cni-netd\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866542    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866578    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cni-binary-copy\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4da1556-1259-4b19-918f-5fbf29dacc74-agent-certs\") pod \"konnectivity-agent-tg8s4\" (UID: \"c4da1556-1259-4b19-918f-5fbf29dacc74\") " pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866620    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-cni-netd\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866630    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-os-release\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866657    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-netns\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.868520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866671    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovnkube-config\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-system-cni-dir\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866714    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cnibin\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866725    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-host-run-netns\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866739    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-cni-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866744    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-system-cni-dir\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866746    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-os-release\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866775    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cnibin\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qftv\" (UniqueName: \"kubernetes.io/projected/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-kube-api-access-6qftv\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866805    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-cni-dir\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866863    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9dx\" (UniqueName: \"kubernetes.io/projected/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-kube-api-access-rh9dx\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-slash\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-node-log\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866977    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-slash\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.866981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-etc-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.869393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867015    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-etc-openvswitch\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867019    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-node-log\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867068    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-daemon-config\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgd8x\" (UniqueName: \"kubernetes.io/projected/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-kube-api-access-kgd8x\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867158    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-os-release\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867164    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867184    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867256    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-systemd\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867258    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/644a213a-11d6-4957-bfed-d2e268ac3979-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867230    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867300    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-run-systemd\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867328    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovnkube-script-lib\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867416    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-os-release\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867648    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.870171 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867671    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-multus-daemon-config\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.870983 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.867770    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovnkube-script-lib\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870983 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.869098    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-ovn-node-metrics-cert\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.870983 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.869482    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4da1556-1259-4b19-918f-5fbf29dacc74-agent-certs\") pod \"konnectivity-agent-tg8s4\" (UID: \"c4da1556-1259-4b19-918f-5fbf29dacc74\") " pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:02.875476 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.875451    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl7fs\" (UniqueName: \"kubernetes.io/projected/4dc813de-ff33-4883-87e4-a91974e198ed-kube-api-access-cl7fs\") pod \"iptables-alerter-s5lf2\" (UID: \"4dc813de-ff33-4883-87e4-a91974e198ed\") " pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:02.875645 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.875557    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr2jc\" (UniqueName: \"kubernetes.io/projected/644a213a-11d6-4957-bfed-d2e268ac3979-kube-api-access-mr2jc\") pod \"aws-ebs-csi-driver-node-n6r5l\" (UID: \"644a213a-11d6-4957-bfed-d2e268ac3979\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:02.882009 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.881986    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9dx\" (UniqueName: \"kubernetes.io/projected/f78ce5db-d179-4a36-bbd7-bf2dd0fd8328-kube-api-access-rh9dx\") pod \"multus-additional-cni-plugins-ctrfd\" (UID: \"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328\") " pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.882173 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.882154    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qftv\" (UniqueName: \"kubernetes.io/projected/52c20f11-1a60-4c0e-8b69-9e2d4dcd552e-kube-api-access-6qftv\") pod \"ovnkube-node-8brz4\" (UID: \"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:02.882396 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.882378    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgd8x\" (UniqueName: \"kubernetes.io/projected/c9ed9dc5-05d6-4bc1-965e-fce30d57fb63-kube-api-access-kgd8x\") pod \"multus-rvp4l\" (UID: \"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63\") " pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:02.958730 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.958689    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggcfw"
Jul 06 13:45:02.965271 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.965199    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7cs2v"
Jul 06 13:45:02.975027 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.975002    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8tb2"
Jul 06 13:45:02.981942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.981915    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ctrfd"
Jul 06 13:45:02.994653 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:02.994633    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:03.002320 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.002297    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l"
Jul 06 13:45:03.011094 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.011073    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:03.018804 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.018751    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s5lf2"
Jul 06 13:45:03.025521 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.025502    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rvp4l"
Jul 06 13:45:03.270483 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.270407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:03.270617 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.270579    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:03.270672 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.270654    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:04.270633893 +0000 UTC m=+4.030605806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:03.371661 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.371629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:03.371846 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.371673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:03.371846 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.371772    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:03.371846 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.371798    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:45:03.371846 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.371816    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:45:03.371846 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.371828    2572 projected.go:196] Error preparing data for projected volume kube-api-access-q7trc for pod openshift-network-diagnostics/network-check-target-pjkk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:03.371846 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.371849    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret podName:b7ea257d-bd74-4818-8bfd-42784778a617 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:04.371830948 +0000 UTC m=+4.131802848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret") pod "global-pull-secret-syncer-5dktc" (UID: "b7ea257d-bd74-4818-8bfd-42784778a617") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:03.372090 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.371872    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc podName:65cecc0b-4040-41ff-8f67-0d7815c5588c nodeName:}" failed. No retries permitted until 2026-07-06 13:45:04.37185655 +0000 UTC m=+4.131828466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7trc" (UniqueName: "kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc") pod "network-check-target-pjkk2" (UID: "65cecc0b-4040-41ff-8f67-0d7815c5588c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:03.683221 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.683164    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:40:02 +0000 UTC" deadline="2028-02-17 09:53:33.268531179 +0000 UTC"
Jul 06 13:45:03.683221 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.683227    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14180h8m29.585326788s"
Jul 06 13:45:03.755696 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:03.755670    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:03.755829 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:03.755761    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:03.785036 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.784817    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c20f11_1a60_4c0e_8b69_9e2d4dcd552e.slice/crio-6b3b7db19dd61c665a88aeb5c121b6f8ec7e70d55a8dee2e04eb45eb67c49c72 WatchSource:0}: Error finding container 6b3b7db19dd61c665a88aeb5c121b6f8ec7e70d55a8dee2e04eb45eb67c49c72: Status 404 returned error can't find the container with id 6b3b7db19dd61c665a88aeb5c121b6f8ec7e70d55a8dee2e04eb45eb67c49c72
Jul 06 13:45:03.786740 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.786592    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4da1556_1259_4b19_918f_5fbf29dacc74.slice/crio-a489bb507c2292fda70bc06218caf85a0e9eb8db76ca712962f6672a75a49bb8 WatchSource:0}: Error finding container a489bb507c2292fda70bc06218caf85a0e9eb8db76ca712962f6672a75a49bb8: Status 404 returned error can't find the container with id a489bb507c2292fda70bc06218caf85a0e9eb8db76ca712962f6672a75a49bb8
Jul 06 13:45:03.787945 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.787910    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79815274_4934_4461_96c6_4d18508d4482.slice/crio-63f08ede7d651a1f950ca02b6381cd8ab8901255be9802aff75772b9657a25e9 WatchSource:0}: Error finding container 63f08ede7d651a1f950ca02b6381cd8ab8901255be9802aff75772b9657a25e9: Status 404 returned error can't find the container with id 63f08ede7d651a1f950ca02b6381cd8ab8901255be9802aff75772b9657a25e9
Jul 06 13:45:03.789393 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.789324    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78ce5db_d179_4a36_bbd7_bf2dd0fd8328.slice/crio-3a3a7ab4c5da49358fd751456f7b7b72fc44e8259b06740f9122039deb718856 WatchSource:0}: Error finding container 3a3a7ab4c5da49358fd751456f7b7b72fc44e8259b06740f9122039deb718856: Status 404 returned error can't find the container with id 3a3a7ab4c5da49358fd751456f7b7b72fc44e8259b06740f9122039deb718856
Jul 06 13:45:03.791992 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.791962    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc892e645_514e_4b1f_9900_7f1ad7e03424.slice/crio-4db0a09d13dfd7544cbbb62062ec4b7d021db66c2fcd01755f7c8763f1527b31 WatchSource:0}: Error finding container 4db0a09d13dfd7544cbbb62062ec4b7d021db66c2fcd01755f7c8763f1527b31: Status 404 returned error can't find the container with id 4db0a09d13dfd7544cbbb62062ec4b7d021db66c2fcd01755f7c8763f1527b31
Jul 06 13:45:03.794415 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.794387    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644a213a_11d6_4957_bfed_d2e268ac3979.slice/crio-baa1497e39214975c277ef486612dce89fa1c29896ba9e7bcb3092023b0bb292 WatchSource:0}: Error finding container baa1497e39214975c277ef486612dce89fa1c29896ba9e7bcb3092023b0bb292: Status 404 returned error can't find the container with id baa1497e39214975c277ef486612dce89fa1c29896ba9e7bcb3092023b0bb292
Jul 06 13:45:03.795834 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.795787    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d53bd5_9d3e_470e_9ca7_c8ffd85daba1.slice/crio-cee62ff19131e467d060c564e6db9a95bcfdd9811ab634068293e6bf4d8fd458 WatchSource:0}: Error finding container cee62ff19131e467d060c564e6db9a95bcfdd9811ab634068293e6bf4d8fd458: Status 404 returned error can't find the container with id cee62ff19131e467d060c564e6db9a95bcfdd9811ab634068293e6bf4d8fd458
Jul 06 13:45:03.797281 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.797131    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc813de_ff33_4883_87e4_a91974e198ed.slice/crio-86641c71dff474b94d1b0a3727bc1d893761610cff503336c185d8278c280633 WatchSource:0}: Error finding container 86641c71dff474b94d1b0a3727bc1d893761610cff503336c185d8278c280633: Status 404 returned error can't find the container with id 86641c71dff474b94d1b0a3727bc1d893761610cff503336c185d8278c280633
Jul 06 13:45:03.797719 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:03.797648    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ed9dc5_05d6_4bc1_965e_fce30d57fb63.slice/crio-ff3acf3a8c48fcfc6a22e34a3ce23c77bc37372989a2073f1e591b7e3ef766b7 WatchSource:0}: Error finding container ff3acf3a8c48fcfc6a22e34a3ce23c77bc37372989a2073f1e591b7e3ef766b7: Status 404 returned error can't find the container with id ff3acf3a8c48fcfc6a22e34a3ce23c77bc37372989a2073f1e591b7e3ef766b7
Jul 06 13:45:04.278336 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.278247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:04.278497 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.278447    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:04.278568 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.278510    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:06.278491473 +0000 UTC m=+6.038463376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.379666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.379719    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.379865    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.379883    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.379895    2572 projected.go:196] Error preparing data for projected volume kube-api-access-q7trc for pod openshift-network-diagnostics/network-check-target-pjkk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.379951    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc podName:65cecc0b-4040-41ff-8f67-0d7815c5588c nodeName:}" failed. No retries permitted until 2026-07-06 13:45:06.379932746 +0000 UTC m=+6.139904650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7trc" (UniqueName: "kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc") pod "network-check-target-pjkk2" (UID: "65cecc0b-4040-41ff-8f67-0d7815c5588c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.380356    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:04.380442 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.380404    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret podName:b7ea257d-bd74-4818-8bfd-42784778a617 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:06.380389701 +0000 UTC m=+6.140361604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret") pod "global-pull-secret-syncer-5dktc" (UID: "b7ea257d-bd74-4818-8bfd-42784778a617") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:04.453187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.452910    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 13:45:04.683691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.683599    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:40:02 +0000 UTC" deadline="2028-04-11 23:38:29.312208354 +0000 UTC"
Jul 06 13:45:04.683691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.683659    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15489h53m24.628553377s"
Jul 06 13:45:04.756833 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.756337    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:04.756833 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.756469    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:04.757370 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.757149    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:04.757370 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:04.757285    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:04.773398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.772711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal" event={"ID":"ab9d31aec28a733c64bba49d46efd8ad","Type":"ContainerStarted","Data":"29fb5a7bef9919fcc7644dbbfc91ea8e9fafa9fc543c9a0bb55f17ee7bf875fd"}
Jul 06 13:45:04.789657 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.787293    2572 generic.go:356] "Generic (PLEG): container finished" podID="bb30839cb03c9062603e1f5c43528128" containerID="bbc01ba26ee8c48341dcc7e45ff57af004126564689f4a9d93c7eaf5bf8c1ca4" exitCode=0
Jul 06 13:45:04.789657 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.787386    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" event={"ID":"bb30839cb03c9062603e1f5c43528128","Type":"ContainerDied","Data":"bbc01ba26ee8c48341dcc7e45ff57af004126564689f4a9d93c7eaf5bf8c1ca4"}
Jul 06 13:45:04.789657 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.788524    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal" podStartSLOduration=2.788506214 podStartE2EDuration="2.788506214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:04.788292811 +0000 UTC m=+4.548264734" watchObservedRunningTime="2026-07-06 13:45:04.788506214 +0000 UTC m=+4.548478142"
Jul 06 13:45:04.797123 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.797048    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8tb2" event={"ID":"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1","Type":"ContainerStarted","Data":"cee62ff19131e467d060c564e6db9a95bcfdd9811ab634068293e6bf4d8fd458"}
Jul 06 13:45:04.801340 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.801264    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rvp4l" event={"ID":"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63","Type":"ContainerStarted","Data":"ff3acf3a8c48fcfc6a22e34a3ce23c77bc37372989a2073f1e591b7e3ef766b7"}
Jul 06 13:45:04.810115 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.810028    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l" event={"ID":"644a213a-11d6-4957-bfed-d2e268ac3979","Type":"ContainerStarted","Data":"baa1497e39214975c277ef486612dce89fa1c29896ba9e7bcb3092023b0bb292"}
Jul 06 13:45:04.812574 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.812493    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerStarted","Data":"3a3a7ab4c5da49358fd751456f7b7b72fc44e8259b06740f9122039deb718856"}
Jul 06 13:45:04.823835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.823802    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tg8s4" event={"ID":"c4da1556-1259-4b19-918f-5fbf29dacc74","Type":"ContainerStarted","Data":"a489bb507c2292fda70bc06218caf85a0e9eb8db76ca712962f6672a75a49bb8"}
Jul 06 13:45:04.826903 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.826877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5lf2" event={"ID":"4dc813de-ff33-4883-87e4-a91974e198ed","Type":"ContainerStarted","Data":"86641c71dff474b94d1b0a3727bc1d893761610cff503336c185d8278c280633"}
Jul 06 13:45:04.837695 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.837626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7cs2v" event={"ID":"c892e645-514e-4b1f-9900-7f1ad7e03424","Type":"ContainerStarted","Data":"4db0a09d13dfd7544cbbb62062ec4b7d021db66c2fcd01755f7c8763f1527b31"}
Jul 06 13:45:04.842399 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.842327    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggcfw" event={"ID":"79815274-4934-4461-96c6-4d18508d4482","Type":"ContainerStarted","Data":"63f08ede7d651a1f950ca02b6381cd8ab8901255be9802aff75772b9657a25e9"}
Jul 06 13:45:04.860756 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:04.860720    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"6b3b7db19dd61c665a88aeb5c121b6f8ec7e70d55a8dee2e04eb45eb67c49c72"}
Jul 06 13:45:05.755696 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:05.755109    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:05.755696 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:05.755252    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:05.873719 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:05.873650    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" event={"ID":"bb30839cb03c9062603e1f5c43528128","Type":"ContainerStarted","Data":"00094e42631187198a136e3f2a0420ede995f78a17063f06d92a36d7f744e6d9"}
Jul 06 13:45:06.295516 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:06.294919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:06.295516 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.295114    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:06.295516 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.295177    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:10.29515875 +0000 UTC m=+10.055130652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:06.396184 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:06.395950    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:06.396184 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:06.395997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:06.396184 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.396134    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:06.396475 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.396225    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret podName:b7ea257d-bd74-4818-8bfd-42784778a617 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:10.39618741 +0000 UTC m=+10.156159323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret") pod "global-pull-secret-syncer-5dktc" (UID: "b7ea257d-bd74-4818-8bfd-42784778a617") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:06.404258 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.396143    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:45:06.404394 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.404285    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:45:06.404394 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.404309    2572 projected.go:196] Error preparing data for projected volume kube-api-access-q7trc for pod openshift-network-diagnostics/network-check-target-pjkk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:06.404512 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.404383    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc podName:65cecc0b-4040-41ff-8f67-0d7815c5588c nodeName:}" failed. No retries permitted until 2026-07-06 13:45:10.40436209 +0000 UTC m=+10.164333992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7trc" (UniqueName: "kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc") pod "network-check-target-pjkk2" (UID: "65cecc0b-4040-41ff-8f67-0d7815c5588c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:06.757723 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:06.757197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:06.757723 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.757358    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:06.758277 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:06.757903    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:06.758277 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:06.758127    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:07.756000 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:07.755701    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:07.756000 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:07.755833    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:08.757168 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:08.757099    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:08.757607 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:08.757100    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:08.757607 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:08.757225    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:08.757607 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:08.757325    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:09.755237 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:09.755024    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:09.755237 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:09.755163    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:10.330632 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:10.330487    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:10.331189 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.330694    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:10.331189 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.330771    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:18.330751513 +0000 UTC m=+18.090723418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:10.431755 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:10.431490    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:10.431755 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:10.431546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:10.431755 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.431668    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:10.431755 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.431684    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:45:10.431755 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.431698    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:45:10.431755 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.431711    2572 projected.go:196] Error preparing data for projected volume kube-api-access-q7trc for pod openshift-network-diagnostics/network-check-target-pjkk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:10.431755 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.431751    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret podName:b7ea257d-bd74-4818-8bfd-42784778a617 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:18.431728791 +0000 UTC m=+18.191700715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret") pod "global-pull-secret-syncer-5dktc" (UID: "b7ea257d-bd74-4818-8bfd-42784778a617") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:10.432165 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.431773    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc podName:65cecc0b-4040-41ff-8f67-0d7815c5588c nodeName:}" failed. No retries permitted until 2026-07-06 13:45:18.431763623 +0000 UTC m=+18.191735525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7trc" (UniqueName: "kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc") pod "network-check-target-pjkk2" (UID: "65cecc0b-4040-41ff-8f67-0d7815c5588c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:10.756434 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:10.756394    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:10.756611 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.756518    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:10.756889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:10.756739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:10.756889 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:10.756855    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:11.755250 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:11.755224    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:11.755542 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:11.755350    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:12.755293 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:12.755260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:12.755736 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:12.755260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:12.755736 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:12.755434    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:12.755736 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:12.755465    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:13.755356 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:13.755322    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:13.755797 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:13.755445    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:14.755488 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:14.755457    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:14.755956 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:14.755456    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:14.755956 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:14.755588    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:14.755956 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:14.755698    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:15.756024 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:15.755981    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:15.756519 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:15.756115    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:16.755451 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:16.755418    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:16.755647 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:16.755551    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:16.755647 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:16.755600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:16.755759 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:16.755715    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:17.755279 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:17.755244    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:17.755711 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:17.755392    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:18.389112 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:18.389073    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:18.389334 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.389229    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:18.389334 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.389292    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:34.38927551 +0000 UTC m=+34.149247410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:18.490198 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:18.490163    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:18.490198 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:18.490202    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:18.490400 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.490312    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:18.490400 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.490379    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret podName:b7ea257d-bd74-4818-8bfd-42784778a617 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:34.490360443 +0000 UTC m=+34.250332342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret") pod "global-pull-secret-syncer-5dktc" (UID: "b7ea257d-bd74-4818-8bfd-42784778a617") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:18.490400 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.490318    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:45:18.490552 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.490411    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:45:18.490552 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.490421    2572 projected.go:196] Error preparing data for projected volume kube-api-access-q7trc for pod openshift-network-diagnostics/network-check-target-pjkk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:18.490552 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.490459    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc podName:65cecc0b-4040-41ff-8f67-0d7815c5588c nodeName:}" failed. No retries permitted until 2026-07-06 13:45:34.490449603 +0000 UTC m=+34.250421503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7trc" (UniqueName: "kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc") pod "network-check-target-pjkk2" (UID: "65cecc0b-4040-41ff-8f67-0d7815c5588c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:18.757364 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:18.757298    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:18.757716 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:18.757298    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:18.757716 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.757399    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:18.757716 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:18.757472    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:19.755743 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:19.755710    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:19.755916 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:19.755820    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:20.756056 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:20.755996    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:20.756558 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:20.756111    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:20.756558 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:20.756171    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:20.756558 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:20.756303    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:21.754974 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:21.754946    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:21.755163 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:21.755052    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:22.758239 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.758010    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:22.758595 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:22.758363    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:22.758871 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.758721    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:22.758871 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:22.758829    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:22.911908 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.911875    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rvp4l" event={"ID":"c9ed9dc5-05d6-4bc1-965e-fce30d57fb63","Type":"ContainerStarted","Data":"011d05c39b7d1e7af4427115a2de409829fbfce0e536c1f2179f781265add201"}
Jul 06 13:45:22.914110 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.914078    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggcfw" event={"ID":"79815274-4934-4461-96c6-4d18508d4482","Type":"ContainerStarted","Data":"55cb71cb6ad7975154b8eec8d624ad09743f3b83b47af6aeffaaba69eb7b961b"}
Jul 06 13:45:22.918056 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.918025    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"2259b6aa7905644e191b30fefa263bc19510731701f9373c6e0ebbcd2e21ae9b"}
Jul 06 13:45:22.931030 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.930971    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" podStartSLOduration=20.930950985 podStartE2EDuration="20.930950985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:05.890562613 +0000 UTC m=+5.650534537" watchObservedRunningTime="2026-07-06 13:45:22.930950985 +0000 UTC m=+22.690922973"
Jul 06 13:45:22.931172 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.931084    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rvp4l" podStartSLOduration=3.958920065 podStartE2EDuration="22.931074183s" totalImagesPullingTime="18.972154118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:22.930788069 +0000 UTC m=+22.690759992" watchObservedRunningTime="2026-07-06 13:45:22.931074183 +0000 UTC m=+22.691046125"
Jul 06 13:45:22.951830 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:22.951775    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ggcfw" podStartSLOduration=4.02247164 podStartE2EDuration="22.951752902s" totalImagesPullingTime="18.929281262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:22.951615545 +0000 UTC m=+22.711587484" watchObservedRunningTime="2026-07-06 13:45:22.951752902 +0000 UTC m=+22.711724807"
Jul 06 13:45:23.756037 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.755843    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:23.756250 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:23.756110    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:23.921066 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.921015    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8tb2" event={"ID":"85d53bd5-9d3e-470e-9ca7-c8ffd85daba1","Type":"ContainerStarted","Data":"33c25c1247d8024ad96dad5dde048a03e45c6825b8772c7b3e3377bc85b33259"}
Jul 06 13:45:23.922445 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.922422    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l" event={"ID":"644a213a-11d6-4957-bfed-d2e268ac3979","Type":"ContainerStarted","Data":"8e1f3de663b86ebc9f769ac0b47a54d29ef38a96f2b720654b2c460ee72b6876"}
Jul 06 13:45:23.923841 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.923819    2572 generic.go:356] "Generic (PLEG): container finished" podID="f78ce5db-d179-4a36-bbd7-bf2dd0fd8328" containerID="f03669cff98098a5281dd2019655ee93289eaf1a36630ca96fa3ffb46cb5cf6d" exitCode=0
Jul 06 13:45:23.923924 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.923880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerDied","Data":"f03669cff98098a5281dd2019655ee93289eaf1a36630ca96fa3ffb46cb5cf6d"}
Jul 06 13:45:23.925504 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.925387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tg8s4" event={"ID":"c4da1556-1259-4b19-918f-5fbf29dacc74","Type":"ContainerStarted","Data":"0051632de38faa3dd165328654bfb2cf65ea950bda3aa28ebb18b4dae14816b1"}
Jul 06 13:45:23.926866 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.926756    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7cs2v" event={"ID":"c892e645-514e-4b1f-9900-7f1ad7e03424","Type":"ContainerStarted","Data":"2cadaeda7f66fdbf45ba8948610e9912c2ba5b3dfe6074c99f878bd6b646097e"}
Jul 06 13:45:23.929385 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.929362    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"81437acd69656069d315f22aa2282dc1c3841ae6946dd2e347eaf6bf8912f976"}
Jul 06 13:45:23.929466 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.929435    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"40d5e2ff8662f9df6c0a66350321b2284f4e63529465eb13440944025c04b2d4"}
Jul 06 13:45:23.929502 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.929474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"0b63e286438b2e63a2accde7e0c1e009bb89bc454bbd9164982917c08f7625f3"}
Jul 06 13:45:23.929535 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.929509    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"e793acb10ca2f961cc73682091b577d128712b811a39423a4a982edf79693fe4"}
Jul 06 13:45:23.929566 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.929543    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"922ff14e849ab71777b4be3de2fcd482f7a80097a1ce4b3d460822d2c7995a14"}
Jul 06 13:45:23.936654 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.936618    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q8tb2" podStartSLOduration=13.346091678 podStartE2EDuration="23.936607395s" totalImagesPullingTime="10.590515717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:23.936583088 +0000 UTC m=+23.696555000" watchObservedRunningTime="2026-07-06 13:45:23.936607395 +0000 UTC m=+23.696579317"
Jul 06 13:45:23.951697 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.951647    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7cs2v" podStartSLOduration=5.029663659 podStartE2EDuration="23.95163449s" totalImagesPullingTime="18.921970831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:23.951557473 +0000 UTC m=+23.711529395" watchObservedRunningTime="2026-07-06 13:45:23.95163449 +0000 UTC m=+23.711606412"
Jul 06 13:45:23.986833 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:23.986787    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tg8s4" podStartSLOduration=5.05819439 podStartE2EDuration="23.986770304s" totalImagesPullingTime="18.928575914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:23.986494036 +0000 UTC m=+23.746465957" watchObservedRunningTime="2026-07-06 13:45:23.986770304 +0000 UTC m=+23.746742226"
Jul 06 13:45:24.216359 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.216088    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 13:45:24.322841 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.322805    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:24.323477 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.323457    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:24.707179 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.706836    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T13:45:24.216109309Z","UUID":"bc2faa59-1d1e-4aa7-8b34-c077ccb4e607","Handler":null,"Name":"","Endpoint":""}
Jul 06 13:45:24.708329 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.708310    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 13:45:24.708469 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.708351    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 13:45:24.755266 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.755231    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:24.755440 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:24.755361    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:24.755572 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.755550    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:24.755690 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:24.755667    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:24.933407 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.933365    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l" event={"ID":"644a213a-11d6-4957-bfed-d2e268ac3979","Type":"ContainerStarted","Data":"0b3b39b208fce80fc9a53e42603480a784edf8801c6a0d887de0d306dba109de"}
Jul 06 13:45:24.935116 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.935085    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s5lf2" event={"ID":"4dc813de-ff33-4883-87e4-a91974e198ed","Type":"ContainerStarted","Data":"065fbccb286124cc81971cab7fb472dde54c3fbe16601aa1c86e027839cbd95f"}
Jul 06 13:45:24.935650 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.935629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:24.936029 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.936012    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tg8s4"
Jul 06 13:45:24.961651 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:24.961573    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s5lf2" podStartSLOduration=6.043104141 podStartE2EDuration="24.961560448s" totalImagesPullingTime="18.918456307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:24.948507372 +0000 UTC m=+24.708479294" watchObservedRunningTime="2026-07-06 13:45:24.961560448 +0000 UTC m=+24.721532435"
Jul 06 13:45:25.754986 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:25.754958    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:25.755162 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:25.755081    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:25.940199 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:25.940162    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l" event={"ID":"644a213a-11d6-4957-bfed-d2e268ac3979","Type":"ContainerStarted","Data":"94ad4fe2f5d39210f4181feccfc84dc185bf60e73392d650166cf16e5302b9d8"}
Jul 06 13:45:25.944161 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:25.944127    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"5a7dba8f21d48ef368a121efe9daf8540212e94f0d615cea03c3045624456268"}
Jul 06 13:45:25.959873 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:25.959825    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6r5l" podStartSLOduration=4.8705889540000005 podStartE2EDuration="25.959811375s" totalImagesPullingTime="21.089222421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:25.959609201 +0000 UTC m=+25.719581124" watchObservedRunningTime="2026-07-06 13:45:25.959811375 +0000 UTC m=+25.719783310"
Jul 06 13:45:26.756027 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:26.755996    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:26.756232 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:26.755996    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:26.756232 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:26.756133    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:26.756360 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:26.756226    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:27.755393 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:27.755357    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:27.756143 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:27.755484    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:27.953517 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:27.953279    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" event={"ID":"52c20f11-1a60-4c0e-8b69-9e2d4dcd552e","Type":"ContainerStarted","Data":"cc2707152a705d6396ca9428dd40b45e5cb61ab91b5a093b351ff5f99db55aee"}
Jul 06 13:45:27.953732 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:27.953599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:27.953732 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:27.953660    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:27.972234 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:27.972121    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:27.993904 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:27.993844    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4" podStartSLOduration=8.988504335 podStartE2EDuration="27.993827768s" totalImagesPullingTime="19.005323433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:27.993662042 +0000 UTC m=+27.753633965" watchObservedRunningTime="2026-07-06 13:45:27.993827768 +0000 UTC m=+27.753799723"
Jul 06 13:45:28.755261 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:28.755166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:28.755415 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:28.755322    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:28.755415 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:28.755393    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:28.755840 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:28.755516    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:28.956351 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:28.956295    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:28.972806 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:28.972782    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:45:29.755651 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:29.755623    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:29.755964 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:29.755723    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:30.162610 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.162429    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5dktc"]
Jul 06 13:45:30.162809 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.162707    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:30.162873 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:30.162828    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:30.165281 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.165253    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pjkk2"]
Jul 06 13:45:30.165407 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.165330    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:30.165480 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:30.165410    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:30.168284 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.168178    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chsg7"]
Jul 06 13:45:30.168284 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.168279    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:30.168421 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:30.168354    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:30.962580 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.962548    2572 generic.go:356] "Generic (PLEG): container finished" podID="f78ce5db-d179-4a36-bbd7-bf2dd0fd8328" containerID="a9cca2d863d51b79f0aa0e184ef0fa5989de534d4cb107717a7cd5f42be22eae" exitCode=0
Jul 06 13:45:30.963254 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:30.962630    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerDied","Data":"a9cca2d863d51b79f0aa0e184ef0fa5989de534d4cb107717a7cd5f42be22eae"}
Jul 06 13:45:31.756001 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:31.755968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:31.756174 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:31.756089    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:31.756174 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:31.756099    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:31.756174 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:31.756146    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:31.756353 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:31.756251    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:31.756353 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:31.756344    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:32.968973 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:32.968941    2572 generic.go:356] "Generic (PLEG): container finished" podID="f78ce5db-d179-4a36-bbd7-bf2dd0fd8328" containerID="f25c4757737c4b196506d6478fcc9e5360f840a718994cd83d5bf8e90017ab42" exitCode=0
Jul 06 13:45:32.969588 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:32.969008    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerDied","Data":"f25c4757737c4b196506d6478fcc9e5360f840a718994cd83d5bf8e90017ab42"}
Jul 06 13:45:33.755362 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:33.755153    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:33.755500 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:33.755173    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:33.755500 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:33.755439    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:33.755574 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:33.755191    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:33.755574 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:33.755508    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:33.755635 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:33.755584    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:33.973581 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:33.973545    2572 generic.go:356] "Generic (PLEG): container finished" podID="f78ce5db-d179-4a36-bbd7-bf2dd0fd8328" containerID="9b03b0a4fcebb5480352fab932849c59e85badc2c504b461c8d1947dedb87ce5" exitCode=0
Jul 06 13:45:33.973936 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:33.973601    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerDied","Data":"9b03b0a4fcebb5480352fab932849c59e85badc2c504b461c8d1947dedb87ce5"}
Jul 06 13:45:34.404069 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:34.404024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:34.404259 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.404157    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:34.404259 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.404248    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.404228736 +0000 UTC m=+66.164200656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 13:45:34.505303 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:34.505272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:34.505440 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:34.505313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:34.505495 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.505439    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:34.505495 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.505459    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 13:45:34.505495 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.505473    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 13:45:34.505495 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.505486    2572 projected.go:196] Error preparing data for projected volume kube-api-access-q7trc for pod openshift-network-diagnostics/network-check-target-pjkk2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:34.505685 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.505512    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret podName:b7ea257d-bd74-4818-8bfd-42784778a617 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.505491299 +0000 UTC m=+66.265463211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret") pod "global-pull-secret-syncer-5dktc" (UID: "b7ea257d-bd74-4818-8bfd-42784778a617") : object "kube-system"/"original-pull-secret" not registered
Jul 06 13:45:34.505685 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:34.505531    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc podName:65cecc0b-4040-41ff-8f67-0d7815c5588c nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.505522023 +0000 UTC m=+66.265493942 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q7trc" (UniqueName: "kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc") pod "network-check-target-pjkk2" (UID: "65cecc0b-4040-41ff-8f67-0d7815c5588c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 13:45:35.755260 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:35.755202    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:35.755672 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:35.755264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:35.755672 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:35.755264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:35.755672 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:35.755357    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dktc" podUID="b7ea257d-bd74-4818-8bfd-42784778a617"
Jul 06 13:45:35.755672 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:35.755451    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjkk2" podUID="65cecc0b-4040-41ff-8f67-0d7815c5588c"
Jul 06 13:45:35.755672 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:35.755531    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chsg7" podUID="3b4ded86-3754-4f04-9b08-77550d187284"
Jul 06 13:45:36.473446 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.473418    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeReady"
Jul 06 13:45:36.473628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.473560    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 13:45:36.529687 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.529601    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8945l"]
Jul 06 13:45:36.531598 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.531577    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.532756 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.532733    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-27p5s"]
Jul 06 13:45:36.534330 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.534313    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.534528 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.534499    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 13:45:36.534639 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.534563    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5h29s\""
Jul 06 13:45:36.534843 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.534826    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 13:45:36.536495 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.536476    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 13:45:36.536591 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.536550    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w8qbs\""
Jul 06 13:45:36.536705 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.536692    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 13:45:36.537075 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.537060    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 13:45:36.543738 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.543715    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8945l"]
Jul 06 13:45:36.545719 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.545701    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27p5s"]
Jul 06 13:45:36.620894 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.620853    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14b6f5b2-187e-4474-9c7d-6699384d3e74-tmp-dir\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.620894 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.620886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.621129 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.620975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bptrd\" (UniqueName: \"kubernetes.io/projected/1997d704-1b3a-4940-bb79-87e62525a026-kube-api-access-bptrd\") pod \"ingress-canary-27p5s\" (UID: \"1997d704-1b3a-4940-bb79-87e62525a026\") " pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.621129 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.621029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14b6f5b2-187e-4474-9c7d-6699384d3e74-config-volume\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.621129 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.621087    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvg8g\" (UniqueName: \"kubernetes.io/projected/14b6f5b2-187e-4474-9c7d-6699384d3e74-kube-api-access-cvg8g\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.621129 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.621114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1997d704-1b3a-4940-bb79-87e62525a026-cert\") pod \"ingress-canary-27p5s\" (UID: \"1997d704-1b3a-4940-bb79-87e62525a026\") " pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.721516 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.721475    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14b6f5b2-187e-4474-9c7d-6699384d3e74-tmp-dir\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.721516 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.721524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.721758 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.721579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bptrd\" (UniqueName: \"kubernetes.io/projected/1997d704-1b3a-4940-bb79-87e62525a026-kube-api-access-bptrd\") pod \"ingress-canary-27p5s\" (UID: \"1997d704-1b3a-4940-bb79-87e62525a026\") " pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.721758 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.721621    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14b6f5b2-187e-4474-9c7d-6699384d3e74-config-volume\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.721758 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.721650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvg8g\" (UniqueName: \"kubernetes.io/projected/14b6f5b2-187e-4474-9c7d-6699384d3e74-kube-api-access-cvg8g\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.721758 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.721683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1997d704-1b3a-4940-bb79-87e62525a026-cert\") pod \"ingress-canary-27p5s\" (UID: \"1997d704-1b3a-4940-bb79-87e62525a026\") " pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.721758 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:36.721710    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:45:36.722011 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:36.721774    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls podName:14b6f5b2-187e-4474-9c7d-6699384d3e74 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:37.221757118 +0000 UTC m=+36.981729040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls") pod "dns-default-8945l" (UID: "14b6f5b2-187e-4474-9c7d-6699384d3e74") : secret "dns-default-metrics-tls" not found
Jul 06 13:45:36.722011 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.721870    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14b6f5b2-187e-4474-9c7d-6699384d3e74-tmp-dir\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.722354 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.722331    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14b6f5b2-187e-4474-9c7d-6699384d3e74-config-volume\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.726674 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.726648    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1997d704-1b3a-4940-bb79-87e62525a026-cert\") pod \"ingress-canary-27p5s\" (UID: \"1997d704-1b3a-4940-bb79-87e62525a026\") " pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.731706 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.731687    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bptrd\" (UniqueName: \"kubernetes.io/projected/1997d704-1b3a-4940-bb79-87e62525a026-kube-api-access-bptrd\") pod \"ingress-canary-27p5s\" (UID: \"1997d704-1b3a-4940-bb79-87e62525a026\") " pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.734968 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.734947    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvg8g\" (UniqueName: \"kubernetes.io/projected/14b6f5b2-187e-4474-9c7d-6699384d3e74-kube-api-access-cvg8g\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:36.847348 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.847276    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27p5s"
Jul 06 13:45:36.995651 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:36.995620    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27p5s"]
Jul 06 13:45:37.000182 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:45:37.000114    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1997d704_1b3a_4940_bb79_87e62525a026.slice/crio-e6fe539ecf4de4f52390270b6e34f9e287b5c468b66b0102af1abd9fe449420b WatchSource:0}: Error finding container e6fe539ecf4de4f52390270b6e34f9e287b5c468b66b0102af1abd9fe449420b: Status 404 returned error can't find the container with id e6fe539ecf4de4f52390270b6e34f9e287b5c468b66b0102af1abd9fe449420b
Jul 06 13:45:37.225258 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.225222    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:37.225449 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:37.225427    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:45:37.225526 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:37.225513    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls podName:14b6f5b2-187e-4474-9c7d-6699384d3e74 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:38.225490132 +0000 UTC m=+37.985462049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls") pod "dns-default-8945l" (UID: "14b6f5b2-187e-4474-9c7d-6699384d3e74") : secret "dns-default-metrics-tls" not found
Jul 06 13:45:37.755221 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.755175    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:45:37.755396 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.755179    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:45:37.755396 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.755179    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:45:37.758138 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.758015    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 13:45:37.758138 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.758019    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 13:45:37.758138 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.758100    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 13:45:37.758421 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.758026    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 13:45:37.758421 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.758026    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztx5l\""
Jul 06 13:45:37.758421 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.758110    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdk7g\""
Jul 06 13:45:37.984919 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:37.984885    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27p5s" event={"ID":"1997d704-1b3a-4940-bb79-87e62525a026","Type":"ContainerStarted","Data":"e6fe539ecf4de4f52390270b6e34f9e287b5c468b66b0102af1abd9fe449420b"}
Jul 06 13:45:38.232395 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:38.232359    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:38.232652 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:38.232570    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:45:38.232652 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:38.232648    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls podName:14b6f5b2-187e-4474-9c7d-6699384d3e74 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:40.232628404 +0000 UTC m=+39.992600309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls") pod "dns-default-8945l" (UID: "14b6f5b2-187e-4474-9c7d-6699384d3e74") : secret "dns-default-metrics-tls" not found
Jul 06 13:45:39.992978 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:39.992942    2572 generic.go:356] "Generic (PLEG): container finished" podID="f78ce5db-d179-4a36-bbd7-bf2dd0fd8328" containerID="0ca633b2dc8db8a97d130fbc6084c7fd1a4ab4b3da5580245ca811611f6487a8" exitCode=0
Jul 06 13:45:39.993507 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:39.992993    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerDied","Data":"0ca633b2dc8db8a97d130fbc6084c7fd1a4ab4b3da5580245ca811611f6487a8"}
Jul 06 13:45:40.249076 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:40.248998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:40.249250 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:40.249174    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:45:40.249322 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:40.249255    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls podName:14b6f5b2-187e-4474-9c7d-6699384d3e74 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:44.249238085 +0000 UTC m=+44.009209984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls") pod "dns-default-8945l" (UID: "14b6f5b2-187e-4474-9c7d-6699384d3e74") : secret "dns-default-metrics-tls" not found
Jul 06 13:45:40.998844 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:40.998661    2572 generic.go:356] "Generic (PLEG): container finished" podID="f78ce5db-d179-4a36-bbd7-bf2dd0fd8328" containerID="0000e8ea61f242baf6088319b55dd6b6dfbf5684ce3e7e3ce1fb2414e8120d62" exitCode=0
Jul 06 13:45:40.998844 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:40.998745    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerDied","Data":"0000e8ea61f242baf6088319b55dd6b6dfbf5684ce3e7e3ce1fb2414e8120d62"}
Jul 06 13:45:42.002431 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:42.002397    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27p5s" event={"ID":"1997d704-1b3a-4940-bb79-87e62525a026","Type":"ContainerStarted","Data":"250f8fadb3656ef476073e3b84082f15e76c97b5cc134dcbac8a35fae834754b"}
Jul 06 13:45:42.006057 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:42.006034    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" event={"ID":"f78ce5db-d179-4a36-bbd7-bf2dd0fd8328","Type":"ContainerStarted","Data":"0dc8b294f0fc15e54e349db2b39b347732fc52d69426ae3e2a5197ec72fa5873"}
Jul 06 13:45:42.019935 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:42.019878    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-27p5s" podStartSLOduration=2.021380248 podStartE2EDuration="6.01986114s" totalImagesPullingTime="3.998480892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:42.019745157 +0000 UTC m=+41.779717080" watchObservedRunningTime="2026-07-06 13:45:42.01986114 +0000 UTC m=+41.779833068"
Jul 06 13:45:42.039266 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:42.039231    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ctrfd" podStartSLOduration=10.404919464 podStartE2EDuration="42.03919976s" totalImagesPullingTime="31.634280296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:42.038658482 +0000 UTC m=+41.798630406" watchObservedRunningTime="2026-07-06 13:45:42.03919976 +0000 UTC m=+41.799171681"
Jul 06 13:45:44.276165 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:44.276124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:44.276568 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:44.276289    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:45:44.276568 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:44.276356    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls podName:14b6f5b2-187e-4474-9c7d-6699384d3e74 nodeName:}" failed. No retries permitted until 2026-07-06 13:45:52.276338883 +0000 UTC m=+52.036310782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls") pod "dns-default-8945l" (UID: "14b6f5b2-187e-4474-9c7d-6699384d3e74") : secret "dns-default-metrics-tls" not found
Jul 06 13:45:52.329780 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:45:52.329739    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:45:52.330270 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:52.329906    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:45:52.330270 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:45:52.330004    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls podName:14b6f5b2-187e-4474-9c7d-6699384d3e74 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:08.329984439 +0000 UTC m=+68.089956358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls") pod "dns-default-8945l" (UID: "14b6f5b2-187e-4474-9c7d-6699384d3e74") : secret "dns-default-metrics-tls" not found
Jul 06 13:46:00.979609 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:00.979579    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8brz4"
Jul 06 13:46:05.447826 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.447791    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bdd585c59-zvlkt"]
Jul 06 13:46:05.450824 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.450802    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-n5m7t"]
Jul 06 13:46:05.450945 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.450925    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.452594 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.452577    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.452704 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.452672    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 13:46:05.452767 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.452677    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 13:46:05.453140 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.453117    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fr6n6\""
Jul 06 13:46:05.453261 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.453154    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 13:46:05.453261 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.453156    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 13:46:05.453391 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.453305    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 13:46:05.453448 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.453401    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 13:46:05.454062 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.454049    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 13:46:05.454269 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.454255    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qz2pw\""
Jul 06 13:46:05.454441 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.454426    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 13:46:05.454476 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.454433    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 13:46:05.454507 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.454472    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 13:46:05.462258 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.462233    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-n5m7t"]
Jul 06 13:46:05.463008 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.462991    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 13:46:05.463370 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.463353    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bdd585c59-zvlkt"]
Jul 06 13:46:05.515531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515495    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b6992ce-ea53-4b36-8e03-c30ad094362d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.515531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b6992ce-ea53-4b36-8e03-c30ad094362d-serving-cert\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.515777 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515556    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-stats-auth\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.515777 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515579    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b6992ce-ea53-4b36-8e03-c30ad094362d-tmp\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.515777 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515620    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b6992ce-ea53-4b36-8e03-c30ad094362d-snapshots\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.515777 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515692    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b6992ce-ea53-4b36-8e03-c30ad094362d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.515777 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.515777 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-default-certificate\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.515987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzbb6\" (UniqueName: \"kubernetes.io/projected/522fe905-1d95-4dbe-ae5c-10ccf3291968-kube-api-access-lzbb6\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.515987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515828    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.515987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.515846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kggv8\" (UniqueName: \"kubernetes.io/projected/3b6992ce-ea53-4b36-8e03-c30ad094362d-kube-api-access-kggv8\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.580610 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.580576    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"]
Jul 06 13:46:05.582571 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.582555    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:05.584477 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.584454    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ncznl\""
Jul 06 13:46:05.584610 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.584519    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 13:46:05.584610 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.584531    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:46:05.584610 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.584519    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 13:46:05.594404 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.594355    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"]
Jul 06 13:46:05.616733 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-default-certificate\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.616875 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616744    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzbb6\" (UniqueName: \"kubernetes.io/projected/522fe905-1d95-4dbe-ae5c-10ccf3291968-kube-api-access-lzbb6\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.616875 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:05.616875 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.617034 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:05.616894    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.116875087 +0000 UTC m=+65.876847004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : configmap references non-existent config key: service-ca.crt
Jul 06 13:46:05.617034 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kggv8\" (UniqueName: \"kubernetes.io/projected/3b6992ce-ea53-4b36-8e03-c30ad094362d-kube-api-access-kggv8\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617034 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616928    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktp6\" (UniqueName: \"kubernetes.io/projected/c0c17a4d-a161-4c4f-9583-891c8033b263-kube-api-access-zktp6\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:05.617034 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b6992ce-ea53-4b36-8e03-c30ad094362d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617034 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.616991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b6992ce-ea53-4b36-8e03-c30ad094362d-serving-cert\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617272 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-stats-auth\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.617272 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b6992ce-ea53-4b36-8e03-c30ad094362d-tmp\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617272 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b6992ce-ea53-4b36-8e03-c30ad094362d-snapshots\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617272 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b6992ce-ea53-4b36-8e03-c30ad094362d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617272 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617234    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.617521 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:05.617329    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:46:05.617521 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:05.617388    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.117372496 +0000 UTC m=+65.877344411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : secret "router-metrics-certs-default" not found
Jul 06 13:46:05.617845 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617816    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b6992ce-ea53-4b36-8e03-c30ad094362d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617935 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617832    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b6992ce-ea53-4b36-8e03-c30ad094362d-tmp\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.617935 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.617908    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b6992ce-ea53-4b36-8e03-c30ad094362d-snapshots\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.618589 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.618571    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b6992ce-ea53-4b36-8e03-c30ad094362d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.620452 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.620424    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b6992ce-ea53-4b36-8e03-c30ad094362d-serving-cert\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.620541 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.620511    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-stats-auth\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.620588 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.620513    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-default-certificate\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.625676 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.625645    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kggv8\" (UniqueName: \"kubernetes.io/projected/3b6992ce-ea53-4b36-8e03-c30ad094362d-kube-api-access-kggv8\") pod \"insights-operator-5c847dcfc4-n5m7t\" (UID: \"3b6992ce-ea53-4b36-8e03-c30ad094362d\") " pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.625968 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.625951    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzbb6\" (UniqueName: \"kubernetes.io/projected/522fe905-1d95-4dbe-ae5c-10ccf3291968-kube-api-access-lzbb6\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:05.717835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.717752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:05.717835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.717797    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktp6\" (UniqueName: \"kubernetes.io/projected/c0c17a4d-a161-4c4f-9583-891c8033b263-kube-api-access-zktp6\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:05.718004 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:05.717900    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 13:46:05.718004 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:05.717959    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls podName:c0c17a4d-a161-4c4f-9583-891c8033b263 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:06.217942197 +0000 UTC m=+65.977914100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7q6p2" (UID: "c0c17a4d-a161-4c4f-9583-891c8033b263") : secret "samples-operator-tls" not found
Jul 06 13:46:05.726085 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.726062    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktp6\" (UniqueName: \"kubernetes.io/projected/c0c17a4d-a161-4c4f-9583-891c8033b263-kube-api-access-zktp6\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:05.768352 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.768320    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t"
Jul 06 13:46:05.886583 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:05.886543    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-n5m7t"]
Jul 06 13:46:05.891061 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:05.891034    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6992ce_ea53_4b36_8e03_c30ad094362d.slice/crio-8829cdc04356c425376e25be502d311d72e46af1fcfe92aef5487aaaa67ac009 WatchSource:0}: Error finding container 8829cdc04356c425376e25be502d311d72e46af1fcfe92aef5487aaaa67ac009: Status 404 returned error can't find the container with id 8829cdc04356c425376e25be502d311d72e46af1fcfe92aef5487aaaa67ac009
Jul 06 13:46:06.060698 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.060615    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t" event={"ID":"3b6992ce-ea53-4b36-8e03-c30ad094362d","Type":"ContainerStarted","Data":"8829cdc04356c425376e25be502d311d72e46af1fcfe92aef5487aaaa67ac009"}
Jul 06 13:46:06.120347 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.120313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:06.120511 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.120433    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:06.120511 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:06.120457    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:07.120437402 +0000 UTC m=+66.880409302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : configmap references non-existent config key: service-ca.crt
Jul 06 13:46:06.120622 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:06.120510    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:46:06.120622 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:06.120555    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:07.120543363 +0000 UTC m=+66.880515272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : secret "router-metrics-certs-default" not found
Jul 06 13:46:06.221008 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.220975    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:06.221142 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:06.221077    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 13:46:06.221142 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:06.221124    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls podName:c0c17a4d-a161-4c4f-9583-891c8033b263 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:07.221112637 +0000 UTC m=+66.981084537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7q6p2" (UID: "c0c17a4d-a161-4c4f-9583-891c8033b263") : secret "samples-operator-tls" not found
Jul 06 13:46:06.422744 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.422708    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:46:06.424824 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.424807    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 13:46:06.433276 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:06.433249    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 13:46:06.433373 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:06.433337    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs podName:3b4ded86-3754-4f04-9b08-77550d187284 nodeName:}" failed. No retries permitted until 2026-07-06 13:47:10.433315801 +0000 UTC m=+130.193287701 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs") pod "network-metrics-daemon-chsg7" (UID: "3b4ded86-3754-4f04-9b08-77550d187284") : secret "metrics-daemon-secret" not found
Jul 06 13:46:06.524087 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.524053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:46:06.524481 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.524095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:46:06.526427 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.526407    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 13:46:06.526524 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.526448    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 13:46:06.536522 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.536504    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 13:46:06.537028 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.537012    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7ea257d-bd74-4818-8bfd-42784778a617-original-pull-secret\") pod \"global-pull-secret-syncer-5dktc\" (UID: \"b7ea257d-bd74-4818-8bfd-42784778a617\") " pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:46:06.547144 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.547127    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7trc\" (UniqueName: \"kubernetes.io/projected/65cecc0b-4040-41ff-8f67-0d7815c5588c-kube-api-access-q7trc\") pod \"network-check-target-pjkk2\" (UID: \"65cecc0b-4040-41ff-8f67-0d7815c5588c\") " pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:46:06.569737 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.569713    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ztx5l\""
Jul 06 13:46:06.578305 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.578287    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:46:06.581775 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.581762    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dktc"
Jul 06 13:46:06.708490 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.708459    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5dktc"]
Jul 06 13:46:06.712721 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:06.712691    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ea257d_bd74_4818_8bfd_42784778a617.slice/crio-88273a1a146f1443f817a98419ffb99be9eb09ad9ad6fe1ea921b1013a8fbe62 WatchSource:0}: Error finding container 88273a1a146f1443f817a98419ffb99be9eb09ad9ad6fe1ea921b1013a8fbe62: Status 404 returned error can't find the container with id 88273a1a146f1443f817a98419ffb99be9eb09ad9ad6fe1ea921b1013a8fbe62
Jul 06 13:46:06.722626 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:06.722601    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pjkk2"]
Jul 06 13:46:06.725509 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:06.725489    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cecc0b_4040_41ff_8f67_0d7815c5588c.slice/crio-9af12e96fb7297286e1c512d99bfc2a838e46254d5f35c25521887f0798c8772 WatchSource:0}: Error finding container 9af12e96fb7297286e1c512d99bfc2a838e46254d5f35c25521887f0798c8772: Status 404 returned error can't find the container with id 9af12e96fb7297286e1c512d99bfc2a838e46254d5f35c25521887f0798c8772
Jul 06 13:46:07.065441 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:07.065350    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5dktc" event={"ID":"b7ea257d-bd74-4818-8bfd-42784778a617","Type":"ContainerStarted","Data":"88273a1a146f1443f817a98419ffb99be9eb09ad9ad6fe1ea921b1013a8fbe62"}
Jul 06 13:46:07.066655 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:07.066622    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pjkk2" event={"ID":"65cecc0b-4040-41ff-8f67-0d7815c5588c","Type":"ContainerStarted","Data":"9af12e96fb7297286e1c512d99bfc2a838e46254d5f35c25521887f0798c8772"}
Jul 06 13:46:07.128298 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:07.128261    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:07.128465 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:07.128349    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:07.128465 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:07.128437    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:46:07.128562 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:07.128516    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:09.128494257 +0000 UTC m=+68.888466177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : secret "router-metrics-certs-default" not found
Jul 06 13:46:07.128562 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:07.128538    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:09.128529383 +0000 UTC m=+68.888501285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : configmap references non-existent config key: service-ca.crt
Jul 06 13:46:07.229860 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:07.229750    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:07.230061 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:07.229956    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 13:46:07.230061 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:07.230016    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls podName:c0c17a4d-a161-4c4f-9583-891c8033b263 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:09.229998441 +0000 UTC m=+68.989970341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7q6p2" (UID: "c0c17a4d-a161-4c4f-9583-891c8033b263") : secret "samples-operator-tls" not found
Jul 06 13:46:08.339496 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:08.339445    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:46:08.340056 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:08.339713    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 13:46:08.340056 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:08.339818    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls podName:14b6f5b2-187e-4474-9c7d-6699384d3e74 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:40.339795406 +0000 UTC m=+100.099767328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls") pod "dns-default-8945l" (UID: "14b6f5b2-187e-4474-9c7d-6699384d3e74") : secret "dns-default-metrics-tls" not found
Jul 06 13:46:09.076074 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.075949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t" event={"ID":"3b6992ce-ea53-4b36-8e03-c30ad094362d","Type":"ContainerStarted","Data":"015851814a8d6f12677b4e9d1a6c1e1c9a690aaefc899fa2d29164446b26dbbd"}
Jul 06 13:46:09.091636 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.091574    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t" podStartSLOduration=1.4113747220000001 podStartE2EDuration="4.091554068s" totalImagesPullingTime="2.680179346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:09.090872579 +0000 UTC m=+68.850844502" watchObservedRunningTime="2026-07-06 13:46:09.091554068 +0000 UTC m=+68.851525990"
Jul 06 13:46:09.145778 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.145740    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:09.145945 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.145906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:09.146071 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.146055    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:46:09.146140 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.146119    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.146102513 +0000 UTC m=+72.906074419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : secret "router-metrics-certs-default" not found
Jul 06 13:46:09.146555 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.146537    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.146522642 +0000 UTC m=+72.906494547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : configmap references non-existent config key: service-ca.crt
Jul 06 13:46:09.246641 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.246603    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:09.246832 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.246758    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 13:46:09.246897 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.246853    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls podName:c0c17a4d-a161-4c4f-9583-891c8033b263 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.246830874 +0000 UTC m=+73.006802774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7q6p2" (UID: "c0c17a4d-a161-4c4f-9583-891c8033b263") : secret "samples-operator-tls" not found
Jul 06 13:46:09.468439 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.468405    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"]
Jul 06 13:46:09.470529 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.470505    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"
Jul 06 13:46:09.472851 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.472827    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pr7kk\""
Jul 06 13:46:09.481142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.481120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"]
Jul 06 13:46:09.549843 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.549805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p89d\" (UniqueName: \"kubernetes.io/projected/ad76f2d9-3266-4f88-be0f-b194c2251740-kube-api-access-2p89d\") pod \"network-check-source-989f8b8dc-c8cx2\" (UID: \"ad76f2d9-3266-4f88-be0f-b194c2251740\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"
Jul 06 13:46:09.635079 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.635044    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dnwbq"]
Jul 06 13:46:09.637202 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.637181    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.639170 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.639151    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 13:46:09.639706 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.639682    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 13:46:09.639805 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.639685    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fqx8g\""
Jul 06 13:46:09.650869 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.650847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p89d\" (UniqueName: \"kubernetes.io/projected/ad76f2d9-3266-4f88-be0f-b194c2251740-kube-api-access-2p89d\") pod \"network-check-source-989f8b8dc-c8cx2\" (UID: \"ad76f2d9-3266-4f88-be0f-b194c2251740\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"
Jul 06 13:46:09.650975 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.650902    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c016f9da-3748-49e5-b9da-1c236b05a83a-crio-socket\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.650975 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.650943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.650975 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.650968    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7s2z\" (UniqueName: \"kubernetes.io/projected/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-api-access-c7s2z\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.651141 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.651122    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c016f9da-3748-49e5-b9da-1c236b05a83a-data-volume\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.651184 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.651157    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.668594 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.668566    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnwbq"]
Jul 06 13:46:09.678381 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.678322    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p89d\" (UniqueName: \"kubernetes.io/projected/ad76f2d9-3266-4f88-be0f-b194c2251740-kube-api-access-2p89d\") pod \"network-check-source-989f8b8dc-c8cx2\" (UID: \"ad76f2d9-3266-4f88-be0f-b194c2251740\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"
Jul 06 13:46:09.751847 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.751755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c016f9da-3748-49e5-b9da-1c236b05a83a-crio-socket\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.751847 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.751820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.752043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.751851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7s2z\" (UniqueName: \"kubernetes.io/projected/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-api-access-c7s2z\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.752043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.751900    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c016f9da-3748-49e5-b9da-1c236b05a83a-crio-socket\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.752043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.751967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c016f9da-3748-49e5-b9da-1c236b05a83a-data-volume\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.752043 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.751979    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:46:09.752043 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.752039    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:09.752314 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.751985    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.752314 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.752040    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:10.25202635 +0000 UTC m=+70.011998250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : configmap "kube-rbac-proxy" not found
Jul 06 13:46:09.752314 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:09.752109    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:10.252088331 +0000 UTC m=+70.012060252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:09.752464 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.752389    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c016f9da-3748-49e5-b9da-1c236b05a83a-data-volume\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.764175 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.764146    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7s2z\" (UniqueName: \"kubernetes.io/projected/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-api-access-c7s2z\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:09.780577 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:09.780542    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"
Jul 06 13:46:10.255433 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:10.255394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:10.255611 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:10.255501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:10.255611 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:10.255539    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:46:10.255611 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:10.255608    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.255587077 +0000 UTC m=+71.015558978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : configmap "kube-rbac-proxy" not found
Jul 06 13:46:10.255794 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:10.255631    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:10.255794 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:10.255687    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:11.255672693 +0000 UTC m=+71.015644619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:11.264036 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:11.263594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:11.264036 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:11.263689    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:11.264036 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:11.263826    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:46:11.264036 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:11.263899    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.26387839 +0000 UTC m=+73.023850307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : configmap "kube-rbac-proxy" not found
Jul 06 13:46:11.264036 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:11.263969    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:11.264036 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:11.264035    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:13.264015851 +0000 UTC m=+73.023987756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:11.324818 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:11.324790    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2"]
Jul 06 13:46:11.328412 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:11.328384    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad76f2d9_3266_4f88_be0f_b194c2251740.slice/crio-359a9fd5346a428f00b33399550c309443bf4de5a3b251a0129be1973549d9aa WatchSource:0}: Error finding container 359a9fd5346a428f00b33399550c309443bf4de5a3b251a0129be1973549d9aa: Status 404 returned error can't find the container with id 359a9fd5346a428f00b33399550c309443bf4de5a3b251a0129be1973549d9aa
Jul 06 13:46:11.399191 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:11.399167    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7cs2v_c892e645-514e-4b1f-9900-7f1ad7e03424/dns-node-resolver/0.log"
Jul 06 13:46:12.086248 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.086195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pjkk2" event={"ID":"65cecc0b-4040-41ff-8f67-0d7815c5588c","Type":"ContainerStarted","Data":"2925771bda5c6fadd07281b58a94418e72083a21f9c6d0e02fd8e18e765fd236"}
Jul 06 13:46:12.086455 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.086313    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:46:12.087663 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.087638    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5dktc" event={"ID":"b7ea257d-bd74-4818-8bfd-42784778a617","Type":"ContainerStarted","Data":"d6842966bc08beea01fe6dc6c616bc67feb30bcf87842bbf5d34cc9027ab4a3a"}
Jul 06 13:46:12.088988 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.088968    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2" event={"ID":"ad76f2d9-3266-4f88-be0f-b194c2251740","Type":"ContainerStarted","Data":"9c9a3b9a335c9a1bc9cfd7260085bc2677b8fab5dfdf9f2e29b1e3580c1cbfc1"}
Jul 06 13:46:12.089082 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.089003    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2" event={"ID":"ad76f2d9-3266-4f88-be0f-b194c2251740","Type":"ContainerStarted","Data":"359a9fd5346a428f00b33399550c309443bf4de5a3b251a0129be1973549d9aa"}
Jul 06 13:46:12.101166 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.101120    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pjkk2" podStartSLOduration=67.625506191 podStartE2EDuration="1m12.101103217s" totalImagesPullingTime="4.475597026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:12.100271983 +0000 UTC m=+71.860243905" watchObservedRunningTime="2026-07-06 13:46:12.101103217 +0000 UTC m=+71.861075140"
Jul 06 13:46:12.145609 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.145558    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5dktc" podStartSLOduration=67.651565252 podStartE2EDuration="1m12.145544842s" totalImagesPullingTime="4.49397959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:12.123679409 +0000 UTC m=+71.883651332" watchObservedRunningTime="2026-07-06 13:46:12.145544842 +0000 UTC m=+71.905516764"
Jul 06 13:46:12.146110 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.146086    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-c8cx2" podStartSLOduration=3.146081042 podStartE2EDuration="3.146081042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:12.14427243 +0000 UTC m=+71.904244352" watchObservedRunningTime="2026-07-06 13:46:12.146081042 +0000 UTC m=+71.906052963"
Jul 06 13:46:12.187709 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.187669    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"]
Jul 06 13:46:12.190352 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.190333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"
Jul 06 13:46:12.194690 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.194643    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 13:46:12.194690 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.194643    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 13:46:12.194890 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.194805    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wq46r\""
Jul 06 13:46:12.202083 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.202063    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"]
Jul 06 13:46:12.271830 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.271793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7nr\" (UniqueName: \"kubernetes.io/projected/e9597afb-6dab-4350-9c1f-fe9ba5b6f535-kube-api-access-kh7nr\") pod \"migrator-d57d58cc9-7dxzf\" (UID: \"e9597afb-6dab-4350-9c1f-fe9ba5b6f535\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"
Jul 06 13:46:12.372585 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.372557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7nr\" (UniqueName: \"kubernetes.io/projected/e9597afb-6dab-4350-9c1f-fe9ba5b6f535-kube-api-access-kh7nr\") pod \"migrator-d57d58cc9-7dxzf\" (UID: \"e9597afb-6dab-4350-9c1f-fe9ba5b6f535\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"
Jul 06 13:46:12.381415 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.381388    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7nr\" (UniqueName: \"kubernetes.io/projected/e9597afb-6dab-4350-9c1f-fe9ba5b6f535-kube-api-access-kh7nr\") pod \"migrator-d57d58cc9-7dxzf\" (UID: \"e9597afb-6dab-4350-9c1f-fe9ba5b6f535\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"
Jul 06 13:46:12.504200 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.504166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"
Jul 06 13:46:12.599397 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.599369    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8tb2_85d53bd5-9d3e-470e-9ca7-c8ffd85daba1/node-ca/0.log"
Jul 06 13:46:12.623018 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:12.622957    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf"]
Jul 06 13:46:12.626520 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:12.626481    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9597afb_6dab_4350_9c1f_fe9ba5b6f535.slice/crio-f22ad06e490743eb1af69d7b809eb880e66a7e223c74f7481d77308e8c4f19ab WatchSource:0}: Error finding container f22ad06e490743eb1af69d7b809eb880e66a7e223c74f7481d77308e8c4f19ab: Status 404 returned error can't find the container with id f22ad06e490743eb1af69d7b809eb880e66a7e223c74f7481d77308e8c4f19ab
Jul 06 13:46:13.092699 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:13.092578    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf" event={"ID":"e9597afb-6dab-4350-9c1f-fe9ba5b6f535","Type":"ContainerStarted","Data":"f22ad06e490743eb1af69d7b809eb880e66a7e223c74f7481d77308e8c4f19ab"}
Jul 06 13:46:13.179283 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:13.179236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:13.179453 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.179361    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:46:13.179453 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:13.179360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:13.179588 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.179442    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:21.179393824 +0000 UTC m=+80.939365724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : secret "router-metrics-certs-default" not found
Jul 06 13:46:13.179588 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.179486    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:21.17947523 +0000 UTC m=+80.939447147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : configmap references non-existent config key: service-ca.crt
Jul 06 13:46:13.199822 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:13.199799    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27p5s_1997d704-1b3a-4940-bb79-87e62525a026/serve-healthcheck-canary/0.log"
Jul 06 13:46:13.280300 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:13.280274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:13.280314    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:13.280352    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.280423    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.280470    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.280474    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:17.280459355 +0000 UTC m=+77.040431259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : configmap "kube-rbac-proxy" not found
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.280507    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:17.280497089 +0000 UTC m=+77.040468989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.280541    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 13:46:13.280619 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:13.280567    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls podName:c0c17a4d-a161-4c4f-9583-891c8033b263 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:21.280559896 +0000 UTC m=+81.040531796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7q6p2" (UID: "c0c17a4d-a161-4c4f-9583-891c8033b263") : secret "samples-operator-tls" not found
Jul 06 13:46:15.101425 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:15.101345    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf" event={"ID":"e9597afb-6dab-4350-9c1f-fe9ba5b6f535","Type":"ContainerStarted","Data":"fdc5403e30ffdfe0c79d760eade52300572f6ee44a227f47fb735dddd81ae9e4"}
Jul 06 13:46:15.101425 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:15.101405    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf" event={"ID":"e9597afb-6dab-4350-9c1f-fe9ba5b6f535","Type":"ContainerStarted","Data":"987a08b80e09e6576fccd411cb9edf0b7b85aa9b9f1b35cea8e1981d1beb16b3"}
Jul 06 13:46:15.118269 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:15.118118    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7dxzf" podStartSLOduration=1.125385731 podStartE2EDuration="3.118100664s" totalImagesPullingTime="1.992714933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:15.116461863 +0000 UTC m=+74.876433784" watchObservedRunningTime="2026-07-06 13:46:15.118100664 +0000 UTC m=+74.878072588"
Jul 06 13:46:17.312256 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:17.312202    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:17.312659 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:17.312276    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:17.312659 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:17.312340    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 13:46:17.312659 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:17.312345    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:17.312659 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:17.312392    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:25.312379598 +0000 UTC m=+85.072351498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : configmap "kube-rbac-proxy" not found
Jul 06 13:46:17.312659 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:17.312404    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:25.312398684 +0000 UTC m=+85.072370584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:21.241342 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:21.241311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:21.241799 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:21.241397    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:21.241799 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:21.241476    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:37.241455284 +0000 UTC m=+97.001427184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : configmap references non-existent config key: service-ca.crt
Jul 06 13:46:21.241799 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:21.241510    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 13:46:21.241799 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:21.241560    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs podName:522fe905-1d95-4dbe-ae5c-10ccf3291968 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:37.241546431 +0000 UTC m=+97.001518332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs") pod "router-default-bdd585c59-zvlkt" (UID: "522fe905-1d95-4dbe-ae5c-10ccf3291968") : secret "router-metrics-certs-default" not found
Jul 06 13:46:21.342626 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:21.342593    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:21.342811 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:21.342776    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 13:46:21.342881 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:21.342859    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls podName:c0c17a4d-a161-4c4f-9583-891c8033b263 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:37.342838767 +0000 UTC m=+97.102810687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7q6p2" (UID: "c0c17a4d-a161-4c4f-9583-891c8033b263") : secret "samples-operator-tls" not found
Jul 06 13:46:25.373853 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:25.373723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:25.373853 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:25.373809    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:25.374278 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:25.373877    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:25.374278 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:25.373967    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls podName:c016f9da-3748-49e5-b9da-1c236b05a83a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:41.37394612 +0000 UTC m=+101.133918036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnwbq" (UID: "c016f9da-3748-49e5-b9da-1c236b05a83a") : secret "insights-runtime-extractor-tls" not found
Jul 06 13:46:25.374367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:25.374304    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c016f9da-3748-49e5-b9da-1c236b05a83a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:37.263157 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.263122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:37.263642 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.263177    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:37.263714 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.263696    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/522fe905-1d95-4dbe-ae5c-10ccf3291968-service-ca-bundle\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:37.265431 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.265407    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/522fe905-1d95-4dbe-ae5c-10ccf3291968-metrics-certs\") pod \"router-default-bdd585c59-zvlkt\" (UID: \"522fe905-1d95-4dbe-ae5c-10ccf3291968\") " pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:37.363568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.363524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:37.365737 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.365714    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c17a4d-a161-4c4f-9583-891c8033b263-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7q6p2\" (UID: \"c0c17a4d-a161-4c4f-9583-891c8033b263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:37.391614 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.391592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"
Jul 06 13:46:37.511745 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.511714    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2"]
Jul 06 13:46:37.563013 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.562991    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:37.681274 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:37.681246    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bdd585c59-zvlkt"]
Jul 06 13:46:37.684042 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:37.684013    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522fe905_1d95_4dbe_ae5c_10ccf3291968.slice/crio-cc51cd159078fd67d78cdd82f1b9abd33a6c2348ccfd1342990fa25c848b3f8b WatchSource:0}: Error finding container cc51cd159078fd67d78cdd82f1b9abd33a6c2348ccfd1342990fa25c848b3f8b: Status 404 returned error can't find the container with id cc51cd159078fd67d78cdd82f1b9abd33a6c2348ccfd1342990fa25c848b3f8b
Jul 06 13:46:38.171272 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:38.171242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2" event={"ID":"c0c17a4d-a161-4c4f-9583-891c8033b263","Type":"ContainerStarted","Data":"86eea2ff36d5b0e8fababd17dbd2a65fad83bd2dc6b94c6578df22dd9a51ad89"}
Jul 06 13:46:38.172635 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:38.172608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bdd585c59-zvlkt" event={"ID":"522fe905-1d95-4dbe-ae5c-10ccf3291968","Type":"ContainerStarted","Data":"ca983120e43d3ed035218d152badaf37583737b7d355a0b27ca99035a45c39e5"}
Jul 06 13:46:38.172785 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:38.172651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bdd585c59-zvlkt" event={"ID":"522fe905-1d95-4dbe-ae5c-10ccf3291968","Type":"ContainerStarted","Data":"cc51cd159078fd67d78cdd82f1b9abd33a6c2348ccfd1342990fa25c848b3f8b"}
Jul 06 13:46:38.191603 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:38.191558    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bdd585c59-zvlkt" podStartSLOduration=33.191543122 podStartE2EDuration="33.191543122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:38.190944706 +0000 UTC m=+97.950916646" watchObservedRunningTime="2026-07-06 13:46:38.191543122 +0000 UTC m=+97.951515044"
Jul 06 13:46:38.563794 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:38.563704    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:38.566573 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:38.566547    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:39.176269 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:39.176241    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:39.177764 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:39.177740    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bdd585c59-zvlkt"
Jul 06 13:46:40.180191 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.180161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2" event={"ID":"c0c17a4d-a161-4c4f-9583-891c8033b263","Type":"ContainerStarted","Data":"166806c5eabd1f2e1add5dfe3a513488f4325d0e7ce9852fffb1a9d9295dd507"}
Jul 06 13:46:40.180628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.180224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2" event={"ID":"c0c17a4d-a161-4c4f-9583-891c8033b263","Type":"ContainerStarted","Data":"c0bfade17084facf00a8375a878c41c7b881b6494dbd65a0b45ca87e18f16c7b"}
Jul 06 13:46:40.195583 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.195542    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7q6p2" podStartSLOduration=33.231047958 podStartE2EDuration="35.195526981s" totalImagesPullingTime="1.964479023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:40.195079113 +0000 UTC m=+99.955051037" watchObservedRunningTime="2026-07-06 13:46:40.195526981 +0000 UTC m=+99.955498911"
Jul 06 13:46:40.391123 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.391074    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:46:40.393378 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.393359    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14b6f5b2-187e-4474-9c7d-6699384d3e74-metrics-tls\") pod \"dns-default-8945l\" (UID: \"14b6f5b2-187e-4474-9c7d-6699384d3e74\") " pod="openshift-dns/dns-default-8945l"
Jul 06 13:46:40.444495 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.444424    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5h29s\""
Jul 06 13:46:40.452634 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.452611    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8945l"
Jul 06 13:46:40.580056 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:40.580021    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8945l"]
Jul 06 13:46:40.584113 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:40.584083    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b6f5b2_187e_4474_9c7d_6699384d3e74.slice/crio-3da8011af11240674f3ce2055c66bc15c090f7dbdab1ad8241a9b258500437e0 WatchSource:0}: Error finding container 3da8011af11240674f3ce2055c66bc15c090f7dbdab1ad8241a9b258500437e0: Status 404 returned error can't find the container with id 3da8011af11240674f3ce2055c66bc15c090f7dbdab1ad8241a9b258500437e0
Jul 06 13:46:41.186632 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:41.186595    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8945l" event={"ID":"14b6f5b2-187e-4474-9c7d-6699384d3e74","Type":"ContainerStarted","Data":"3da8011af11240674f3ce2055c66bc15c090f7dbdab1ad8241a9b258500437e0"}
Jul 06 13:46:41.399648 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:41.399616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:41.402084 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:41.402054    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c016f9da-3748-49e5-b9da-1c236b05a83a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnwbq\" (UID: \"c016f9da-3748-49e5-b9da-1c236b05a83a\") " pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:41.448188 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:41.448121    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnwbq"
Jul 06 13:46:41.604375 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:41.604347    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnwbq"]
Jul 06 13:46:41.607454 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:41.607418    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc016f9da_3748_49e5_b9da_1c236b05a83a.slice/crio-06c8db72cb41bce1683d0a784cb41920680b52f040ceffe6e1d92fae147f43c1 WatchSource:0}: Error finding container 06c8db72cb41bce1683d0a784cb41920680b52f040ceffe6e1d92fae147f43c1: Status 404 returned error can't find the container with id 06c8db72cb41bce1683d0a784cb41920680b52f040ceffe6e1d92fae147f43c1
Jul 06 13:46:42.191255 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.191198    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnwbq" event={"ID":"c016f9da-3748-49e5-b9da-1c236b05a83a","Type":"ContainerStarted","Data":"06c8db72cb41bce1683d0a784cb41920680b52f040ceffe6e1d92fae147f43c1"}
Jul 06 13:46:42.817365 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.817336    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"]
Jul 06 13:46:42.832907 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.832885    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"]
Jul 06 13:46:42.833032 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.832971    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:42.835048 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.835027    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 13:46:42.835870 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.835839    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 13:46:42.835971 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.835940    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-26l22\""
Jul 06 13:46:42.911698 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.911673    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dd486b4-13eb-4ceb-b8ab-70ee424ea253-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9w2t\" (UID: \"2dd486b4-13eb-4ceb-b8ab-70ee424ea253\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:42.911784 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.911709    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dd486b4-13eb-4ceb-b8ab-70ee424ea253-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-n9w2t\" (UID: \"2dd486b4-13eb-4ceb-b8ab-70ee424ea253\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:42.924452 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.924425    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"]
Jul 06 13:46:42.947408 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.947387    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"]
Jul 06 13:46:42.947516 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.947492    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"
Jul 06 13:46:42.950343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.950317    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6zd4t\""
Jul 06 13:46:42.950429 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:42.950392    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 13:46:43.012618 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.012591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dd486b4-13eb-4ceb-b8ab-70ee424ea253-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9w2t\" (UID: \"2dd486b4-13eb-4ceb-b8ab-70ee424ea253\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:43.012725 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.012643    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dd486b4-13eb-4ceb-b8ab-70ee424ea253-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-n9w2t\" (UID: \"2dd486b4-13eb-4ceb-b8ab-70ee424ea253\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:43.013404 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.013376    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dd486b4-13eb-4ceb-b8ab-70ee424ea253-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-n9w2t\" (UID: \"2dd486b4-13eb-4ceb-b8ab-70ee424ea253\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:43.015733 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.015690    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dd486b4-13eb-4ceb-b8ab-70ee424ea253-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-n9w2t\" (UID: \"2dd486b4-13eb-4ceb-b8ab-70ee424ea253\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:43.095986 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.095959    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pjkk2"
Jul 06 13:46:43.113378 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.113348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/642d0903-f997-4204-9061-d1a2edc6d777-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9hvb9\" (UID: \"642d0903-f997-4204-9061-d1a2edc6d777\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"
Jul 06 13:46:43.142255 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.142229    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"
Jul 06 13:46:43.205813 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.205767    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8945l" event={"ID":"14b6f5b2-187e-4474-9c7d-6699384d3e74","Type":"ContainerStarted","Data":"78e8d07346f0bad9ed652a09e94463484550e275506f82cb2998b11166242ee1"}
Jul 06 13:46:43.206247 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.205875    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8945l" event={"ID":"14b6f5b2-187e-4474-9c7d-6699384d3e74","Type":"ContainerStarted","Data":"d28cefde15578e4f8177ec657d07fec28620ccd5407187ae9abbc3bc4168d48f"}
Jul 06 13:46:43.206952 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.206801    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8945l"
Jul 06 13:46:43.214658 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.214622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/642d0903-f997-4204-9061-d1a2edc6d777-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9hvb9\" (UID: \"642d0903-f997-4204-9061-d1a2edc6d777\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"
Jul 06 13:46:43.219231 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.219192    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/642d0903-f997-4204-9061-d1a2edc6d777-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9hvb9\" (UID: \"642d0903-f997-4204-9061-d1a2edc6d777\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"
Jul 06 13:46:43.258276 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.258007    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"
Jul 06 13:46:43.370722 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.370665    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8945l" podStartSLOduration=65.058508978 podStartE2EDuration="1m7.370644895s" totalImagesPullingTime="2.312135917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:43.229416571 +0000 UTC m=+102.989388494" watchObservedRunningTime="2026-07-06 13:46:43.370644895 +0000 UTC m=+103.130616819"
Jul 06 13:46:43.371430 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.371305    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t"]
Jul 06 13:46:43.375685 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:43.375653    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd486b4_13eb_4ceb_b8ab_70ee424ea253.slice/crio-2259cac23fec8182f54386ddb7253bdc2f89dafc49c332355029df8086f827db WatchSource:0}: Error finding container 2259cac23fec8182f54386ddb7253bdc2f89dafc49c332355029df8086f827db: Status 404 returned error can't find the container with id 2259cac23fec8182f54386ddb7253bdc2f89dafc49c332355029df8086f827db
Jul 06 13:46:43.436895 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:43.436862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"]
Jul 06 13:46:43.441719 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:43.441685    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642d0903_f997_4204_9061_d1a2edc6d777.slice/crio-92b125b3c45cd0ae5a9166be03a2e7724554150a101e23c18649182961590122 WatchSource:0}: Error finding container 92b125b3c45cd0ae5a9166be03a2e7724554150a101e23c18649182961590122: Status 404 returned error can't find the container with id 92b125b3c45cd0ae5a9166be03a2e7724554150a101e23c18649182961590122
Jul 06 13:46:44.212033 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:44.211991    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9" event={"ID":"642d0903-f997-4204-9061-d1a2edc6d777","Type":"ContainerStarted","Data":"92b125b3c45cd0ae5a9166be03a2e7724554150a101e23c18649182961590122"}
Jul 06 13:46:44.213729 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:44.213700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t" event={"ID":"2dd486b4-13eb-4ceb-b8ab-70ee424ea253","Type":"ContainerStarted","Data":"2259cac23fec8182f54386ddb7253bdc2f89dafc49c332355029df8086f827db"}
Jul 06 13:46:48.229691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.229651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnwbq" event={"ID":"c016f9da-3748-49e5-b9da-1c236b05a83a","Type":"ContainerStarted","Data":"8679cc15f844de844998fefc897a425a1a1cc298d2990002d0d523adb5e49618"}
Jul 06 13:46:48.230118 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.229715    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnwbq" event={"ID":"c016f9da-3748-49e5-b9da-1c236b05a83a","Type":"ContainerStarted","Data":"fc1bd3c50826d9264fa29a2423af0654959d17de6c7239089288cd4c0f65b1a4"}
Jul 06 13:46:48.231037 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.231013    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9" event={"ID":"642d0903-f997-4204-9061-d1a2edc6d777","Type":"ContainerStarted","Data":"ef2e7ac6a4ba443803a1ec50391ccc8731a81c4b34ea34ce71569fadba91c995"}
Jul 06 13:46:48.231193 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.231158    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"
Jul 06 13:46:48.232662 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.232624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t" event={"ID":"2dd486b4-13eb-4ceb-b8ab-70ee424ea253","Type":"ContainerStarted","Data":"be3d6dd87105e0061338adb0ebfad48294fb00b5e104d69d8a9dda8944dfb371"}
Jul 06 13:46:48.235850 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.235832    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9"
Jul 06 13:46:48.247149 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.247109    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9hvb9" podStartSLOduration=2.232409399 podStartE2EDuration="6.247096684s" totalImagesPullingTime="4.014687285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:48.246575431 +0000 UTC m=+108.006547354" watchObservedRunningTime="2026-07-06 13:46:48.247096684 +0000 UTC m=+108.007068606"
Jul 06 13:46:48.261420 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:48.261379    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-n9w2t" podStartSLOduration=2.182663806 podStartE2EDuration="6.26136693s" totalImagesPullingTime="4.078703124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:48.260745571 +0000 UTC m=+108.020717492" watchObservedRunningTime="2026-07-06 13:46:48.26136693 +0000 UTC m=+108.021338855"
Jul 06 13:46:49.146922 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.146884    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-dcbxl"]
Jul 06 13:46:49.149001 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.148978    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dcbxl"
Jul 06 13:46:49.150886 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.150860    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p9fh6\""
Jul 06 13:46:49.150972 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.150925    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 13:46:49.151304 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.151157    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 13:46:49.161821 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.160195    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dcbxl"]
Jul 06 13:46:49.263645 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.263614    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-544d9\" (UniqueName: \"kubernetes.io/projected/da2dd50c-716f-4118-b215-cdc11fb6b6ed-kube-api-access-544d9\") pod \"downloads-685bfb5f64-dcbxl\" (UID: \"da2dd50c-716f-4118-b215-cdc11fb6b6ed\") " pod="openshift-console/downloads-685bfb5f64-dcbxl"
Jul 06 13:46:49.273314 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.273280    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"]
Jul 06 13:46:49.275428 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.275410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.277378 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.277358    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 13:46:49.278233 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.278106    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 13:46:49.278233 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.278113    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 13:46:49.279157 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.278796    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 13:46:49.279157 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.278939    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w9sk2\""
Jul 06 13:46:49.279157 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.279038    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 13:46:49.289168 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.289146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"]
Jul 06 13:46:49.365033 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.364999    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-544d9\" (UniqueName: \"kubernetes.io/projected/da2dd50c-716f-4118-b215-cdc11fb6b6ed-kube-api-access-544d9\") pod \"downloads-685bfb5f64-dcbxl\" (UID: \"da2dd50c-716f-4118-b215-cdc11fb6b6ed\") " pod="openshift-console/downloads-685bfb5f64-dcbxl"
Jul 06 13:46:49.375316 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.375283    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-544d9\" (UniqueName: \"kubernetes.io/projected/da2dd50c-716f-4118-b215-cdc11fb6b6ed-kube-api-access-544d9\") pod \"downloads-685bfb5f64-dcbxl\" (UID: \"da2dd50c-716f-4118-b215-cdc11fb6b6ed\") " pod="openshift-console/downloads-685bfb5f64-dcbxl"
Jul 06 13:46:49.463348 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.463271    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dcbxl"
Jul 06 13:46:49.466429 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.466382    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7281c6e9-0000-4150-b5ae-04c6fd221837-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.466429 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.466421    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xpbm\" (UniqueName: \"kubernetes.io/projected/7281c6e9-0000-4150-b5ae-04c6fd221837-kube-api-access-7xpbm\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.466589 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.466477    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7281c6e9-0000-4150-b5ae-04c6fd221837-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.466589 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.466523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7281c6e9-0000-4150-b5ae-04c6fd221837-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.567871 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.567836    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7281c6e9-0000-4150-b5ae-04c6fd221837-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.568014 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.567908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7281c6e9-0000-4150-b5ae-04c6fd221837-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.568014 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.567942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7281c6e9-0000-4150-b5ae-04c6fd221837-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.568014 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.567975    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xpbm\" (UniqueName: \"kubernetes.io/projected/7281c6e9-0000-4150-b5ae-04c6fd221837-kube-api-access-7xpbm\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.568628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.568604    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7281c6e9-0000-4150-b5ae-04c6fd221837-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.570640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.570615    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7281c6e9-0000-4150-b5ae-04c6fd221837-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.570949 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.570929    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7281c6e9-0000-4150-b5ae-04c6fd221837-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.577028 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.577000    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xpbm\" (UniqueName: \"kubernetes.io/projected/7281c6e9-0000-4150-b5ae-04c6fd221837-kube-api-access-7xpbm\") pod \"prometheus-operator-567f7b8b7c-jkr6g\" (UID: \"7281c6e9-0000-4150-b5ae-04c6fd221837\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.587794 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.587771    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"
Jul 06 13:46:49.603983 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.603962    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dcbxl"]
Jul 06 13:46:49.608829 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:49.608801    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2dd50c_716f_4118_b215_cdc11fb6b6ed.slice/crio-2bdcd6183bbb36ce87c2e79e7d8a316e935f560a3eff850d0e88d22e4b64cff4 WatchSource:0}: Error finding container 2bdcd6183bbb36ce87c2e79e7d8a316e935f560a3eff850d0e88d22e4b64cff4: Status 404 returned error can't find the container with id 2bdcd6183bbb36ce87c2e79e7d8a316e935f560a3eff850d0e88d22e4b64cff4
Jul 06 13:46:49.731116 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:49.731026    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g"]
Jul 06 13:46:49.736921 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:49.736890    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7281c6e9_0000_4150_b5ae_04c6fd221837.slice/crio-4db3ca35258e45487a75509bb151e24c904301dda98dd38ea20be93b3f41a21c WatchSource:0}: Error finding container 4db3ca35258e45487a75509bb151e24c904301dda98dd38ea20be93b3f41a21c: Status 404 returned error can't find the container with id 4db3ca35258e45487a75509bb151e24c904301dda98dd38ea20be93b3f41a21c
Jul 06 13:46:50.240321 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:50.240244    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g" event={"ID":"7281c6e9-0000-4150-b5ae-04c6fd221837","Type":"ContainerStarted","Data":"4db3ca35258e45487a75509bb151e24c904301dda98dd38ea20be93b3f41a21c"}
Jul 06 13:46:50.241566 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:50.241533    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dcbxl" event={"ID":"da2dd50c-716f-4118-b215-cdc11fb6b6ed","Type":"ContainerStarted","Data":"2bdcd6183bbb36ce87c2e79e7d8a316e935f560a3eff850d0e88d22e4b64cff4"}
Jul 06 13:46:51.247599 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:51.247505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnwbq" event={"ID":"c016f9da-3748-49e5-b9da-1c236b05a83a","Type":"ContainerStarted","Data":"bc870fb96b865ea3686e585ab2d973ba8453a32f138dd5568ed65278711ab19a"}
Jul 06 13:46:51.265623 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:51.265545    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dnwbq" podStartSLOduration=33.030643079 podStartE2EDuration="42.265501489s" totalImagesPullingTime="9.23485841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:46:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:51.264199973 +0000 UTC m=+111.024171896" watchObservedRunningTime="2026-07-06 13:46:51.265501489 +0000 UTC m=+111.025473402"
Jul 06 13:46:52.257869 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:52.257748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g" event={"ID":"7281c6e9-0000-4150-b5ae-04c6fd221837","Type":"ContainerStarted","Data":"5964618e75581199c7372ec990cc9722c1c2b8753d61a89ef21ed2d7763e33bc"}
Jul 06 13:46:52.257869 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:52.257824    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g" event={"ID":"7281c6e9-0000-4150-b5ae-04c6fd221837","Type":"ContainerStarted","Data":"70b3112164b6e17eff306842f914f48855c9ba3861f3b77b26f9bd06234fc595"}
Jul 06 13:46:54.219634 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.219606    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8945l"
Jul 06 13:46:54.237376 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.237324    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-jkr6g" podStartSLOduration=2.956095973 podStartE2EDuration="5.237305077s" totalImagesPullingTime="2.281209104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:52.274325182 +0000 UTC m=+112.034297110" watchObservedRunningTime="2026-07-06 13:46:54.237305077 +0000 UTC m=+113.997277002"
Jul 06 13:46:54.617913 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.617883    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"]
Jul 06 13:46:54.621414 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.621393    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.623319 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.623297    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 13:46:54.623443 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.623372    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lr24x\""
Jul 06 13:46:54.623540 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.623518    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 13:46:54.633135 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.633112    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"]
Jul 06 13:46:54.656570 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.656544    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jj6bz"]
Jul 06 13:46:54.660122 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.660101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.662317 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.662289    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 13:46:54.662582 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.662544    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lqf4q\""
Jul 06 13:46:54.662725 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.662706    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 13:46:54.663138 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.663118    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 13:46:54.709581 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709557    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-metrics-client-ca\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.709730 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.709730 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709632    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bw4q\" (UniqueName: \"kubernetes.io/projected/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-kube-api-access-9bw4q\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.709730 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.709730 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709720    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-tls\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.709932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-sys\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.709932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709827    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.709932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709862    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-root\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.709932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-textfile\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.710088 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709936    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.710088 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-wtmp\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.710088 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.709976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.710088 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.710025    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlnng\" (UniqueName: \"kubernetes.io/projected/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-kube-api-access-vlnng\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.811398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-metrics-client-ca\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.811568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bw4q\" (UniqueName: \"kubernetes.io/projected/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-kube-api-access-9bw4q\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811473    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.811568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811497    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-tls\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-sys\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811548    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811568 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-root\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:54.811596    2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-textfile\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:54.811653    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-tls podName:a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5 nodeName:}" failed. No retries permitted until 2026-07-06 13:46:55.311638059 +0000 UTC m=+115.071609959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-xwtqn" (UID: "a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5") : secret "openshift-state-metrics-tls" not found
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811676    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-sys\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-wtmp\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.811926 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlnng\" (UniqueName: \"kubernetes.io/projected/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-kube-api-access-vlnng\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.812325 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811940    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-textfile\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.812325 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.811996    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-root\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.812325 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.812103    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-wtmp\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.812325 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.812131    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-metrics-client-ca\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.812325 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.812274    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.812688 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.812667    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.814307 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.814286    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.814403 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.814314    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-node-exporter-tls\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.814475 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.814460    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.820296 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.820274    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlnng\" (UniqueName: \"kubernetes.io/projected/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-kube-api-access-vlnng\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:54.820755 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.820732    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bw4q\" (UniqueName: \"kubernetes.io/projected/e70da61f-78e0-45cf-a1bb-00ca7ca53d9c-kube-api-access-9bw4q\") pod \"node-exporter-jj6bz\" (UID: \"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c\") " pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.970941 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:54.970871    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jj6bz"
Jul 06 13:46:54.984280 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:54.984253    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70da61f_78e0_45cf_a1bb_00ca7ca53d9c.slice/crio-e5c68d1d03451f0a046a99c54b8a0571fdb1832225de7d1e297ccb9f417f6f90 WatchSource:0}: Error finding container e5c68d1d03451f0a046a99c54b8a0571fdb1832225de7d1e297ccb9f417f6f90: Status 404 returned error can't find the container with id e5c68d1d03451f0a046a99c54b8a0571fdb1832225de7d1e297ccb9f417f6f90
Jul 06 13:46:55.271100 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.271023    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jj6bz" event={"ID":"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c","Type":"ContainerStarted","Data":"e5c68d1d03451f0a046a99c54b8a0571fdb1832225de7d1e297ccb9f417f6f90"}
Jul 06 13:46:55.316527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.316493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:55.319156 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.319129    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xwtqn\" (UID: \"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:55.532587 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.532506    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"
Jul 06 13:46:55.684326 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.684232    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn"]
Jul 06 13:46:55.686837 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.686310    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 13:46:55.691689 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.691669    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.694043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.693657    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 13:46:55.694043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.693915    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 13:46:55.694271 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694253    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 13:46:55.694354 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694291    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 13:46:55.694354 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694343    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 13:46:55.694462 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694294    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 13:46:55.694903 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694615    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 13:46:55.694903 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694680    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 13:46:55.694903 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694616    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qx6n7\""
Jul 06 13:46:55.695189 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.694935    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 13:46:55.710312 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.710091    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 13:46:55.719520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzdpl\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-kube-api-access-zzdpl\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719628 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719625    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719842 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-config-volume\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719842 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719842 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719842 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719842 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-web-config\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719842 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-config-out\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.719842 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719831    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.720182 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.719856    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.820592 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.820546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-config-volume\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.820592 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.820586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.820774 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.820620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.820774 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.820647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.820774 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.820669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-web-config\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.820921 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:55.820802    2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 06 13:46:55.820921 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.820824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-config-out\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.820921 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:55.820864    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls podName:15b415b8-05d7-4a05-829c-f3f04658579a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:56.320842804 +0000 UTC m=+116.080814729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a") : secret "alertmanager-main-tls" not found
Jul 06 13:46:55.821063 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.821121 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821086    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.821174 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.821174 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.821302 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821192    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.821302 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821252    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzdpl\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-kube-api-access-zzdpl\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.821302 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.821711 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.821617    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.823276 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:46:55.823246    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle podName:15b415b8-05d7-4a05-829c-f3f04658579a nodeName:}" failed. No retries permitted until 2026-07-06 13:46:56.323203272 +0000 UTC m=+116.083175187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a") : configmap references non-existent config key: ca-bundle.crt
Jul 06 13:46:55.823749 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.823726    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.826280 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.826178    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.826552 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.826516    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-config-out\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.826730 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.826679    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.826896 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.826873    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.826987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.826844    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.827403 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.827379    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-config-volume\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.827581 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.827555    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.828745 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.828722    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-web-config\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:55.831927 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:55.831899    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzdpl\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-kube-api-access-zzdpl\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:56.277455 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.277420    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn" event={"ID":"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5","Type":"ContainerStarted","Data":"a6156e8d6f918efce7728a4e5b9db4194497aadea1a6be59060cc976aa8f5cf5"}
Jul 06 13:46:56.277771 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.277492    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn" event={"ID":"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5","Type":"ContainerStarted","Data":"cabd03d81da33d5105c8f945f25b7226456b1b06abf0994a80b49906cf837c25"}
Jul 06 13:46:56.277771 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.277522    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn" event={"ID":"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5","Type":"ContainerStarted","Data":"20cc9685f351b7587df337f1e258771162e30a1b399830a2272a77a580c21b09"}
Jul 06 13:46:56.326806 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.326767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:56.326923 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.326882    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:56.328118 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.328088    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:56.329557 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.329531    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:56.612079 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.612042    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:46:56.775545 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:56.775448    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 13:46:56.780883 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:56.780853    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b415b8_05d7_4a05_829c_f3f04658579a.slice/crio-bd4b794a7fac4c7fe347dfb0929baf9d9c5cfe875de708a906311989bb9f5394 WatchSource:0}: Error finding container bd4b794a7fac4c7fe347dfb0929baf9d9c5cfe875de708a906311989bb9f5394: Status 404 returned error can't find the container with id bd4b794a7fac4c7fe347dfb0929baf9d9c5cfe875de708a906311989bb9f5394
Jul 06 13:46:57.282820 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.282771    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerStarted","Data":"bd4b794a7fac4c7fe347dfb0929baf9d9c5cfe875de708a906311989bb9f5394"}
Jul 06 13:46:57.285421 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.285382    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn" event={"ID":"a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5","Type":"ContainerStarted","Data":"796f60a1a25c89bcf708ac682dfdf09adb5561c009ed7c01d6f40ac297dc6d8d"}
Jul 06 13:46:57.287223 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.287177    2572 generic.go:356] "Generic (PLEG): container finished" podID="e70da61f-78e0-45cf-a1bb-00ca7ca53d9c" containerID="8323dac2daacf425d3762e1d27e7a4a0053987551e711ed0baebe85ea28e9891" exitCode=0
Jul 06 13:46:57.287310 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.287245    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jj6bz" event={"ID":"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c","Type":"ContainerDied","Data":"8323dac2daacf425d3762e1d27e7a4a0053987551e711ed0baebe85ea28e9891"}
Jul 06 13:46:57.303446 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.303404    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xwtqn" podStartSLOduration=1.993023862 podStartE2EDuration="3.303390298s" totalImagesPullingTime="1.310366436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:57.302441035 +0000 UTC m=+117.062412957" watchObservedRunningTime="2026-07-06 13:46:57.303390298 +0000 UTC m=+117.063362219"
Jul 06 13:46:57.601516 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.601486    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-569c5cddf8-6595n"]
Jul 06 13:46:57.605513 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.605485    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.607620 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.607588    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 13:46:57.607741 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.607623    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 13:46:57.607741 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.607646    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 13:46:57.608050 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.608026    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 13:46:57.608151 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.608105    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2cl49\""
Jul 06 13:46:57.608151 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.608109    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2dh8grvkgrpo9\""
Jul 06 13:46:57.608373 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.608356    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 13:46:57.619056 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.619033    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-569c5cddf8-6595n"]
Jul 06 13:46:57.638623 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638598    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a942bbe0-8c6e-4c52-898d-0f92821c28c4-metrics-client-ca\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.638734 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638648    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjpjm\" (UniqueName: \"kubernetes.io/projected/a942bbe0-8c6e-4c52-898d-0f92821c28c4-kube-api-access-mjpjm\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.638734 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638689    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.638734 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.638895 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638747    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.638895 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-tls\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.638895 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.639023 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.638928    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-grpc-tls\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739523 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjpjm\" (UniqueName: \"kubernetes.io/projected/a942bbe0-8c6e-4c52-898d-0f92821c28c4-kube-api-access-mjpjm\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739523 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739523 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739541    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-tls\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-grpc-tls\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.739770 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.739730    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a942bbe0-8c6e-4c52-898d-0f92821c28c4-metrics-client-ca\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.740537 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.740509    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a942bbe0-8c6e-4c52-898d-0f92821c28c4-metrics-client-ca\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.743487 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.743452    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.743894 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.743872    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.743991 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.743958    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.744101 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.744080    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-tls\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.744348 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.744326    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.746001 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.745952    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a942bbe0-8c6e-4c52-898d-0f92821c28c4-secret-grpc-tls\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.751320 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.751298    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjpjm\" (UniqueName: \"kubernetes.io/projected/a942bbe0-8c6e-4c52-898d-0f92821c28c4-kube-api-access-mjpjm\") pod \"thanos-querier-569c5cddf8-6595n\" (UID: \"a942bbe0-8c6e-4c52-898d-0f92821c28c4\") " pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:57.917581 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:57.917534    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:46:58.069044 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:58.068780    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-569c5cddf8-6595n"]
Jul 06 13:46:58.259679 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:58.259602    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda942bbe0_8c6e_4c52_898d_0f92821c28c4.slice/crio-8a73b0e4390dc624058d4e1fbaf4034f442c1627138148603ee04199e9b80d02 WatchSource:0}: Error finding container 8a73b0e4390dc624058d4e1fbaf4034f442c1627138148603ee04199e9b80d02: Status 404 returned error can't find the container with id 8a73b0e4390dc624058d4e1fbaf4034f442c1627138148603ee04199e9b80d02
Jul 06 13:46:58.294636 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:58.294572    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jj6bz" event={"ID":"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c","Type":"ContainerStarted","Data":"3a1149d57e38e96cfd65874ccccb09306326e699734f5552beca4ed8c10ca494"}
Jul 06 13:46:58.294636 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:58.294633    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jj6bz" event={"ID":"e70da61f-78e0-45cf-a1bb-00ca7ca53d9c","Type":"ContainerStarted","Data":"09048d735b6a96c051f700bd90c81a5a04043ac91778b78220b18af3215d9964"}
Jul 06 13:46:58.295968 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:58.295944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" event={"ID":"a942bbe0-8c6e-4c52-898d-0f92821c28c4","Type":"ContainerStarted","Data":"8a73b0e4390dc624058d4e1fbaf4034f442c1627138148603ee04199e9b80d02"}
Jul 06 13:46:58.314221 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:58.314167    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jj6bz" podStartSLOduration=2.978167585 podStartE2EDuration="4.314151388s" totalImagesPullingTime="1.261157974s" totalInitContainerRuntime="74.825829ms" isStatefulPod=true podCreationTimestamp="2026-07-06 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:58.313919937 +0000 UTC m=+118.073892076" watchObservedRunningTime="2026-07-06 13:46:58.314151388 +0000 UTC m=+118.074123313"
Jul 06 13:46:59.309008 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.308967    2572 generic.go:356] "Generic (PLEG): container finished" podID="15b415b8-05d7-4a05-829c-f3f04658579a" containerID="b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b" exitCode=0
Jul 06 13:46:59.309504 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.309071    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b"}
Jul 06 13:46:59.417078 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.417045    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"]
Jul 06 13:46:59.420746 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.420719    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.423168 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.423066    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 13:46:59.423307 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.423172    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fsrd7\""
Jul 06 13:46:59.430061 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.430007    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"]
Jul 06 13:46:59.455697 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.455666    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1f91cca-eb43-4472-8e11-08164f8969b7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r2mwx\" (UID: \"d1f91cca-eb43-4472-8e11-08164f8969b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.455832 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.455733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5m8\" (UniqueName: \"kubernetes.io/projected/d1f91cca-eb43-4472-8e11-08164f8969b7-kube-api-access-gp5m8\") pod \"monitoring-plugin-d5dcff7cf-r2mwx\" (UID: \"d1f91cca-eb43-4472-8e11-08164f8969b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.557159 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.557120    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1f91cca-eb43-4472-8e11-08164f8969b7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r2mwx\" (UID: \"d1f91cca-eb43-4472-8e11-08164f8969b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.557322 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.557175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5m8\" (UniqueName: \"kubernetes.io/projected/d1f91cca-eb43-4472-8e11-08164f8969b7-kube-api-access-gp5m8\") pod \"monitoring-plugin-d5dcff7cf-r2mwx\" (UID: \"d1f91cca-eb43-4472-8e11-08164f8969b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.559857 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.559800    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1f91cca-eb43-4472-8e11-08164f8969b7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r2mwx\" (UID: \"d1f91cca-eb43-4472-8e11-08164f8969b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.565032 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.565005    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5m8\" (UniqueName: \"kubernetes.io/projected/d1f91cca-eb43-4472-8e11-08164f8969b7-kube-api-access-gp5m8\") pod \"monitoring-plugin-d5dcff7cf-r2mwx\" (UID: \"d1f91cca-eb43-4472-8e11-08164f8969b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.735227 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.735183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:46:59.899454 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:46:59.899420    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"]
Jul 06 13:46:59.903806 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:46:59.903780    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f91cca_eb43_4472_8e11_08164f8969b7.slice/crio-8864a8d2f038cfcd4c69df7d7b413a4147c5773acfbab35c361f672a3af0361e WatchSource:0}: Error finding container 8864a8d2f038cfcd4c69df7d7b413a4147c5773acfbab35c361f672a3af0361e: Status 404 returned error can't find the container with id 8864a8d2f038cfcd4c69df7d7b413a4147c5773acfbab35c361f672a3af0361e
Jul 06 13:47:00.316752 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.316710    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx" event={"ID":"d1f91cca-eb43-4472-8e11-08164f8969b7","Type":"ContainerStarted","Data":"8864a8d2f038cfcd4c69df7d7b413a4147c5773acfbab35c361f672a3af0361e"}
Jul 06 13:47:00.895930 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.895893    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:47:00.900240 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.900197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.902742 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.902714    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 13:47:00.903757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.903732    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 13:47:00.911235 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.909909    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 13:47:00.911235 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.910719    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 13:47:00.911235 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.910734    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 13:47:00.911235 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.911061    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 13:47:00.911753 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.911341    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 13:47:00.911753 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.911671    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 13:47:00.912184 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.912156    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 13:47:00.912357 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.912198    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 13:47:00.912803 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.912783    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 13:47:00.912906 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.912801    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 13:47:00.913385 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.913365    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 13:47:00.913566 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.913548    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bce1l4ph05ep0\""
Jul 06 13:47:00.913642 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.913574    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 13:47:00.913708 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.913686    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-65zx5\""
Jul 06 13:47:00.913765 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.913731    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 13:47:00.919084 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.919065    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:47:00.971027 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971000    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971175 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971041    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971175 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971175 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971123    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971175 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971154    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971420 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971420 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971420 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971420 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpl94\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-kube-api-access-qpl94\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971420 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971420 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971502    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-config\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971540    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971578    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:00.971757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:00.971698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072560 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072560 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072678    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072702    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072757    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.072800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpl94\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-kube-api-access-qpl94\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.072977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.073011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.073120 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.073041    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.073745    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.074244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-config\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.074290    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.074317    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.074355    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.074493    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.074696    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.074970    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.075640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.075074    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.076602 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.076573    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.079142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.078292    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.079142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.078303    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.079142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.078468    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.079142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.078695    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-config\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.079142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.078998    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.079142 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.079100    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.079515 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.079154    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.080086 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.080026    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.080691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.080629    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.080814 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.080793    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.080874 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.080838    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.081431 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.081409    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.093906 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.093864    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpl94\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-kube-api-access-qpl94\") pod \"prometheus-k8s-0\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:01.218044 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:01.217966    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:47:09.172491 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:09.172465    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:47:09.491870 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:47:09.491794    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb1a192_91de_464e_ae80_ce7a44ab9584.slice/crio-39d1ee0213c78cbaf3ebd73799f40dd259f763e6b873b16845ca60fd63e96c82 WatchSource:0}: Error finding container 39d1ee0213c78cbaf3ebd73799f40dd259f763e6b873b16845ca60fd63e96c82: Status 404 returned error can't find the container with id 39d1ee0213c78cbaf3ebd73799f40dd259f763e6b873b16845ca60fd63e96c82
Jul 06 13:47:10.366817 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.366773    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerStarted","Data":"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"}
Jul 06 13:47:10.367310 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.366904    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerStarted","Data":"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"}
Jul 06 13:47:10.367310 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.366950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerStarted","Data":"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"}
Jul 06 13:47:10.367310 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.366990    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerStarted","Data":"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"}
Jul 06 13:47:10.367310 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.367030    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerStarted","Data":"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"}
Jul 06 13:47:10.368680 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.368649    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx" event={"ID":"d1f91cca-eb43-4472-8e11-08164f8969b7","Type":"ContainerStarted","Data":"5c8144b89bbd890be3fd99a6086c7ebdd6b6f7f54294bfb19eef131d45206a77"}
Jul 06 13:47:10.368807 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.368712    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:47:10.371651 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.371620    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" event={"ID":"a942bbe0-8c6e-4c52-898d-0f92821c28c4","Type":"ContainerStarted","Data":"e92583fac9eb07a280ebbbcd1c2f50347e87c974061bfc0b89e4cff488523cea"}
Jul 06 13:47:10.371765 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.371717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" event={"ID":"a942bbe0-8c6e-4c52-898d-0f92821c28c4","Type":"ContainerStarted","Data":"0b53f7af5538956ce336b178f222fba71f30f6d071979e19f072df0622344606"}
Jul 06 13:47:10.371831 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.371807    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" event={"ID":"a942bbe0-8c6e-4c52-898d-0f92821c28c4","Type":"ContainerStarted","Data":"e0901a0ac22044b065e6aa197a2d2a3b45ea96a75285c2a22fcab2d28ed893b9"}
Jul 06 13:47:10.373959 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.373939    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dcbxl" event={"ID":"da2dd50c-716f-4118-b215-cdc11fb6b6ed","Type":"ContainerStarted","Data":"42b7fd7ecbd04531655f91e6eaf3e8f73bcc6848ddae1dbfd4d29845e9c0e07d"}
Jul 06 13:47:10.374143 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.374120    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-dcbxl"
Jul 06 13:47:10.375711 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.375690    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx"
Jul 06 13:47:10.375851 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.375831    2572 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80" exitCode=0
Jul 06 13:47:10.375911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.375860    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"}
Jul 06 13:47:10.375911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.375903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerStarted","Data":"39d1ee0213c78cbaf3ebd73799f40dd259f763e6b873b16845ca60fd63e96c82"}
Jul 06 13:47:10.383820 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.383797    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-dcbxl"
Jul 06 13:47:10.385519 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.385474    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r2mwx" podStartSLOduration=1.449243243 podStartE2EDuration="11.385458398s" totalImagesPullingTime="9.936215155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:10.384715082 +0000 UTC m=+130.144687007" watchObservedRunningTime="2026-07-06 13:47:10.385458398 +0000 UTC m=+130.145430333"
Jul 06 13:47:10.400197 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.400143    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-dcbxl" podStartSLOduration=1.5186534040000002 podStartE2EDuration="21.400127286s" totalImagesPullingTime="19.881473882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:10.399988947 +0000 UTC m=+130.159960881" watchObservedRunningTime="2026-07-06 13:47:10.400127286 +0000 UTC m=+130.160099208"
Jul 06 13:47:10.465288 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.464733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:47:10.468825 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.468791    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b4ded86-3754-4f04-9b08-77550d187284-metrics-certs\") pod \"network-metrics-daemon-chsg7\" (UID: \"3b4ded86-3754-4f04-9b08-77550d187284\") " pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:47:10.477158 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.477132    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdk7g\""
Jul 06 13:47:10.485104 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.485077    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chsg7"
Jul 06 13:47:10.675889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:10.675809    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chsg7"]
Jul 06 13:47:10.682285 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:47:10.682248    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4ded86_3754_4f04_9b08_77550d187284.slice/crio-8bd8b83deb44c95a59f442828b659e4af0ffcca892cef927411996fcaf0a4e28 WatchSource:0}: Error finding container 8bd8b83deb44c95a59f442828b659e4af0ffcca892cef927411996fcaf0a4e28: Status 404 returned error can't find the container with id 8bd8b83deb44c95a59f442828b659e4af0ffcca892cef927411996fcaf0a4e28
Jul 06 13:47:11.382708 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:11.382663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chsg7" event={"ID":"3b4ded86-3754-4f04-9b08-77550d187284","Type":"ContainerStarted","Data":"8bd8b83deb44c95a59f442828b659e4af0ffcca892cef927411996fcaf0a4e28"}
Jul 06 13:47:12.393363 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:12.393326    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" event={"ID":"a942bbe0-8c6e-4c52-898d-0f92821c28c4","Type":"ContainerStarted","Data":"6418efa3a322e8ff7b714e5c6c0ec256a15f72fb724d655c06f5aa1007ef021d"}
Jul 06 13:47:12.393829 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:12.393403    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" event={"ID":"a942bbe0-8c6e-4c52-898d-0f92821c28c4","Type":"ContainerStarted","Data":"fcccf828c31b210558ccc8b00dc79d1ea45198f2e1eb669c762fde6ccc7a20f3"}
Jul 06 13:47:12.393829 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:12.393440    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" event={"ID":"a942bbe0-8c6e-4c52-898d-0f92821c28c4","Type":"ContainerStarted","Data":"8396866c22255c6930ca45e9fa34d3ff3e406be05ef31474fb7303f3fc14bc0d"}
Jul 06 13:47:12.393829 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:12.393608    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:47:12.399470 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:12.399437    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerStarted","Data":"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"}
Jul 06 13:47:12.417018 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:12.416962    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n" podStartSLOduration=2.980151188 podStartE2EDuration="15.416942217s" totalImagesPullingTime="12.436791029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:12.416110696 +0000 UTC m=+132.176082635" watchObservedRunningTime="2026-07-06 13:47:12.416942217 +0000 UTC m=+132.176914141"
Jul 06 13:47:12.445074 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:12.444977    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.761313668 podStartE2EDuration="17.4449554s" totalImagesPullingTime="12.668616399s" totalInitContainerRuntime="15.025333ms" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:12.443707386 +0000 UTC m=+132.203679321" watchObservedRunningTime="2026-07-06 13:47:12.4449554 +0000 UTC m=+132.204927327"
Jul 06 13:47:13.407953 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:13.407911    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chsg7" event={"ID":"3b4ded86-3754-4f04-9b08-77550d187284","Type":"ContainerStarted","Data":"9194900b87d9e38ae2e9472f622a2a25ea1ea486c6513df0a6d1ab1db92aba08"}
Jul 06 13:47:13.408677 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:13.407980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chsg7" event={"ID":"3b4ded86-3754-4f04-9b08-77550d187284","Type":"ContainerStarted","Data":"0cec61af8ef90b37bea72cbf2c9583900170211c645dbbd6b8283927148b6ead"}
Jul 06 13:47:13.427647 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:13.427491    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-chsg7" podStartSLOduration=131.171477809 podStartE2EDuration="2m13.427469768s" totalImagesPullingTime="2.255991959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:13.426489674 +0000 UTC m=+133.186461604" watchObservedRunningTime="2026-07-06 13:47:13.427469768 +0000 UTC m=+133.187441690"
Jul 06 13:47:14.415241 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:14.414921    2572 generic.go:356] "Generic (PLEG): container finished" podID="3b6992ce-ea53-4b36-8e03-c30ad094362d" containerID="015851814a8d6f12677b4e9d1a6c1e1c9a690aaefc899fa2d29164446b26dbbd" exitCode=0
Jul 06 13:47:14.415241 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:14.415029    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t" event={"ID":"3b6992ce-ea53-4b36-8e03-c30ad094362d","Type":"ContainerDied","Data":"015851814a8d6f12677b4e9d1a6c1e1c9a690aaefc899fa2d29164446b26dbbd"}
Jul 06 13:47:14.415849 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:14.415731    2572 scope.go:117] "RemoveContainer" containerID="015851814a8d6f12677b4e9d1a6c1e1c9a690aaefc899fa2d29164446b26dbbd"
Jul 06 13:47:16.430819 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:16.430774    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-n5m7t" event={"ID":"3b6992ce-ea53-4b36-8e03-c30ad094362d","Type":"ContainerStarted","Data":"ca39bd13fbb3f5ef17eea2e664cda71decd99c8597e4b81649d769042f9570e6"}
Jul 06 13:47:16.434386 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:16.434359    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerStarted","Data":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"}
Jul 06 13:47:16.434853 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:16.434831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerStarted","Data":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"}
Jul 06 13:47:17.443466 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:17.443425    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerStarted","Data":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"}
Jul 06 13:47:17.443932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:17.443509    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerStarted","Data":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"}
Jul 06 13:47:17.443932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:17.443539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerStarted","Data":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"}
Jul 06 13:47:17.443932 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:17.443578    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerStarted","Data":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"}
Jul 06 13:47:17.477043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:17.476981    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=11.694544957 podStartE2EDuration="17.476962694s" totalImagesPullingTime="5.720158562s" totalInitContainerRuntime="62.259175ms" isStatefulPod=false podCreationTimestamp="2026-07-06 13:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:47:17.4753714 +0000 UTC m=+137.235343324" watchObservedRunningTime="2026-07-06 13:47:17.476962694 +0000 UTC m=+137.236934615"
Jul 06 13:47:18.415764 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:18.415737    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-569c5cddf8-6595n"
Jul 06 13:47:21.218408 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:47:21.218369    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:01.218470 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:01.218432    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:01.234286 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:01.234261    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:01.633516 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:01.633490    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:14.962437 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:14.962405    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 13:48:14.962942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:14.962686    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="alertmanager" containerID="cri-o://5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad" gracePeriod=120
Jul 06 13:48:14.962942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:14.962760    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-metric" containerID="cri-o://818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5" gracePeriod=120
Jul 06 13:48:14.962942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:14.962778    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-web" containerID="cri-o://27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4" gracePeriod=120
Jul 06 13:48:14.962942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:14.962801    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="config-reloader" containerID="cri-o://3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7" gracePeriod=120
Jul 06 13:48:14.962942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:14.962821    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy" containerID="cri-o://cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab" gracePeriod=120
Jul 06 13:48:14.962942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:14.962902    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="prom-label-proxy" containerID="cri-o://f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f" gracePeriod=120
Jul 06 13:48:15.679531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679498    2572 generic.go:356] "Generic (PLEG): container finished" podID="15b415b8-05d7-4a05-829c-f3f04658579a" containerID="f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f" exitCode=0
Jul 06 13:48:15.679531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679521    2572 generic.go:356] "Generic (PLEG): container finished" podID="15b415b8-05d7-4a05-829c-f3f04658579a" containerID="cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab" exitCode=0
Jul 06 13:48:15.679531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679529    2572 generic.go:356] "Generic (PLEG): container finished" podID="15b415b8-05d7-4a05-829c-f3f04658579a" containerID="3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7" exitCode=0
Jul 06 13:48:15.679531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679536    2572 generic.go:356] "Generic (PLEG): container finished" podID="15b415b8-05d7-4a05-829c-f3f04658579a" containerID="5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad" exitCode=0
Jul 06 13:48:15.679781 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679566    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"}
Jul 06 13:48:15.679781 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"}
Jul 06 13:48:15.679781 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"}
Jul 06 13:48:15.679781 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:15.679703    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"}
Jul 06 13:48:16.209810 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.209786    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:48:16.246873 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.246846    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-web\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.246900    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.246930    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-config-out\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.246963    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-main-db\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.246998    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-web-config\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247043 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247027    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-config-volume\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247066    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247109    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247145    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzdpl\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-kube-api-access-zzdpl\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247189    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-tls-assets\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247244    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-cluster-tls-config\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247278    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.247343 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247307    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-metrics-client-ca\") pod \"15b415b8-05d7-4a05-829c-f3f04658579a\" (UID: \"15b415b8-05d7-4a05-829c-f3f04658579a\") "
Jul 06 13:48:16.248164 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.247899    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:16.249820 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.249790    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:48:16.249922 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.249835    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:16.250145 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.250107    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:16.250948 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.250889    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-kube-api-access-zzdpl" (OuterVolumeSpecName: "kube-api-access-zzdpl") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "kube-api-access-zzdpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:48:16.251038 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.250976    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:16.251595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.251546    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-config-volume" (OuterVolumeSpecName: "config-volume") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:16.253269 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.253090    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:16.253466 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.253406    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:48:16.254029 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.254006    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-config-out" (OuterVolumeSpecName: "config-out") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:48:16.255513 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.255483    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:16.257634 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.257609    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:16.265827 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.265800    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-web-config" (OuterVolumeSpecName: "web-config") pod "15b415b8-05d7-4a05-829c-f3f04658579a" (UID: "15b415b8-05d7-4a05-829c-f3f04658579a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348103    2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-main-db\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348139    2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-web-config\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348149    2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-config-volume\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348158    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348168    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348178    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzdpl\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-kube-api-access-zzdpl\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348186    2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15b415b8-05d7-4a05-829c-f3f04658579a-tls-assets\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348193    2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-cluster-tls-config\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348187 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348201    2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348579 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348229    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15b415b8-05d7-4a05-829c-f3f04658579a-metrics-client-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348579 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348238    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348579 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348246    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/15b415b8-05d7-4a05-829c-f3f04658579a-secret-alertmanager-main-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.348579 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.348253    2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15b415b8-05d7-4a05-829c-f3f04658579a-config-out\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:16.693752 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.693715    2572 generic.go:356] "Generic (PLEG): container finished" podID="15b415b8-05d7-4a05-829c-f3f04658579a" containerID="818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5" exitCode=0
Jul 06 13:48:16.693752 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.693745    2572 generic.go:356] "Generic (PLEG): container finished" podID="15b415b8-05d7-4a05-829c-f3f04658579a" containerID="27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4" exitCode=0
Jul 06 13:48:16.693940 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.693774    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"}
Jul 06 13:48:16.693940 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.693800    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 13:48:16.693940 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.693853    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"}
Jul 06 13:48:16.693940 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.693879    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"15b415b8-05d7-4a05-829c-f3f04658579a","Type":"ContainerDied","Data":"bd4b794a7fac4c7fe347dfb0929baf9d9c5cfe875de708a906311989bb9f5394"}
Jul 06 13:48:16.693940 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.693906    2572 scope.go:117] "RemoveContainer" containerID="f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"
Jul 06 13:48:16.704125 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.704110    2572 scope.go:117] "RemoveContainer" containerID="818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"
Jul 06 13:48:16.710896 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.710866    2572 scope.go:117] "RemoveContainer" containerID="cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"
Jul 06 13:48:16.718410 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.718301    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 13:48:16.722375 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.722353    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 13:48:16.722748 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.722725    2572 scope.go:117] "RemoveContainer" containerID="27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"
Jul 06 13:48:16.729554 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.729532    2572 scope.go:117] "RemoveContainer" containerID="3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"
Jul 06 13:48:16.736160 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.736144    2572 scope.go:117] "RemoveContainer" containerID="5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"
Jul 06 13:48:16.742899 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.742885    2572 scope.go:117] "RemoveContainer" containerID="b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b"
Jul 06 13:48:16.749694 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.749675    2572 scope.go:117] "RemoveContainer" containerID="f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"
Jul 06 13:48:16.749943 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:16.749921    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f\": container with ID starting with f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f not found: ID does not exist" containerID="f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"
Jul 06 13:48:16.750021 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.749949    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"} err="failed to get container status \"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f\": rpc error: code = NotFound desc = could not find container \"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f\": container with ID starting with f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f not found: ID does not exist"
Jul 06 13:48:16.750021 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.749980    2572 scope.go:117] "RemoveContainer" containerID="818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"
Jul 06 13:48:16.750223 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:16.750191    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5\": container with ID starting with 818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5 not found: ID does not exist" containerID="818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"
Jul 06 13:48:16.750270 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750225    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"} err="failed to get container status \"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5\": rpc error: code = NotFound desc = could not find container \"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5\": container with ID starting with 818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5 not found: ID does not exist"
Jul 06 13:48:16.750270 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750239    2572 scope.go:117] "RemoveContainer" containerID="cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"
Jul 06 13:48:16.750430 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:16.750415    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab\": container with ID starting with cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab not found: ID does not exist" containerID="cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"
Jul 06 13:48:16.750472 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750433    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"} err="failed to get container status \"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab\": rpc error: code = NotFound desc = could not find container \"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab\": container with ID starting with cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab not found: ID does not exist"
Jul 06 13:48:16.750472 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750445    2572 scope.go:117] "RemoveContainer" containerID="27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"
Jul 06 13:48:16.750640 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:16.750619    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4\": container with ID starting with 27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4 not found: ID does not exist" containerID="27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"
Jul 06 13:48:16.750686 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750646    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"} err="failed to get container status \"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4\": rpc error: code = NotFound desc = could not find container \"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4\": container with ID starting with 27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4 not found: ID does not exist"
Jul 06 13:48:16.750686 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750662    2572 scope.go:117] "RemoveContainer" containerID="3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"
Jul 06 13:48:16.750865 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:16.750849    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7\": container with ID starting with 3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7 not found: ID does not exist" containerID="3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"
Jul 06 13:48:16.750907 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750867    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"} err="failed to get container status \"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7\": rpc error: code = NotFound desc = could not find container \"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7\": container with ID starting with 3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7 not found: ID does not exist"
Jul 06 13:48:16.750907 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.750879    2572 scope.go:117] "RemoveContainer" containerID="5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"
Jul 06 13:48:16.751100 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:16.751084    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad\": container with ID starting with 5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad not found: ID does not exist" containerID="5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"
Jul 06 13:48:16.751138 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751107    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"} err="failed to get container status \"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad\": rpc error: code = NotFound desc = could not find container \"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad\": container with ID starting with 5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad not found: ID does not exist"
Jul 06 13:48:16.751138 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751124    2572 scope.go:117] "RemoveContainer" containerID="b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b"
Jul 06 13:48:16.751349 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:16.751330    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b\": container with ID starting with b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b not found: ID does not exist" containerID="b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b"
Jul 06 13:48:16.751389 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751353    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b"} err="failed to get container status \"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b\": rpc error: code = NotFound desc = could not find container \"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b\": container with ID starting with b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b not found: ID does not exist"
Jul 06 13:48:16.751389 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751365    2572 scope.go:117] "RemoveContainer" containerID="f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"
Jul 06 13:48:16.751590 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751573    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f"} err="failed to get container status \"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f\": rpc error: code = NotFound desc = could not find container \"f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f\": container with ID starting with f4aed6413a17da14410ec25a3e0b6354f6b086cf51f2e79a0bb6213b5e3d600f not found: ID does not exist"
Jul 06 13:48:16.751633 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751592    2572 scope.go:117] "RemoveContainer" containerID="818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"
Jul 06 13:48:16.751788 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751770    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5"} err="failed to get container status \"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5\": rpc error: code = NotFound desc = could not find container \"818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5\": container with ID starting with 818ade625db9d45e6ca52275c51a4f22d0738b249029842aaf307510457da1c5 not found: ID does not exist"
Jul 06 13:48:16.751829 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751790    2572 scope.go:117] "RemoveContainer" containerID="cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"
Jul 06 13:48:16.751992 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751976    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab"} err="failed to get container status \"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab\": rpc error: code = NotFound desc = could not find container \"cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab\": container with ID starting with cba6fe54b0ceed8894c7eca68c906190124bd0519884542f89886591fee2f8ab not found: ID does not exist"
Jul 06 13:48:16.752034 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.751992    2572 scope.go:117] "RemoveContainer" containerID="27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"
Jul 06 13:48:16.752192 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.752174    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4"} err="failed to get container status \"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4\": rpc error: code = NotFound desc = could not find container \"27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4\": container with ID starting with 27c3d09e9e90134f28e5bbab8f87255dbf7f73330e578d95365e685e752519e4 not found: ID does not exist"
Jul 06 13:48:16.752285 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.752193    2572 scope.go:117] "RemoveContainer" containerID="3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"
Jul 06 13:48:16.752443 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.752427    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7"} err="failed to get container status \"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7\": rpc error: code = NotFound desc = could not find container \"3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7\": container with ID starting with 3f90866abed0c57ad1a9592f5a6e878de50e56e9958b869da061077f8bd075f7 not found: ID does not exist"
Jul 06 13:48:16.752487 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.752444    2572 scope.go:117] "RemoveContainer" containerID="5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"
Jul 06 13:48:16.752644 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.752629    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad"} err="failed to get container status \"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad\": rpc error: code = NotFound desc = could not find container \"5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad\": container with ID starting with 5af30489222015b93d84d67aa29a8f2abc15cfb3ae435b6d27f1170a7de392ad not found: ID does not exist"
Jul 06 13:48:16.752685 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.752645    2572 scope.go:117] "RemoveContainer" containerID="b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b"
Jul 06 13:48:16.752829 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.752814    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b"} err="failed to get container status \"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b\": rpc error: code = NotFound desc = could not find container \"b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b\": container with ID starting with b29fb0a3c9f9f028861bbb02c34b77503d9597d2ad6e89c22b927507d9a8a01b not found: ID does not exist"
Jul 06 13:48:16.759900 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:16.759880    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" path="/var/lib/kubelet/pods/15b415b8-05d7-4a05-829c-f3f04658579a/volumes"
Jul 06 13:48:19.214901 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.214861    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:48:19.215527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.215493    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="prometheus" containerID="cri-o://17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683" gracePeriod=600
Jul 06 13:48:19.215648 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.215538    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy" containerID="cri-o://d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9" gracePeriod=600
Jul 06 13:48:19.215648 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.215566    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731" gracePeriod=600
Jul 06 13:48:19.215648 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.215589    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-web" containerID="cri-o://cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659" gracePeriod=600
Jul 06 13:48:19.215794 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.215567    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="thanos-sidecar" containerID="cri-o://847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59" gracePeriod=600
Jul 06 13:48:19.215794 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.215684    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="config-reloader" containerID="cri-o://5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8" gracePeriod=600
Jul 06 13:48:19.469974 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.469917    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.566711 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566667    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-2\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.566867 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566747    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-web-config\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.566867 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566765    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpl94\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-kube-api-access-qpl94\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.566867 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566795    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-trusted-ca-bundle\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.566867 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566812    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-kubelet-serving-ca-bundle\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.566867 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566829    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-db\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.566867 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566848    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.567123 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566876    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-config-out\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.567123 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566908    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-0\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.567123 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566941    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-thanos-prometheus-http-client-file\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.567531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.567500    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:19.567774 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.567744    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:19.567949 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.566952    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:19.568095 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568066    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:48:19.568192 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568082    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-serving-certs-ca-bundle\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.568352 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568333    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-1\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.568475 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568460    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.568868 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568851    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-tls-assets\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.568996 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568980    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-metrics-client-ca\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.569127 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.569113    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-kube-rbac-proxy\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.569252 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.569237    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-metrics-client-certs\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.569377 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.569364    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-config\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.569482 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.569469    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-grpc-tls\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.569598 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.569583    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-tls\") pod \"1bb1a192-91de-464e-ae80-ce7a44ab9584\" (UID: \"1bb1a192-91de-464e-ae80-ce7a44ab9584\") "
Jul 06 13:48:19.570068 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.570047    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.570520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.570164    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.570520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.570185    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.570520 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.570200    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-db\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.570722 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568343    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:19.570722 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568659    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:19.570722 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.568856    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:19.570722 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.569701    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-kube-api-access-qpl94" (OuterVolumeSpecName: "kube-api-access-qpl94") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "kube-api-access-qpl94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:48:19.570722 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.570235    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-config-out" (OuterVolumeSpecName: "config-out") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:48:19.570722 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.570637    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.571879 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.571691    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.571879 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.571789    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:48:19.575902 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.575386    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-config" (OuterVolumeSpecName: "config") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.575902 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.575521    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:48:19.575902 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.575630    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.576098 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.575956    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.576311 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.576264    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.577059 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.577038    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.577474 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.577456    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.585070 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.585051    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-web-config" (OuterVolumeSpecName: "web-config") pod "1bb1a192-91de-464e-ae80-ce7a44ab9584" (UID: "1bb1a192-91de-464e-ae80-ce7a44ab9584"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:48:19.670761 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670718    2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670761 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670757    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670761 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670768    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670779    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670790    2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-tls-assets\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670798    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-configmap-metrics-client-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670807    2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-kube-rbac-proxy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670814    2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-metrics-client-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670823    2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-config\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670830    2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-grpc-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670840    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670847    2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-web-config\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670855    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpl94\" (UniqueName: \"kubernetes.io/projected/1bb1a192-91de-464e-ae80-ce7a44ab9584-kube-api-access-qpl94\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670863    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bb1a192-91de-464e-ae80-ce7a44ab9584-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670871    2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb1a192-91de-464e-ae80-ce7a44ab9584-config-out\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.670962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.670879    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bb1a192-91de-464e-ae80-ce7a44ab9584-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:48:19.708752 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708722    2572 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731" exitCode=0
Jul 06 13:48:19.708752 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708746    2572 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9" exitCode=0
Jul 06 13:48:19.708752 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708753    2572 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659" exitCode=0
Jul 06 13:48:19.708911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708759    2572 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59" exitCode=0
Jul 06 13:48:19.708911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708764    2572 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8" exitCode=0
Jul 06 13:48:19.708911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708770    2572 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683" exitCode=0
Jul 06 13:48:19.708911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708805    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.708911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708806    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"}
Jul 06 13:48:19.708911 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708897    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"}
Jul 06 13:48:19.709082 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708946    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"}
Jul 06 13:48:19.709082 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"}
Jul 06 13:48:19.709082 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708971    2572 scope.go:117] "RemoveContainer" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.709082 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.708995    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"}
Jul 06 13:48:19.709082 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.709019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"}
Jul 06 13:48:19.709082 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.709042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bb1a192-91de-464e-ae80-ce7a44ab9584","Type":"ContainerDied","Data":"39d1ee0213c78cbaf3ebd73799f40dd259f763e6b873b16845ca60fd63e96c82"}
Jul 06 13:48:19.716732 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.716713    2572 scope.go:117] "RemoveContainer" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.723742 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.723726    2572 scope.go:117] "RemoveContainer" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.730196 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.730179    2572 scope.go:117] "RemoveContainer" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.732545 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.732525    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:48:19.736101 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.736082    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:48:19.737800 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.737786    2572 scope.go:117] "RemoveContainer" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.744110 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.744093    2572 scope.go:117] "RemoveContainer" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.751141 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.751126    2572 scope.go:117] "RemoveContainer" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.757422 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.757405    2572 scope.go:117] "RemoveContainer" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.757659 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:19.757642    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": container with ID starting with ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731 not found: ID does not exist" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.757712 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.757668    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"} err="failed to get container status \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": rpc error: code = NotFound desc = could not find container \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": container with ID starting with ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731 not found: ID does not exist"
Jul 06 13:48:19.757712 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.757685    2572 scope.go:117] "RemoveContainer" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.757927 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:19.757913    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": container with ID starting with d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9 not found: ID does not exist" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.757968 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.757928    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"} err="failed to get container status \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": rpc error: code = NotFound desc = could not find container \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": container with ID starting with d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9 not found: ID does not exist"
Jul 06 13:48:19.757968 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.757939    2572 scope.go:117] "RemoveContainer" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.758115 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:19.758101    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": container with ID starting with cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659 not found: ID does not exist" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.758150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758116    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"} err="failed to get container status \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": rpc error: code = NotFound desc = could not find container \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": container with ID starting with cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659 not found: ID does not exist"
Jul 06 13:48:19.758150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758128    2572 scope.go:117] "RemoveContainer" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.758344 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:19.758329    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": container with ID starting with 847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59 not found: ID does not exist" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.758382 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758349    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"} err="failed to get container status \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": rpc error: code = NotFound desc = could not find container \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": container with ID starting with 847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59 not found: ID does not exist"
Jul 06 13:48:19.758382 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758363    2572 scope.go:117] "RemoveContainer" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.758586 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:19.758570    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": container with ID starting with 5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8 not found: ID does not exist" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.758639 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758589    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"} err="failed to get container status \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": rpc error: code = NotFound desc = could not find container \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": container with ID starting with 5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8 not found: ID does not exist"
Jul 06 13:48:19.758639 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758602    2572 scope.go:117] "RemoveContainer" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.758786 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:19.758768    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": container with ID starting with 17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683 not found: ID does not exist" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.758823 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758790    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"} err="failed to get container status \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": rpc error: code = NotFound desc = could not find container \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": container with ID starting with 17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683 not found: ID does not exist"
Jul 06 13:48:19.758823 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.758802    2572 scope.go:117] "RemoveContainer" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.759007 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:48:19.758991    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": container with ID starting with 39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80 not found: ID does not exist" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.759054 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759009    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"} err="failed to get container status \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": rpc error: code = NotFound desc = could not find container \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": container with ID starting with 39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80 not found: ID does not exist"
Jul 06 13:48:19.759054 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759020    2572 scope.go:117] "RemoveContainer" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.759233 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759204    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"} err="failed to get container status \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": rpc error: code = NotFound desc = could not find container \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": container with ID starting with ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731 not found: ID does not exist"
Jul 06 13:48:19.759233 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759233    2572 scope.go:117] "RemoveContainer" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.759455 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759437    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"} err="failed to get container status \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": rpc error: code = NotFound desc = could not find container \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": container with ID starting with d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9 not found: ID does not exist"
Jul 06 13:48:19.759531 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759456    2572 scope.go:117] "RemoveContainer" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.759693 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759672    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"} err="failed to get container status \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": rpc error: code = NotFound desc = could not find container \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": container with ID starting with cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659 not found: ID does not exist"
Jul 06 13:48:19.759693 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759691    2572 scope.go:117] "RemoveContainer" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.759871 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759856    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"} err="failed to get container status \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": rpc error: code = NotFound desc = could not find container \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": container with ID starting with 847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59 not found: ID does not exist"
Jul 06 13:48:19.759871 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.759870    2572 scope.go:117] "RemoveContainer" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.760049 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760035    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"} err="failed to get container status \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": rpc error: code = NotFound desc = could not find container \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": container with ID starting with 5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8 not found: ID does not exist"
Jul 06 13:48:19.760096 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760059    2572 scope.go:117] "RemoveContainer" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.760237 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760222    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"} err="failed to get container status \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": rpc error: code = NotFound desc = could not find container \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": container with ID starting with 17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683 not found: ID does not exist"
Jul 06 13:48:19.760285 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760237    2572 scope.go:117] "RemoveContainer" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.760398 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760383    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"} err="failed to get container status \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": rpc error: code = NotFound desc = could not find container \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": container with ID starting with 39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80 not found: ID does not exist"
Jul 06 13:48:19.760443 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760398    2572 scope.go:117] "RemoveContainer" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.760559 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760544    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"} err="failed to get container status \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": rpc error: code = NotFound desc = could not find container \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": container with ID starting with ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731 not found: ID does not exist"
Jul 06 13:48:19.760600 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760560    2572 scope.go:117] "RemoveContainer" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.760734 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760720    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"} err="failed to get container status \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": rpc error: code = NotFound desc = could not find container \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": container with ID starting with d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9 not found: ID does not exist"
Jul 06 13:48:19.760780 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760734    2572 scope.go:117] "RemoveContainer" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.760942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760928    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"} err="failed to get container status \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": rpc error: code = NotFound desc = could not find container \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": container with ID starting with cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659 not found: ID does not exist"
Jul 06 13:48:19.760987 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.760943    2572 scope.go:117] "RemoveContainer" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.761109 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761096    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"} err="failed to get container status \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": rpc error: code = NotFound desc = could not find container \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": container with ID starting with 847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59 not found: ID does not exist"
Jul 06 13:48:19.761150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761110    2572 scope.go:117] "RemoveContainer" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.761315 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761287    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"} err="failed to get container status \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": rpc error: code = NotFound desc = could not find container \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": container with ID starting with 5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8 not found: ID does not exist"
Jul 06 13:48:19.761363 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761317    2572 scope.go:117] "RemoveContainer" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.761534 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761519    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"} err="failed to get container status \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": rpc error: code = NotFound desc = could not find container \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": container with ID starting with 17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683 not found: ID does not exist"
Jul 06 13:48:19.761534 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761533    2572 scope.go:117] "RemoveContainer" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.761723 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761707    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"} err="failed to get container status \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": rpc error: code = NotFound desc = could not find container \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": container with ID starting with 39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80 not found: ID does not exist"
Jul 06 13:48:19.761765 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761723    2572 scope.go:117] "RemoveContainer" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.761900 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761881    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"} err="failed to get container status \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": rpc error: code = NotFound desc = could not find container \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": container with ID starting with ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731 not found: ID does not exist"
Jul 06 13:48:19.761944 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.761902    2572 scope.go:117] "RemoveContainer" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.762083 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762065    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"} err="failed to get container status \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": rpc error: code = NotFound desc = could not find container \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": container with ID starting with d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9 not found: ID does not exist"
Jul 06 13:48:19.762133 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762083    2572 scope.go:117] "RemoveContainer" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.762313 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762289    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"} err="failed to get container status \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": rpc error: code = NotFound desc = could not find container \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": container with ID starting with cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659 not found: ID does not exist"
Jul 06 13:48:19.762365 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762315    2572 scope.go:117] "RemoveContainer" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.762590 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762544    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"} err="failed to get container status \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": rpc error: code = NotFound desc = could not find container \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": container with ID starting with 847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59 not found: ID does not exist"
Jul 06 13:48:19.762590 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762577    2572 scope.go:117] "RemoveContainer" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.762891 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762867    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"} err="failed to get container status \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": rpc error: code = NotFound desc = could not find container \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": container with ID starting with 5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8 not found: ID does not exist"
Jul 06 13:48:19.762968 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.762892    2572 scope.go:117] "RemoveContainer" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.763148 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763128    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"} err="failed to get container status \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": rpc error: code = NotFound desc = could not find container \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": container with ID starting with 17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683 not found: ID does not exist"
Jul 06 13:48:19.763265 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763149    2572 scope.go:117] "RemoveContainer" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.763441 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763418    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"} err="failed to get container status \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": rpc error: code = NotFound desc = could not find container \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": container with ID starting with 39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80 not found: ID does not exist"
Jul 06 13:48:19.763534 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763442    2572 scope.go:117] "RemoveContainer" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.763661 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763642    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"} err="failed to get container status \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": rpc error: code = NotFound desc = could not find container \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": container with ID starting with ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731 not found: ID does not exist"
Jul 06 13:48:19.763712 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763661    2572 scope.go:117] "RemoveContainer" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.763895 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763876    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"} err="failed to get container status \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": rpc error: code = NotFound desc = could not find container \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": container with ID starting with d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9 not found: ID does not exist"
Jul 06 13:48:19.763895 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763889    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:48:19.763979 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.763896    2572 scope.go:117] "RemoveContainer" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.764094 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764081    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"} err="failed to get container status \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": rpc error: code = NotFound desc = could not find container \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": container with ID starting with cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659 not found: ID does not exist"
Jul 06 13:48:19.764135 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764094    2572 scope.go:117] "RemoveContainer" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764198    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764248    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764266    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="prom-label-proxy"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764275    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="prom-label-proxy"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764287    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="config-reloader"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764295    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="config-reloader"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764307    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764315    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764326    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="alertmanager"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764334    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="alertmanager"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764343    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="thanos-sidecar"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764352    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="thanos-sidecar"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764351    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"} err="failed to get container status \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": rpc error: code = NotFound desc = could not find container \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": container with ID starting with 847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59 not found: ID does not exist"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764364    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="init-config-reloader"
Jul 06 13:48:19.764367 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764372    2572 scope.go:117] "RemoveContainer" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764373    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="init-config-reloader"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764425    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-web"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764431    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-web"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764441    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-thanos"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764450    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-thanos"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764461    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-web"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764467    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-web"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764476    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="prometheus"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764481    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="prometheus"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764488    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="init-config-reloader"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764493    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="init-config-reloader"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764501    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-metric"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764506    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-metric"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764512    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="config-reloader"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764517    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="config-reloader"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764617    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764627    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-web"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764633    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="config-reloader"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764630    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"} err="failed to get container status \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": rpc error: code = NotFound desc = could not find container \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": container with ID starting with 5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8 not found: ID does not exist"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764640    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="alertmanager"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764644    2572 scope.go:117] "RemoveContainer" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764648    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="thanos-sidecar"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764654    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="prometheus"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764659    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy-metric"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764665    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="prom-label-proxy"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764669    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="config-reloader"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764674    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-web"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764680    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b415b8-05d7-4a05-829c-f3f04658579a" containerName="kube-rbac-proxy"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764685    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" containerName="kube-rbac-proxy-thanos"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764844    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"} err="failed to get container status \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": rpc error: code = NotFound desc = could not find container \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": container with ID starting with 17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683 not found: ID does not exist"
Jul 06 13:48:19.764880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.764864    2572 scope.go:117] "RemoveContainer" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765057    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"} err="failed to get container status \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": rpc error: code = NotFound desc = could not find container \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": container with ID starting with 39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80 not found: ID does not exist"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765071    2572 scope.go:117] "RemoveContainer" containerID="ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765290    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731"} err="failed to get container status \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": rpc error: code = NotFound desc = could not find container \"ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731\": container with ID starting with ab563e7c8a21b8ca1e97f923454deb842f61146db8756aa5ce16972e56ff5731 not found: ID does not exist"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765308    2572 scope.go:117] "RemoveContainer" containerID="d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765565    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9"} err="failed to get container status \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": rpc error: code = NotFound desc = could not find container \"d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9\": container with ID starting with d702ab78a27fb7e56446402a7c017d0eac1e40227c5c155b8698a96fdd13b4d9 not found: ID does not exist"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765589    2572 scope.go:117] "RemoveContainer" containerID="cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765849    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659"} err="failed to get container status \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": rpc error: code = NotFound desc = could not find container \"cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659\": container with ID starting with cc3821342760afd29dcef2f6ddb67b9c302338c9cbc5e2f3197878647d0fd659 not found: ID does not exist"
Jul 06 13:48:19.766055 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.765870    2572 scope.go:117] "RemoveContainer" containerID="847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"
Jul 06 13:48:19.766456 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.766110    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59"} err="failed to get container status \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": rpc error: code = NotFound desc = could not find container \"847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59\": container with ID starting with 847fe682a4f9e683b9c023334d5149c6ec367b27b63c0934ee3c8fb6f4a12e59 not found: ID does not exist"
Jul 06 13:48:19.766456 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.766128    2572 scope.go:117] "RemoveContainer" containerID="5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"
Jul 06 13:48:19.766456 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.766441    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8"} err="failed to get container status \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": rpc error: code = NotFound desc = could not find container \"5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8\": container with ID starting with 5c9f84ecdf7ca135960a815323be7fe48827068638a93b42ebc9ec239ecb7cf8 not found: ID does not exist"
Jul 06 13:48:19.766559 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.766464    2572 scope.go:117] "RemoveContainer" containerID="17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"
Jul 06 13:48:19.766714 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.766693    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683"} err="failed to get container status \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": rpc error: code = NotFound desc = could not find container \"17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683\": container with ID starting with 17f62d27c7fd402bc98b7c7fce8ca88240bbc72258a3e222763f635a203a4683 not found: ID does not exist"
Jul 06 13:48:19.766714 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.766710    2572 scope.go:117] "RemoveContainer" containerID="39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"
Jul 06 13:48:19.766949 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.766924    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80"} err="failed to get container status \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": rpc error: code = NotFound desc = could not find container \"39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80\": container with ID starting with 39e39b698482afff2af2ebfdc16eea67b88a7467c6d6ef02193fc1cf683c3d80 not found: ID does not exist"
Jul 06 13:48:19.768556 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.768542    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.770822 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.770521    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 13:48:19.770822 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.770521    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 13:48:19.770822 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.770806    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 13:48:19.770822 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.770821    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 13:48:19.770822 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.770806    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.770994    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771052    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771329    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-65zx5\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771397    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771433    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771762    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bce1l4ph05ep0\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771815    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771860    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.771819    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 13:48:19.772292 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.772043    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 13:48:19.775713 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.775696    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 13:48:19.777610 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.777532    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 13:48:19.786482 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.786463    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:48:19.872052 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872023    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872195 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872195 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872195 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872092    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872195 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn6nl\" (UniqueName: \"kubernetes.io/projected/8e046101-b5c0-4329-ab2f-9568b2302867-kube-api-access-zn6nl\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872195 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872195 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872312    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872374    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872412 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-config\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e046101-b5c0-4329-ab2f-9568b2302867-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872559    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.872757 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.872586    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e046101-b5c0-4329-ab2f-9568b2302867-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973434 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973403    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973509    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973897 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973708    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973897 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973746    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973897 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973897 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-config\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973897 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e046101-b5c0-4329-ab2f-9568b2302867-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973897 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973857    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.973897 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973911    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e046101-b5c0-4329-ab2f-9568b2302867-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973937    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973953    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.973989    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.974026    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.974051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.974087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn6nl\" (UniqueName: \"kubernetes.io/projected/8e046101-b5c0-4329-ab2f-9568b2302867-kube-api-access-zn6nl\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.974253    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.974621 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.974600    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.975562 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.975281    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.976673 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.976309    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.976673 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.976631    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.976673 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.976647    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.976962 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.976923    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.977096 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.976991    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.977165 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.977117    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.977913 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.977855    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.978342 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.978290    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.978745 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.978721    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e046101-b5c0-4329-ab2f-9568b2302867-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.979110 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.979072    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-config\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.979110 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.979075    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.979341 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.979258    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e046101-b5c0-4329-ab2f-9568b2302867-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.980097 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.980075    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.980265 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.980196    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e046101-b5c0-4329-ab2f-9568b2302867-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.980444 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.980428    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e046101-b5c0-4329-ab2f-9568b2302867-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:19.981713 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:19.981695    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn6nl\" (UniqueName: \"kubernetes.io/projected/8e046101-b5c0-4329-ab2f-9568b2302867-kube-api-access-zn6nl\") pod \"prometheus-k8s-0\" (UID: \"8e046101-b5c0-4329-ab2f-9568b2302867\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:20.080547 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:20.080515    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:48:20.215132 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:20.215107    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 13:48:20.217623 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:48:20.217598    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e046101_b5c0_4329_ab2f_9568b2302867.slice/crio-eabc2db6a7bbf170e7ae85888fa600d809cd215cb57f9990f15fed3e119689a4 WatchSource:0}: Error finding container eabc2db6a7bbf170e7ae85888fa600d809cd215cb57f9990f15fed3e119689a4: Status 404 returned error can't find the container with id eabc2db6a7bbf170e7ae85888fa600d809cd215cb57f9990f15fed3e119689a4
Jul 06 13:48:20.714880 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:20.714849    2572 generic.go:356] "Generic (PLEG): container finished" podID="8e046101-b5c0-4329-ab2f-9568b2302867" containerID="3c93362e8a08ce61cf42df2fe26838117e34f2f3371895fa55e501226ce20e20" exitCode=0
Jul 06 13:48:20.715071 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:20.714911    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerDied","Data":"3c93362e8a08ce61cf42df2fe26838117e34f2f3371895fa55e501226ce20e20"}
Jul 06 13:48:20.715071 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:20.714963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerStarted","Data":"eabc2db6a7bbf170e7ae85888fa600d809cd215cb57f9990f15fed3e119689a4"}
Jul 06 13:48:20.765613 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:20.765585    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb1a192-91de-464e-ae80-ce7a44ab9584" path="/var/lib/kubelet/pods/1bb1a192-91de-464e-ae80-ce7a44ab9584/volumes"
Jul 06 13:48:21.722262 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:21.722225    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerStarted","Data":"d6ca686f1da3bef844654043ee6c6a532f6d9fc1137317ee53519a41ff243cef"}
Jul 06 13:48:21.722691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:21.722287    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerStarted","Data":"c08faa3ded49388cba64a8f6dafbd77fb13425b38e449933e8671ca213ac38c5"}
Jul 06 13:48:21.722691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:21.722313    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerStarted","Data":"9eae9bce567cad182b7ccb7f77ae0cf7b17c7d6681dfad06207ba2f60bb3f019"}
Jul 06 13:48:21.722691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:21.722343    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerStarted","Data":"175d9c12f86c667186b77f2f0bd0c23004997da167ecaf380c62a8014f918201"}
Jul 06 13:48:21.722691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:21.722366    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerStarted","Data":"81f254029046364485d75fce78c560acbbf35549fd47e103198d6752a4124898"}
Jul 06 13:48:21.722691 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:21.722389    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e046101-b5c0-4329-ab2f-9568b2302867","Type":"ContainerStarted","Data":"0746d9e7d18da9e7a009caa4bf8f5b5f85a398007d31595bb036a254ad92bbf3"}
Jul 06 13:48:21.754732 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:21.754672    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7318608319999997 podStartE2EDuration="2.754648332s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.7875ms" isStatefulPod=false podCreationTimestamp="2026-07-06 13:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:48:21.752782004 +0000 UTC m=+201.512753956" watchObservedRunningTime="2026-07-06 13:48:21.754648332 +0000 UTC m=+201.514620256"
Jul 06 13:48:25.081414 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:48:25.081365    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:49:20.081396 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:49:20.081361    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:49:20.096524 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:49:20.096502    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:49:20.972676 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:49:20.972646    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 13:50:00.654941 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:00.654914    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 13:50:34.193788 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.193755    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"]
Jul 06 13:50:34.196863 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.196848    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.198834 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.198812    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 13:50:34.199069 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.199054    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kc44z\""
Jul 06 13:50:34.199447 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.199431    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 13:50:34.199545 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.199457    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 13:50:34.200939 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.200911    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 13:50:34.222761 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.222736    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"]
Jul 06 13:50:34.263156 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.263134    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w789l\" (UniqueName: \"kubernetes.io/projected/27381896-1a78-47a0-8454-ac90d0d147e3-kube-api-access-w789l\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.263309 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.263162    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27381896-1a78-47a0-8454-ac90d0d147e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.263309 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.263184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27381896-1a78-47a0-8454-ac90d0d147e3-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.263309 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.263201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27381896-1a78-47a0-8454-ac90d0d147e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.263474 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.263334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27381896-1a78-47a0-8454-ac90d0d147e3-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.364649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.364622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w789l\" (UniqueName: \"kubernetes.io/projected/27381896-1a78-47a0-8454-ac90d0d147e3-kube-api-access-w789l\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.364649 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.364654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27381896-1a78-47a0-8454-ac90d0d147e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.364853 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.364676    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27381896-1a78-47a0-8454-ac90d0d147e3-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.364853 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.364701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27381896-1a78-47a0-8454-ac90d0d147e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.364853 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.364742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27381896-1a78-47a0-8454-ac90d0d147e3-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.365063 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.365046    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/27381896-1a78-47a0-8454-ac90d0d147e3-manifests\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.366883 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.366855    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27381896-1a78-47a0-8454-ac90d0d147e3-tmp\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.367227 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.367190    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27381896-1a78-47a0-8454-ac90d0d147e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.367281 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.367258    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/27381896-1a78-47a0-8454-ac90d0d147e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.375044 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.375024    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w789l\" (UniqueName: \"kubernetes.io/projected/27381896-1a78-47a0-8454-ac90d0d147e3-kube-api-access-w789l\") pod \"opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz\" (UID: \"27381896-1a78-47a0-8454-ac90d0d147e3\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.507701 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.507607    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:34.650163 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.650133    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"]
Jul 06 13:50:34.653355 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:50:34.653328    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27381896_1a78_47a0_8454_ac90d0d147e3.slice/crio-2e9eb6bb880909aecc383e0b99d2dfd541aac117692e45931ea87d275e5c6306 WatchSource:0}: Error finding container 2e9eb6bb880909aecc383e0b99d2dfd541aac117692e45931ea87d275e5c6306: Status 404 returned error can't find the container with id 2e9eb6bb880909aecc383e0b99d2dfd541aac117692e45931ea87d275e5c6306
Jul 06 13:50:34.654994 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:34.654973    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:50:35.243224 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:35.243185    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz" event={"ID":"27381896-1a78-47a0-8454-ac90d0d147e3","Type":"ContainerStarted","Data":"2e9eb6bb880909aecc383e0b99d2dfd541aac117692e45931ea87d275e5c6306"}
Jul 06 13:50:38.261324 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:38.261285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz" event={"ID":"27381896-1a78-47a0-8454-ac90d0d147e3","Type":"ContainerStarted","Data":"6bc37c9523b09cc1ca5f674ab65ef9951571d18c98ef91d76a1fc5ac6a58141d"}
Jul 06 13:50:39.268021 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:39.267979    2572 generic.go:356] "Generic (PLEG): container finished" podID="27381896-1a78-47a0-8454-ac90d0d147e3" containerID="6bc37c9523b09cc1ca5f674ab65ef9951571d18c98ef91d76a1fc5ac6a58141d" exitCode=0
Jul 06 13:50:39.268528 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:39.268037    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz" event={"ID":"27381896-1a78-47a0-8454-ac90d0d147e3","Type":"ContainerDied","Data":"6bc37c9523b09cc1ca5f674ab65ef9951571d18c98ef91d76a1fc5ac6a58141d"}
Jul 06 13:50:40.274801 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:40.274769    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz" event={"ID":"27381896-1a78-47a0-8454-ac90d0d147e3","Type":"ContainerStarted","Data":"6e966d9a0f06bb7c0b62834491f90331432fe84665eb087b2b8b89d0d30033e1"}
Jul 06 13:50:40.275248 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:40.274939    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:40.297059 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:40.297012    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz" podStartSLOduration=1.894604834 podStartE2EDuration="6.296995296s" totalImagesPullingTime="3.33067323s" totalInitContainerRuntime="1.071717232s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:40.294585936 +0000 UTC m=+340.054557866" watchObservedRunningTime="2026-07-06 13:50:40.296995296 +0000 UTC m=+340.056967274"
Jul 06 13:50:51.281564 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:51.281537    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz"
Jul 06 13:50:52.162337 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.162256    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-665d757866-dth7x"]
Jul 06 13:50:52.165401 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.165386    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.167524 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.167500    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 13:50:52.167641 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.167531    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 13:50:52.167641 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.167543    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 13:50:52.168638 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.168622    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 13:50:52.168741 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.168702    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m76dr\""
Jul 06 13:50:52.168876 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.168864    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 13:50:52.176156 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.176136    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-665d757866-dth7x"]
Jul 06 13:50:52.323464 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.323432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/377c99f0-2c95-4a0a-96e3-9664db0fd99d-cert\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.323860 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.323471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/377c99f0-2c95-4a0a-96e3-9664db0fd99d-metrics-cert\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.323860 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.323517    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4z5m\" (UniqueName: \"kubernetes.io/projected/377c99f0-2c95-4a0a-96e3-9664db0fd99d-kube-api-access-x4z5m\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.323860 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.323648    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/377c99f0-2c95-4a0a-96e3-9664db0fd99d-manager-config\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.424362 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.424288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/377c99f0-2c95-4a0a-96e3-9664db0fd99d-manager-config\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.424362 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.424326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/377c99f0-2c95-4a0a-96e3-9664db0fd99d-cert\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.424362 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.424346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/377c99f0-2c95-4a0a-96e3-9664db0fd99d-metrics-cert\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.424643 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.424383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4z5m\" (UniqueName: \"kubernetes.io/projected/377c99f0-2c95-4a0a-96e3-9664db0fd99d-kube-api-access-x4z5m\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.424981 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.424956    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/377c99f0-2c95-4a0a-96e3-9664db0fd99d-manager-config\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.426774 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.426756    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/377c99f0-2c95-4a0a-96e3-9664db0fd99d-cert\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.426835 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.426821    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/377c99f0-2c95-4a0a-96e3-9664db0fd99d-metrics-cert\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.431488 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.431471    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4z5m\" (UniqueName: \"kubernetes.io/projected/377c99f0-2c95-4a0a-96e3-9664db0fd99d-kube-api-access-x4z5m\") pod \"lws-controller-manager-665d757866-dth7x\" (UID: \"377c99f0-2c95-4a0a-96e3-9664db0fd99d\") " pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.475047 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.475014    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:52.605907 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:52.605879    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-665d757866-dth7x"]
Jul 06 13:50:52.608639 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:50:52.608610    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377c99f0_2c95_4a0a_96e3_9664db0fd99d.slice/crio-33f62ddd8794b4ab515824e75dfdda8c2a87378e2cafb489763d223c1277cc35 WatchSource:0}: Error finding container 33f62ddd8794b4ab515824e75dfdda8c2a87378e2cafb489763d223c1277cc35: Status 404 returned error can't find the container with id 33f62ddd8794b4ab515824e75dfdda8c2a87378e2cafb489763d223c1277cc35
Jul 06 13:50:53.330035 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:53.329999    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x" event={"ID":"377c99f0-2c95-4a0a-96e3-9664db0fd99d","Type":"ContainerStarted","Data":"33f62ddd8794b4ab515824e75dfdda8c2a87378e2cafb489763d223c1277cc35"}
Jul 06 13:50:55.342017 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:55.341929    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x" event={"ID":"377c99f0-2c95-4a0a-96e3-9664db0fd99d","Type":"ContainerStarted","Data":"8323d8b9c92f751d9f6cb81c6995246882a4ca775667d5efdf332543a253d607"}
Jul 06 13:50:55.342401 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:55.342056    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:50:55.358305 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:55.358262    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x" podStartSLOduration=0.913114169 podStartE2EDuration="3.358249789s" totalImagesPullingTime="2.44513562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:50:55.35741891 +0000 UTC m=+355.117390832" watchObservedRunningTime="2026-07-06 13:50:55.358249789 +0000 UTC m=+355.118221710"
Jul 06 13:50:56.423150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.423120    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"]
Jul 06 13:50:56.426806 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.426779    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.428634 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.428609    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 13:50:56.428767 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.428667    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tp2wj\""
Jul 06 13:50:56.428847 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.428779    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 13:50:56.435675 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.435654    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"]
Jul 06 13:50:56.562715 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.562677    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xgzh\" (UniqueName: \"kubernetes.io/projected/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-kube-api-access-7xgzh\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.562889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.562792    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-tmp\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.562889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.562832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-tls-certs\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.664033 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.664000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-tls-certs\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.664227 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.664052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xgzh\" (UniqueName: \"kubernetes.io/projected/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-kube-api-access-7xgzh\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.664227 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.664108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-tmp\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.666304 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.666277    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-tmp\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.666603 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.666572    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-tls-certs\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.671620 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.671598    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xgzh\" (UniqueName: \"kubernetes.io/projected/2f8fd633-a81e-4760-ae50-cc6cc651c3ae-kube-api-access-7xgzh\") pod \"kube-auth-proxy-cf46d7698-db7ct\" (UID: \"2f8fd633-a81e-4760-ae50-cc6cc651c3ae\") " pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.739553 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.739467    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"
Jul 06 13:50:56.876982 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:56.876956    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cf46d7698-db7ct"]
Jul 06 13:50:56.879531 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:50:56.879500    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8fd633_a81e_4760_ae50_cc6cc651c3ae.slice/crio-4299d8ec1931d24b0149748d701f1ef431c249d552648f5325c332a22c37bf7a WatchSource:0}: Error finding container 4299d8ec1931d24b0149748d701f1ef431c249d552648f5325c332a22c37bf7a: Status 404 returned error can't find the container with id 4299d8ec1931d24b0149748d701f1ef431c249d552648f5325c332a22c37bf7a
Jul 06 13:50:57.351045 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:50:57.351009    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct" event={"ID":"2f8fd633-a81e-4760-ae50-cc6cc651c3ae","Type":"ContainerStarted","Data":"4299d8ec1931d24b0149748d701f1ef431c249d552648f5325c332a22c37bf7a"}
Jul 06 13:51:00.366870 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:51:00.366829    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct" event={"ID":"2f8fd633-a81e-4760-ae50-cc6cc651c3ae","Type":"ContainerStarted","Data":"1aadcfdeebfd9d2ee4767f4740fd5daacc250e07f8dea632340937da6e66b229"}
Jul 06 13:51:00.385517 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:51:00.385474    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cf46d7698-db7ct" podStartSLOduration=1.505966046 podStartE2EDuration="4.385459849s" totalImagesPullingTime="2.879493803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:51:00.384459368 +0000 UTC m=+360.144431309" watchObservedRunningTime="2026-07-06 13:51:00.385459849 +0000 UTC m=+360.145431808"
Jul 06 13:51:06.347955 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:51:06.347923    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-665d757866-dth7x"
Jul 06 13:52:30.186909 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.186818    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"]
Jul 06 13:52:30.190287 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.190272    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"
Jul 06 13:52:30.192588 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.192567    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 13:52:30.192702 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.192593    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 13:52:30.193249 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.193232    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-spjs9\""
Jul 06 13:52:30.193345 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.193272    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 13:52:30.201116 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.201099    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"]
Jul 06 13:52:30.245957 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.245928    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r957w\" (UniqueName: \"kubernetes.io/projected/3a6779c3-2992-413b-ae80-cbddb9bf4e59-kube-api-access-r957w\") pod \"dns-operator-controller-manager-864dd78c4c-fgdj8\" (UID: \"3a6779c3-2992-413b-ae80-cbddb9bf4e59\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"
Jul 06 13:52:30.347039 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.346994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r957w\" (UniqueName: \"kubernetes.io/projected/3a6779c3-2992-413b-ae80-cbddb9bf4e59-kube-api-access-r957w\") pod \"dns-operator-controller-manager-864dd78c4c-fgdj8\" (UID: \"3a6779c3-2992-413b-ae80-cbddb9bf4e59\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"
Jul 06 13:52:30.359512 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.359486    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r957w\" (UniqueName: \"kubernetes.io/projected/3a6779c3-2992-413b-ae80-cbddb9bf4e59-kube-api-access-r957w\") pod \"dns-operator-controller-manager-864dd78c4c-fgdj8\" (UID: \"3a6779c3-2992-413b-ae80-cbddb9bf4e59\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"
Jul 06 13:52:30.500713 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.500625    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"
Jul 06 13:52:30.629168 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.629140    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"]
Jul 06 13:52:30.632376 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:52:30.632341    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6779c3_2992_413b_ae80_cbddb9bf4e59.slice/crio-947bdd0e07f2dab7480153eaaeb0aa9a556275d1fbb5f07f755ec4d860887d80 WatchSource:0}: Error finding container 947bdd0e07f2dab7480153eaaeb0aa9a556275d1fbb5f07f755ec4d860887d80: Status 404 returned error can't find the container with id 947bdd0e07f2dab7480153eaaeb0aa9a556275d1fbb5f07f755ec4d860887d80
Jul 06 13:52:30.761123 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.761042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8" event={"ID":"3a6779c3-2992-413b-ae80-cbddb9bf4e59","Type":"ContainerStarted","Data":"947bdd0e07f2dab7480153eaaeb0aa9a556275d1fbb5f07f755ec4d860887d80"}
Jul 06 13:52:30.839306 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.839275    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"]
Jul 06 13:52:30.843651 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.843633    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:30.845635 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.845613    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 13:52:30.845754 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.845639    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 13:52:30.845754 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.845648    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nhp6c\""
Jul 06 13:52:30.852179 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.852155    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"]
Jul 06 13:52:30.952174 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.952140    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:30.952345 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.952183    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fhfq\" (UniqueName: \"kubernetes.io/projected/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-kube-api-access-8fhfq\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:30.952345 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:30.952221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.053693 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.053600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.053693 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.053650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fhfq\" (UniqueName: \"kubernetes.io/projected/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-kube-api-access-8fhfq\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.053889 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.053766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.054350 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.054329    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.056116 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.056087    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.063359 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.063340    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fhfq\" (UniqueName: \"kubernetes.io/projected/1b22ddb6-259e-4f6e-803c-e3ab603b7f14-kube-api-access-8fhfq\") pod \"kuadrant-console-plugin-66b5774985-nc2nc\" (UID: \"1b22ddb6-259e-4f6e-803c-e3ab603b7f14\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.166781 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.166744    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"
Jul 06 13:52:31.301625 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.301599    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc"]
Jul 06 13:52:31.337891 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:52:31.337820    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b22ddb6_259e_4f6e_803c_e3ab603b7f14.slice/crio-b4ff82596df95fb808ed3fb47cf80a5d7aa47756687adad3fcce15f077b7567b WatchSource:0}: Error finding container b4ff82596df95fb808ed3fb47cf80a5d7aa47756687adad3fcce15f077b7567b: Status 404 returned error can't find the container with id b4ff82596df95fb808ed3fb47cf80a5d7aa47756687adad3fcce15f077b7567b
Jul 06 13:52:31.763595 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:31.763554    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc" event={"ID":"1b22ddb6-259e-4f6e-803c-e3ab603b7f14","Type":"ContainerStarted","Data":"b4ff82596df95fb808ed3fb47cf80a5d7aa47756687adad3fcce15f077b7567b"}
Jul 06 13:52:32.771364 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:32.771293    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8" event={"ID":"3a6779c3-2992-413b-ae80-cbddb9bf4e59","Type":"ContainerStarted","Data":"57c5835dfbebc11616f7d07c047efa0d3179d052aa9caeb79f1fa34cb91a5b09"}
Jul 06 13:52:32.771885 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:32.771448    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"
Jul 06 13:52:32.791140 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:32.791086    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8" podStartSLOduration=0.78709693 podStartE2EDuration="2.791069802s" totalImagesPullingTime="2.003972872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:32.790181894 +0000 UTC m=+452.550153815" watchObservedRunningTime="2026-07-06 13:52:32.791069802 +0000 UTC m=+452.551041723"
Jul 06 13:52:40.989504 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:40.989469    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"]
Jul 06 13:52:40.999946 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:40.999923    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:41.003861 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.003770    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nm4qw\""
Jul 06 13:52:41.006086 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.006059    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"]
Jul 06 13:52:41.152453 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.152417    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ac865e4-79e3-48cd-b741-cba81c0d9545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dlp6x\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:41.152453 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.152465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxxsm\" (UniqueName: \"kubernetes.io/projected/7ac865e4-79e3-48cd-b741-cba81c0d9545-kube-api-access-nxxsm\") pod \"kuadrant-operator-controller-manager-86878c769f-dlp6x\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:41.253432 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.253348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ac865e4-79e3-48cd-b741-cba81c0d9545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dlp6x\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:41.253432 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.253390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxxsm\" (UniqueName: \"kubernetes.io/projected/7ac865e4-79e3-48cd-b741-cba81c0d9545-kube-api-access-nxxsm\") pod \"kuadrant-operator-controller-manager-86878c769f-dlp6x\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:41.253787 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.253768    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ac865e4-79e3-48cd-b741-cba81c0d9545-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dlp6x\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:41.269257 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.269203    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxxsm\" (UniqueName: \"kubernetes.io/projected/7ac865e4-79e3-48cd-b741-cba81c0d9545-kube-api-access-nxxsm\") pod \"kuadrant-operator-controller-manager-86878c769f-dlp6x\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:41.313676 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:41.313641    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:43.778882 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:43.778851    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgdj8"
Jul 06 13:52:53.827559 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:53.827536    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"]
Jul 06 13:52:53.830886 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:52:53.830862    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac865e4_79e3_48cd_b741_cba81c0d9545.slice/crio-0f78714f05fd56d9863172170f59516ceed0fb432f61fe942530692beaf50ef7 WatchSource:0}: Error finding container 0f78714f05fd56d9863172170f59516ceed0fb432f61fe942530692beaf50ef7: Status 404 returned error can't find the container with id 0f78714f05fd56d9863172170f59516ceed0fb432f61fe942530692beaf50ef7
Jul 06 13:52:53.873824 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:53.873791    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x" event={"ID":"7ac865e4-79e3-48cd-b741-cba81c0d9545","Type":"ContainerStarted","Data":"0f78714f05fd56d9863172170f59516ceed0fb432f61fe942530692beaf50ef7"}
Jul 06 13:52:53.875293 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:53.875274    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc" event={"ID":"1b22ddb6-259e-4f6e-803c-e3ab603b7f14","Type":"ContainerStarted","Data":"f0f0cb87dce4102536d1b0cfc6931dd044d9c200799d7830611d1cc192818717"}
Jul 06 13:52:53.896678 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:53.896621    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nc2nc" podStartSLOduration=1.469015365 podStartE2EDuration="23.89660679s" totalImagesPullingTime="22.427591425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:53.894998314 +0000 UTC m=+473.654970250" watchObservedRunningTime="2026-07-06 13:52:53.89660679 +0000 UTC m=+473.656578711"
Jul 06 13:52:59.905150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:59.905116    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x" event={"ID":"7ac865e4-79e3-48cd-b741-cba81c0d9545","Type":"ContainerStarted","Data":"05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6"}
Jul 06 13:52:59.905525 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:59.905191    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:52:59.923049 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:52:59.922997    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x" podStartSLOduration=14.944366818 podStartE2EDuration="19.922982072s" totalImagesPullingTime="4.978615254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:52:59.921167221 +0000 UTC m=+479.681139143" watchObservedRunningTime="2026-07-06 13:52:59.922982072 +0000 UTC m=+479.682953994"
Jul 06 13:53:10.916992 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:10.916960    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 13:53:30.473643 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.473605    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-s9jxb"]
Jul 06 13:53:30.592406 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.592366    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s9jxb"]
Jul 06 13:53:30.592566 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.592461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s9jxb"
Jul 06 13:53:30.594771 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.594753    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4tc5b\""
Jul 06 13:53:30.678108 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.678071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fszd2\" (UniqueName: \"kubernetes.io/projected/ec0e4fd1-35b5-4565-b178-20f81b4f7d04-kube-api-access-fszd2\") pod \"authorino-75d556bd77-s9jxb\" (UID: \"ec0e4fd1-35b5-4565-b178-20f81b4f7d04\") " pod="kuadrant-system/authorino-75d556bd77-s9jxb"
Jul 06 13:53:30.778640 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.778541    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fszd2\" (UniqueName: \"kubernetes.io/projected/ec0e4fd1-35b5-4565-b178-20f81b4f7d04-kube-api-access-fszd2\") pod \"authorino-75d556bd77-s9jxb\" (UID: \"ec0e4fd1-35b5-4565-b178-20f81b4f7d04\") " pod="kuadrant-system/authorino-75d556bd77-s9jxb"
Jul 06 13:53:30.791172 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.791140    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fszd2\" (UniqueName: \"kubernetes.io/projected/ec0e4fd1-35b5-4565-b178-20f81b4f7d04-kube-api-access-fszd2\") pod \"authorino-75d556bd77-s9jxb\" (UID: \"ec0e4fd1-35b5-4565-b178-20f81b4f7d04\") " pod="kuadrant-system/authorino-75d556bd77-s9jxb"
Jul 06 13:53:30.900878 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:30.900840    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s9jxb"
Jul 06 13:53:31.031672 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:31.031600    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s9jxb"]
Jul 06 13:53:31.034839 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:53:31.034815    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec0e4fd1_35b5_4565_b178_20f81b4f7d04.slice/crio-848e17b57619796a565a57c8541e30fe75bdf1cf682a2e81dbb30d2aebd7c935 WatchSource:0}: Error finding container 848e17b57619796a565a57c8541e30fe75bdf1cf682a2e81dbb30d2aebd7c935: Status 404 returned error can't find the container with id 848e17b57619796a565a57c8541e30fe75bdf1cf682a2e81dbb30d2aebd7c935
Jul 06 13:53:31.049863 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:31.049835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s9jxb" event={"ID":"ec0e4fd1-35b5-4565-b178-20f81b4f7d04","Type":"ContainerStarted","Data":"848e17b57619796a565a57c8541e30fe75bdf1cf682a2e81dbb30d2aebd7c935"}
Jul 06 13:53:34.066986 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:34.066884    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s9jxb" event={"ID":"ec0e4fd1-35b5-4565-b178-20f81b4f7d04","Type":"ContainerStarted","Data":"07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82"}
Jul 06 13:53:34.083938 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:34.083888    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-s9jxb" podStartSLOduration=1.320333154 podStartE2EDuration="4.083873029s" totalImagesPullingTime="2.763539875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:53:34.082734634 +0000 UTC m=+513.842706557" watchObservedRunningTime="2026-07-06 13:53:34.083873029 +0000 UTC m=+513.843844951"
Jul 06 13:53:59.546881 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:59.546844    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s9jxb"]
Jul 06 13:53:59.547405 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:59.547018    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-s9jxb" podUID="ec0e4fd1-35b5-4565-b178-20f81b4f7d04" containerName="authorino" containerID="cri-o://07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82" gracePeriod=30
Jul 06 13:53:59.798585 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:59.798531    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s9jxb"
Jul 06 13:53:59.827345 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:59.827313    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fszd2\" (UniqueName: \"kubernetes.io/projected/ec0e4fd1-35b5-4565-b178-20f81b4f7d04-kube-api-access-fszd2\") pod \"ec0e4fd1-35b5-4565-b178-20f81b4f7d04\" (UID: \"ec0e4fd1-35b5-4565-b178-20f81b4f7d04\") "
Jul 06 13:53:59.829484 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:59.829458    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0e4fd1-35b5-4565-b178-20f81b4f7d04-kube-api-access-fszd2" (OuterVolumeSpecName: "kube-api-access-fszd2") pod "ec0e4fd1-35b5-4565-b178-20f81b4f7d04" (UID: "ec0e4fd1-35b5-4565-b178-20f81b4f7d04"). InnerVolumeSpecName "kube-api-access-fszd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:53:59.928077 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:53:59.928039    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fszd2\" (UniqueName: \"kubernetes.io/projected/ec0e4fd1-35b5-4565-b178-20f81b4f7d04-kube-api-access-fszd2\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 13:54:00.185953 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.185922    2572 generic.go:356] "Generic (PLEG): container finished" podID="ec0e4fd1-35b5-4565-b178-20f81b4f7d04" containerID="07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82" exitCode=0
Jul 06 13:54:00.186150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.185971    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s9jxb"
Jul 06 13:54:00.186150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.186019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s9jxb" event={"ID":"ec0e4fd1-35b5-4565-b178-20f81b4f7d04","Type":"ContainerDied","Data":"07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82"}
Jul 06 13:54:00.186150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.186061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s9jxb" event={"ID":"ec0e4fd1-35b5-4565-b178-20f81b4f7d04","Type":"ContainerDied","Data":"848e17b57619796a565a57c8541e30fe75bdf1cf682a2e81dbb30d2aebd7c935"}
Jul 06 13:54:00.186150 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.186083    2572 scope.go:117] "RemoveContainer" containerID="07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82"
Jul 06 13:54:00.195712 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.195695    2572 scope.go:117] "RemoveContainer" containerID="07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82"
Jul 06 13:54:00.195971 ip-10-0-142-56 kubenswrapper[2572]: E0706 13:54:00.195945    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82\": container with ID starting with 07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82 not found: ID does not exist" containerID="07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82"
Jul 06 13:54:00.196018 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.195978    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82"} err="failed to get container status \"07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82\": rpc error: code = NotFound desc = could not find container \"07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82\": container with ID starting with 07d1fffca2af8eb7d9a5184a7bdcbbac1d2576018e8232f2a94980cd56ad8e82 not found: ID does not exist"
Jul 06 13:54:00.214186 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.214160    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s9jxb"]
Jul 06 13:54:00.219606 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.219581    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s9jxb"]
Jul 06 13:54:00.761879 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:54:00.761848    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0e4fd1-35b5-4565-b178-20f81b4f7d04" path="/var/lib/kubelet/pods/ec0e4fd1-35b5-4565-b178-20f81b4f7d04/volumes"
Jul 06 13:55:07.376636 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.376590    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"]
Jul 06 13:55:07.377101 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.376978    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0e4fd1-35b5-4565-b178-20f81b4f7d04" containerName="authorino"
Jul 06 13:55:07.377101 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.376990    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0e4fd1-35b5-4565-b178-20f81b4f7d04" containerName="authorino"
Jul 06 13:55:07.377101 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.377055    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0e4fd1-35b5-4565-b178-20f81b4f7d04" containerName="authorino"
Jul 06 13:55:07.379893 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.379876    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.382751 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.382730    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 13:55:07.383404 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.383382    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-96n6p\""
Jul 06 13:55:07.383519 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.383382    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 13:55:07.383519 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.383390    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 13:55:07.392552 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.392528    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"]
Jul 06 13:55:07.531338 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.531302    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77628\" (UniqueName: \"kubernetes.io/projected/207042dd-c6e6-498b-87c8-a8e45dec6deb-kube-api-access-77628\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.531527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.531391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/207042dd-c6e6-498b-87c8-a8e45dec6deb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.531527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.531412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.531527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.531435    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.531527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.531457    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.531527 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.531498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.632951 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.632861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/207042dd-c6e6-498b-87c8-a8e45dec6deb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.632951 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.632901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.632951 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.632921    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.633244 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.632953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.633244 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.632984    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.633244 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.633015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77628\" (UniqueName: \"kubernetes.io/projected/207042dd-c6e6-498b-87c8-a8e45dec6deb-kube-api-access-77628\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.633425 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.633408    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.633493 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.633434    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.633548 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.633491    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.635255 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.635234    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/207042dd-c6e6-498b-87c8-a8e45dec6deb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.635443 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.635428    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/207042dd-c6e6-498b-87c8-a8e45dec6deb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.641844 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.641817    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77628\" (UniqueName: \"kubernetes.io/projected/207042dd-c6e6-498b-87c8-a8e45dec6deb-kube-api-access-77628\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fhsgg\" (UID: \"207042dd-c6e6-498b-87c8-a8e45dec6deb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.690156 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.690119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:07.836751 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:07.836727    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"]
Jul 06 13:55:07.838774 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:55:07.838747    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207042dd_c6e6_498b_87c8_a8e45dec6deb.slice/crio-df40d9bae3f7ac524c66f8a1c3bec9a1b464c0683f91c759277ddd420c718073 WatchSource:0}: Error finding container df40d9bae3f7ac524c66f8a1c3bec9a1b464c0683f91c759277ddd420c718073: Status 404 returned error can't find the container with id df40d9bae3f7ac524c66f8a1c3bec9a1b464c0683f91c759277ddd420c718073
Jul 06 13:55:08.512576 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:08.512539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg" event={"ID":"207042dd-c6e6-498b-87c8-a8e45dec6deb","Type":"ContainerStarted","Data":"df40d9bae3f7ac524c66f8a1c3bec9a1b464c0683f91c759277ddd420c718073"}
Jul 06 13:55:09.518164 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:09.518129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg" event={"ID":"207042dd-c6e6-498b-87c8-a8e45dec6deb","Type":"ContainerStarted","Data":"5f9bc48845782b40442085a6d20e54373b2c4f64cdbf9b89a1f7e56977883588"}
Jul 06 13:55:09.534845 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:09.534795    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg" podStartSLOduration=1.46103942 podStartE2EDuration="2.534779038s" totalImagesPullingTime="1.073739618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:55:09.533848657 +0000 UTC m=+609.293820578" watchObservedRunningTime="2026-07-06 13:55:09.534779038 +0000 UTC m=+609.294750959"
Jul 06 13:55:17.690275 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:17.690235    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:17.690783 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:17.690347    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:17.702957 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:17.702925    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:18.573590 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:18.573561    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fhsgg"
Jul 06 13:55:19.671924 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.671887    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"]
Jul 06 13:55:19.675634 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.675613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.677457 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.677435    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 13:55:19.684491 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.684468    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"]
Jul 06 13:55:19.842884 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.842842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.843059 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.842894    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.843059 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.842956    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.843059 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.843025    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.843059 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.843051    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.843191 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.843078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlmb\" (UniqueName: \"kubernetes.io/projected/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-kube-api-access-9dlmb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.943869 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.943785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.943869 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.943849    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.943869 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.943872    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.944141 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.943893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlmb\" (UniqueName: \"kubernetes.io/projected/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-kube-api-access-9dlmb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.944141 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.943928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.944141 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.943957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.944402 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.944380    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.944402 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.944384    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.944502 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.944446    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.946244 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.946227    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.946362 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.946345    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.952149 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.952132    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlmb\" (UniqueName: \"kubernetes.io/projected/afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4-kube-api-access-9dlmb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x\" (UID: \"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:19.985991 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:19.985958    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:20.122440 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:20.122405    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"]
Jul 06 13:55:20.125798 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:55:20.125775    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe4b32e_9eac_4f1e_95c3_bb62f6d7f6e4.slice/crio-9d3b8178e21ef65a692facefea730674c9556575cc93c4e425376d3427acebe0 WatchSource:0}: Error finding container 9d3b8178e21ef65a692facefea730674c9556575cc93c4e425376d3427acebe0: Status 404 returned error can't find the container with id 9d3b8178e21ef65a692facefea730674c9556575cc93c4e425376d3427acebe0
Jul 06 13:55:20.570898 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:20.570866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x" event={"ID":"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4","Type":"ContainerStarted","Data":"55b57612ff562c35aff0fda116d42ad6d44760a660c5c7819bd0a4d018809179"}
Jul 06 13:55:20.571062 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:20.570920    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x" event={"ID":"afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4","Type":"ContainerStarted","Data":"9d3b8178e21ef65a692facefea730674c9556575cc93c4e425376d3427acebe0"}
Jul 06 13:55:20.588629 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:20.588578    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x" podStartSLOduration=1.336334614 podStartE2EDuration="1.58856158s" totalImagesPullingTime="252.226966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:55:20.586691068 +0000 UTC m=+620.346662992" watchObservedRunningTime="2026-07-06 13:55:20.58856158 +0000 UTC m=+620.348533503"
Jul 06 13:55:29.986942 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:29.986904    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:29.987376 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:29.986973    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:29.999626 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:29.999598    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:30.628805 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:30.628777    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x"
Jul 06 13:55:46.678159 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.678122    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"]
Jul 06 13:55:46.682232 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.682197    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.684441 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.684417    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 13:55:46.693125 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.693104    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"]
Jul 06 13:55:46.785734 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.785697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pflqc\" (UniqueName: \"kubernetes.io/projected/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-kube-api-access-pflqc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.785921 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.785784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.785921 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.785814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.785921 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.785850    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.785921 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.785879    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.785921 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.785899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887269 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887201    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887488 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887293    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887488 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887488 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887488 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887706 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pflqc\" (UniqueName: \"kubernetes.io/projected/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-kube-api-access-pflqc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887764 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887713    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887820 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887761    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.887820 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.887804    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.889736 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.889713    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.889870 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.889852    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.895741 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.895715    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pflqc\" (UniqueName: \"kubernetes.io/projected/2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b-kube-api-access-pflqc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq\" (UID: \"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:46.993013 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:46.992920    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:47.172048 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:47.172021    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"]
Jul 06 13:55:47.174759 ip-10-0-142-56 kubenswrapper[2572]: W0706 13:55:47.174725    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f5c0fb2_0bc9_4dbf_8df4_3113f9f2767b.slice/crio-6a048a97649b1773dfd54b5e582de381635361ccc34cc29eb1035689ea71fa9b WatchSource:0}: Error finding container 6a048a97649b1773dfd54b5e582de381635361ccc34cc29eb1035689ea71fa9b: Status 404 returned error can't find the container with id 6a048a97649b1773dfd54b5e582de381635361ccc34cc29eb1035689ea71fa9b
Jul 06 13:55:47.176165 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:47.176145    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:55:47.695131 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:47.695035    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq" event={"ID":"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b","Type":"ContainerStarted","Data":"a5b2d69f480592543ea9345d9fca490721b1f0ad6624fd3425f6ad2d3dc7b496"}
Jul 06 13:55:47.695131 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:47.695082    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq" event={"ID":"2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b","Type":"ContainerStarted","Data":"6a048a97649b1773dfd54b5e582de381635361ccc34cc29eb1035689ea71fa9b"}
Jul 06 13:55:47.714735 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:47.714683    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq" podStartSLOduration=1.5233786230000002 podStartE2EDuration="1.714667747s" totalImagesPullingTime="191.289124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:55:47.713356665 +0000 UTC m=+647.473328587" watchObservedRunningTime="2026-07-06 13:55:47.714667747 +0000 UTC m=+647.474639646"
Jul 06 13:55:56.993963 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:56.993928    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:56.993963 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:56.993971    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:57.006366 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:57.006342    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 13:55:57.753598 ip-10-0-142-56 kubenswrapper[2572]: I0706 13:55:57.753574    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq"
Jul 06 14:02:27.137561 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:27.137530    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"]
Jul 06 14:02:27.138084 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:27.137731    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x" podUID="7ac865e4-79e3-48cd-b741-cba81c0d9545" containerName="manager" containerID="cri-o://05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6" gracePeriod=10
Jul 06 14:02:29.499994 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.499970    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 14:02:29.566461 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.566381    2572 generic.go:356] "Generic (PLEG): container finished" podID="7ac865e4-79e3-48cd-b741-cba81c0d9545" containerID="05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6" exitCode=0
Jul 06 14:02:29.566461 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.566423    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"
Jul 06 14:02:29.566676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.566464    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x" event={"ID":"7ac865e4-79e3-48cd-b741-cba81c0d9545","Type":"ContainerDied","Data":"05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6"}
Jul 06 14:02:29.566676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.566518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x" event={"ID":"7ac865e4-79e3-48cd-b741-cba81c0d9545","Type":"ContainerDied","Data":"0f78714f05fd56d9863172170f59516ceed0fb432f61fe942530692beaf50ef7"}
Jul 06 14:02:29.566676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.566549    2572 scope.go:117] "RemoveContainer" containerID="05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6"
Jul 06 14:02:29.575371 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.575356    2572 scope.go:117] "RemoveContainer" containerID="05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6"
Jul 06 14:02:29.575625 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:02:29.575606    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6\": container with ID starting with 05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6 not found: ID does not exist" containerID="05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6"
Jul 06 14:02:29.575690 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.575638    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6"} err="failed to get container status \"05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6\": rpc error: code = NotFound desc = could not find container \"05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6\": container with ID starting with 05e3d8a65ef127a38ea071ac4a5119521fe6a0af48f59c647432e743c75a8ee6 not found: ID does not exist"
Jul 06 14:02:29.592117 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.592090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxxsm\" (UniqueName: \"kubernetes.io/projected/7ac865e4-79e3-48cd-b741-cba81c0d9545-kube-api-access-nxxsm\") pod \"7ac865e4-79e3-48cd-b741-cba81c0d9545\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") "
Jul 06 14:02:29.592245 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.592169    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ac865e4-79e3-48cd-b741-cba81c0d9545-extensions-socket-volume\") pod \"7ac865e4-79e3-48cd-b741-cba81c0d9545\" (UID: \"7ac865e4-79e3-48cd-b741-cba81c0d9545\") "
Jul 06 14:02:29.592528 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.592508    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac865e4-79e3-48cd-b741-cba81c0d9545-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ac865e4-79e3-48cd-b741-cba81c0d9545" (UID: "7ac865e4-79e3-48cd-b741-cba81c0d9545"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:02:29.594114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.594095    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac865e4-79e3-48cd-b741-cba81c0d9545-kube-api-access-nxxsm" (OuterVolumeSpecName: "kube-api-access-nxxsm") pod "7ac865e4-79e3-48cd-b741-cba81c0d9545" (UID: "7ac865e4-79e3-48cd-b741-cba81c0d9545"). InnerVolumeSpecName "kube-api-access-nxxsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:02:29.693043 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.693003    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxxsm\" (UniqueName: \"kubernetes.io/projected/7ac865e4-79e3-48cd-b741-cba81c0d9545-kube-api-access-nxxsm\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:02:29.693043 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.693038    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ac865e4-79e3-48cd-b741-cba81c0d9545-extensions-socket-volume\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:02:29.887628 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.887605    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"]
Jul 06 14:02:29.891588 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:29.891568    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dlp6x"]
Jul 06 14:02:30.761183 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:02:30.761138    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ac865e4-79e3-48cd-b741-cba81c0d9545" path="/var/lib/kubelet/pods/7ac865e4-79e3-48cd-b741-cba81c0d9545/volumes"
Jul 06 14:09:24.845847 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.845816    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"]
Jul 06 14:09:24.846318 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.846180    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ac865e4-79e3-48cd-b741-cba81c0d9545" containerName="manager"
Jul 06 14:09:24.846318 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.846191    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ac865e4-79e3-48cd-b741-cba81c0d9545" containerName="manager"
Jul 06 14:09:24.846403 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.846327    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ac865e4-79e3-48cd-b741-cba81c0d9545" containerName="manager"
Jul 06 14:09:24.849818 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.849794    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:24.851807 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.851788    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b9da3ec9-openshift-default-dockercfg-xgr6n\""
Jul 06 14:09:24.852002 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.851811    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 14:09:24.860426 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:24.860403    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"]
Jul 06 14:09:25.011803 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.011755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-podinfo\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.011803 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.011808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istiod-ca-cert\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.012033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.011858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-envoy\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.012033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.011897    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-token\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.012033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.011955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68xmt\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-kube-api-access-68xmt\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.012033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.011998    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-credential-socket\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.012033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.012013    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-certs\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.012033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.012034    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-data\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.012330 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.012109    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-socket\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.112930 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.112903    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68xmt\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-kube-api-access-68xmt\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113087 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.112960    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-credential-socket\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113087 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.112979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-certs\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113087 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.112998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-data\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113087 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-socket\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113087 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-podinfo\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113087 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istiod-ca-cert\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113485 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-envoy\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113485 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-token\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113485 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113450    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-data\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113622 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113483    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-credential-socket\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113622 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113540    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-certs\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.113622 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.113589    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-socket\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.114022 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.114004    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istiod-ca-cert\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.115353 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.115331    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-envoy\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.115578 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.115562    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-podinfo\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.120523 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.120501    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-token\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.120625 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.120609    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68xmt\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-kube-api-access-68xmt\") pod \"e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") " pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.161644 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.161609    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:25.301950 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.301923    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"]
Jul 06 14:09:25.304541 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:09:25.304515    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf008d5fb_03e7_4cdb_a5c2_32b1bce71b4a.slice/crio-d932b3cdc2a965ee945a9fa50c5aa9832914e9aa1f0219d2cc51804e527a08f8 WatchSource:0}: Error finding container d932b3cdc2a965ee945a9fa50c5aa9832914e9aa1f0219d2cc51804e527a08f8: Status 404 returned error can't find the container with id d932b3cdc2a965ee945a9fa50c5aa9832914e9aa1f0219d2cc51804e527a08f8
Jul 06 14:09:25.306544 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.306525    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:09:25.510512 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:25.510422    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r" event={"ID":"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a","Type":"ContainerStarted","Data":"d932b3cdc2a965ee945a9fa50c5aa9832914e9aa1f0219d2cc51804e527a08f8"}
Jul 06 14:09:26.276640 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.276600    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"]
Jul 06 14:09:26.280573 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.280546    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.283128 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.283043    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-b9da3ec9-serving-cert\""
Jul 06 14:09:26.283520 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.283355    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:09:26.295741 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.295694    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"]
Jul 06 14:09:26.425972 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.425880    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.425972 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.425950    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-openshift-service-ca\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.426234 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.426091    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzvh2\" (UniqueName: \"kubernetes.io/projected/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-kube-api-access-mzvh2\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.527101 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.527015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzvh2\" (UniqueName: \"kubernetes.io/projected/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-kube-api-access-mzvh2\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.527307 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.527123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.527307 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.527157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-openshift-service-ca\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.527307 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:26.527296    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-b9da3ec9-serving-cert: secret "maas-api-e2e-ait-b9da3ec9-serving-cert" not found
Jul 06 14:09:26.527479 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:26.527373    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls podName:b5975115-bfa2-406c-8a3e-da6d9de1a9e5 nodeName:}" failed. No retries permitted until 2026-07-06 14:09:27.027352385 +0000 UTC m=+1466.787324288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls") pod "maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" (UID: "b5975115-bfa2-406c-8a3e-da6d9de1a9e5") : secret "maas-api-e2e-ait-b9da3ec9-serving-cert" not found
Jul 06 14:09:26.527952 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.527928    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-openshift-service-ca\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:26.537366 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:26.537324    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzvh2\" (UniqueName: \"kubernetes.io/projected/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-kube-api-access-mzvh2\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:27.033938 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:27.033900    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:27.036990 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:27.036962    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls\") pod \"maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") " pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:27.196969 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:27.196931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:28.107163 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:28.107126    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:28.107484 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:28.107233    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:28.107484 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:28.107281    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:28.175664 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:28.175638    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"]
Jul 06 14:09:28.178739 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:09:28.178706    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5975115_bfa2_406c_8a3e_da6d9de1a9e5.slice/crio-ed2314b24eb2bd436842360376512e1c365bda788d9f264194cc62b3e56c15db WatchSource:0}: Error finding container ed2314b24eb2bd436842360376512e1c365bda788d9f264194cc62b3e56c15db: Status 404 returned error can't find the container with id ed2314b24eb2bd436842360376512e1c365bda788d9f264194cc62b3e56c15db
Jul 06 14:09:28.527618 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:28.527581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r" event={"ID":"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a","Type":"ContainerStarted","Data":"1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12"}
Jul 06 14:09:28.528783 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:28.528762    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" event={"ID":"b5975115-bfa2-406c-8a3e-da6d9de1a9e5","Type":"ContainerStarted","Data":"ed2314b24eb2bd436842360376512e1c365bda788d9f264194cc62b3e56c15db"}
Jul 06 14:09:28.547612 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:28.547565    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r" podStartSLOduration=1.747397919 podStartE2EDuration="4.547546917s" totalImagesPullingTime="2.800148998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:28.546537418 +0000 UTC m=+1468.306509355" watchObservedRunningTime="2026-07-06 14:09:28.547546917 +0000 UTC m=+1468.307518838"
Jul 06 14:09:29.161790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:29.161753    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:29.167387 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:29.167358    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:29.535616 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:29.535534    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:29.536664 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:29.536640    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:31.368246 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:31.368178    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"]
Jul 06 14:09:31.456955 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:31.456922    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"]
Jul 06 14:09:31.547589 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:31.547553    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" event={"ID":"b5975115-bfa2-406c-8a3e-da6d9de1a9e5","Type":"ContainerStarted","Data":"dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844"}
Jul 06 14:09:31.547772 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:31.547755    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:31.547966 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:31.547952    2572 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r" secret="" err="secret \"e2e-ait-b9da3ec9-openshift-default-dockercfg-xgr6n\" not found"
Jul 06 14:09:31.564115 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:31.564073    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" podStartSLOduration=2.6433311 podStartE2EDuration="5.564059274s" totalImagesPullingTime="2.920728174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:31.562467528 +0000 UTC m=+1471.322439451" watchObservedRunningTime="2026-07-06 14:09:31.564059274 +0000 UTC m=+1471.324031195"
Jul 06 14:09:31.599004 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:31.598967    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-b9da3ec9-serving-cert: secret "maas-api-e2e-ait-b9da3ec9-serving-cert" not found
Jul 06 14:09:31.599249 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:31.599048    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls podName:b5975115-bfa2-406c-8a3e-da6d9de1a9e5 nodeName:}" failed. No retries permitted until 2026-07-06 14:09:32.099027594 +0000 UTC m=+1471.858999495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls") pod "maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" (UID: "b5975115-bfa2-406c-8a3e-da6d9de1a9e5") : secret "maas-api-e2e-ait-b9da3ec9-serving-cert" not found
Jul 06 14:09:32.102670 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:32.102638    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-b9da3ec9-serving-cert: secret "maas-api-e2e-ait-b9da3ec9-serving-cert" not found
Jul 06 14:09:32.102856 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:32.102724    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls podName:b5975115-bfa2-406c-8a3e-da6d9de1a9e5 nodeName:}" failed. No retries permitted until 2026-07-06 14:09:33.102700753 +0000 UTC m=+1472.862672653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls") pod "maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" (UID: "b5975115-bfa2-406c-8a3e-da6d9de1a9e5") : secret "maas-api-e2e-ait-b9da3ec9-serving-cert" not found
Jul 06 14:09:32.552669 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.552623    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r" podUID="f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" containerName="istio-proxy" containerID="cri-o://1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12" gracePeriod=30
Jul 06 14:09:32.553099 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.552701    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" podUID="b5975115-bfa2-406c-8a3e-da6d9de1a9e5" containerName="maas-api" containerID="cri-o://dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844" gracePeriod=30
Jul 06 14:09:32.847384 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.847358    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:32.909755 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.909726    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls\") pod \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") "
Jul 06 14:09:32.909925 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.909825    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-openshift-service-ca\") pod \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") "
Jul 06 14:09:32.909925 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.909870    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzvh2\" (UniqueName: \"kubernetes.io/projected/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-kube-api-access-mzvh2\") pod \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\" (UID: \"b5975115-bfa2-406c-8a3e-da6d9de1a9e5\") "
Jul 06 14:09:32.910248 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.910199    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b5975115-bfa2-406c-8a3e-da6d9de1a9e5" (UID: "b5975115-bfa2-406c-8a3e-da6d9de1a9e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:09:32.912130 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.912103    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-kube-api-access-mzvh2" (OuterVolumeSpecName: "kube-api-access-mzvh2") pod "b5975115-bfa2-406c-8a3e-da6d9de1a9e5" (UID: "b5975115-bfa2-406c-8a3e-da6d9de1a9e5"). InnerVolumeSpecName "kube-api-access-mzvh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:09:32.913569 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:32.913544    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b5975115-bfa2-406c-8a3e-da6d9de1a9e5" (UID: "b5975115-bfa2-406c-8a3e-da6d9de1a9e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:09:33.010592 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.010559    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:33.010592 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.010588    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzvh2\" (UniqueName: \"kubernetes.io/projected/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-kube-api-access-mzvh2\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:33.010592 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.010598    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5975115-bfa2-406c-8a3e-da6d9de1a9e5-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:33.557909 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.557876    2572 generic.go:356] "Generic (PLEG): container finished" podID="b5975115-bfa2-406c-8a3e-da6d9de1a9e5" containerID="dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844" exitCode=0
Jul 06 14:09:33.558336 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.557923    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"
Jul 06 14:09:33.558336 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.557956    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" event={"ID":"b5975115-bfa2-406c-8a3e-da6d9de1a9e5","Type":"ContainerDied","Data":"dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844"}
Jul 06 14:09:33.558336 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.558008    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn" event={"ID":"b5975115-bfa2-406c-8a3e-da6d9de1a9e5","Type":"ContainerDied","Data":"ed2314b24eb2bd436842360376512e1c365bda788d9f264194cc62b3e56c15db"}
Jul 06 14:09:33.558336 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.558030    2572 scope.go:117] "RemoveContainer" containerID="dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844"
Jul 06 14:09:33.568500 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.568474    2572 scope.go:117] "RemoveContainer" containerID="dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844"
Jul 06 14:09:33.568910 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:33.568878    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844\": container with ID starting with dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844 not found: ID does not exist" containerID="dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844"
Jul 06 14:09:33.569004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.568925    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844"} err="failed to get container status \"dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844\": rpc error: code = NotFound desc = could not find container \"dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844\": container with ID starting with dba8755c203fdbbaf23513a3dce1dea8959a7d340a8e36044a0e945c3f70d844 not found: ID does not exist"
Jul 06 14:09:33.585287 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.585253    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"]
Jul 06 14:09:33.591333 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:33.591309    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-b9da3ec9-544bd5568d-zdxbn"]
Jul 06 14:09:34.761744 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:34.761708    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5975115-bfa2-406c-8a3e-da6d9de1a9e5" path="/var/lib/kubelet/pods/b5975115-bfa2-406c-8a3e-da6d9de1a9e5/volumes"
Jul 06 14:09:36.811569 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.811510    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:36.848177 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848146    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-certs\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848364 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848192    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-podinfo\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848364 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848238    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68xmt\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-kube-api-access-68xmt\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848364 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848261    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istiod-ca-cert\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848364 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848281    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-envoy\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848364 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848316    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-credential-socket\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848364 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848342    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-data\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848679 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848385    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-socket\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848679 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848418    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-token\") pod \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\" (UID: \"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a\") "
Jul 06 14:09:36.848679 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848486    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:36.848679 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848636    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:36.848863 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848728    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:36.848863 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848760    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:09:36.848863 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848781    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.848863 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.848797    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.849183 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.849140    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:36.850988 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.850955    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:36.851103 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.851056    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:09:36.851178 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.851156    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:09:36.851238 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.851156    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-kube-api-access-68xmt" (OuterVolumeSpecName: "kube-api-access-68xmt") pod "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" (UID: "f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a"). InnerVolumeSpecName "kube-api-access-68xmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:09:36.949838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.949743    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.949838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.949786    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.949838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.949796    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68xmt\" (UniqueName: \"kubernetes.io/projected/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-kube-api-access-68xmt\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.949838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.949807    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.949838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.949817    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.949838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.949825    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:36.949838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:36.949833    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:37.421180 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.421148    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"]
Jul 06 14:09:37.421655 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.421635    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" containerName="istio-proxy"
Jul 06 14:09:37.421746 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.421657    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" containerName="istio-proxy"
Jul 06 14:09:37.421746 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.421670    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5975115-bfa2-406c-8a3e-da6d9de1a9e5" containerName="maas-api"
Jul 06 14:09:37.421746 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.421678    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5975115-bfa2-406c-8a3e-da6d9de1a9e5" containerName="maas-api"
Jul 06 14:09:37.421895 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.421802    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" containerName="istio-proxy"
Jul 06 14:09:37.421895 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.421815    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5975115-bfa2-406c-8a3e-da6d9de1a9e5" containerName="maas-api"
Jul 06 14:09:37.425180 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.425160    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.427628 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.427608    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-23cf4773-openshift-default-dockercfg-fswlf\""
Jul 06 14:09:37.443861 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.443824    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"]
Jul 06 14:09:37.454136 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-data\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454305 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlrz2\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-kube-api-access-zlrz2\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454305 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-podinfo\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454305 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454265    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-credential-socket\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454305 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istiod-ca-cert\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454487 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-token\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454487 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454429    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-socket\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454487 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-certs\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.454487 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.454481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-envoy\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.554999 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.554962    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-podinfo\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.554999 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555008    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-credential-socket\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555195 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istiod-ca-cert\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555195 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-token\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555293 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555245    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-socket\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555293 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555267    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-certs\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555293 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555282    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-envoy\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555440 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555315    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-data\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555440 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555361    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlrz2\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-kube-api-access-zlrz2\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555549 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555505    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-credential-socket\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555626 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555597    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-certs\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555796 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555767    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-socket\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555820    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-data\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.555914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.555840    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istiod-ca-cert\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.557513 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.557485    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-envoy\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.557697 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.557680    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-podinfo\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.565388 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.565363    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-token\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.565528 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.565511    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlrz2\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-kube-api-access-zlrz2\") pod \"e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") " pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.579982 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.579954    2572 generic.go:356] "Generic (PLEG): container finished" podID="f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" containerID="1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12" exitCode=0
Jul 06 14:09:37.580114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.580007    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"
Jul 06 14:09:37.580114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.580042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r" event={"ID":"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a","Type":"ContainerDied","Data":"1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12"}
Jul 06 14:09:37.580114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.580106    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r" event={"ID":"f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a","Type":"ContainerDied","Data":"d932b3cdc2a965ee945a9fa50c5aa9832914e9aa1f0219d2cc51804e527a08f8"}
Jul 06 14:09:37.580295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.580133    2572 scope.go:117] "RemoveContainer" containerID="1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12"
Jul 06 14:09:37.589329 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.589312    2572 scope.go:117] "RemoveContainer" containerID="1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12"
Jul 06 14:09:37.589603 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:37.589586    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12\": container with ID starting with 1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12 not found: ID does not exist" containerID="1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12"
Jul 06 14:09:37.589674 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.589611    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12"} err="failed to get container status \"1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12\": rpc error: code = NotFound desc = could not find container \"1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12\": container with ID starting with 1cb09edc92370ab3a7058df522cf1b9d3ee81437fbc7b420f4d8a37e26c46d12 not found: ID does not exist"
Jul 06 14:09:37.604776 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.604746    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"]
Jul 06 14:09:37.611411 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.611388    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b9da3ec9-openshift-default-77b44c4c75-zsd7r"]
Jul 06 14:09:37.735945 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.735859    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:37.874067 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.874019    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"]
Jul 06 14:09:37.876703 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:09:37.876668    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9e207c_e539_496f_bab8_5a9fc850e0f0.slice/crio-0d3e01a4b9ecfef7db54cc68a0af4afa92ac14ae16f69cb2110eb532b3e16f4e WatchSource:0}: Error finding container 0d3e01a4b9ecfef7db54cc68a0af4afa92ac14ae16f69cb2110eb532b3e16f4e: Status 404 returned error can't find the container with id 0d3e01a4b9ecfef7db54cc68a0af4afa92ac14ae16f69cb2110eb532b3e16f4e
Jul 06 14:09:37.879728 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.879697    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:37.879836 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.879763    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:37.879836 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:37.879792    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:38.585824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.585784    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" event={"ID":"ce9e207c-e539-496f-bab8-5a9fc850e0f0","Type":"ContainerStarted","Data":"de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe"}
Jul 06 14:09:38.586034 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.585848    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" event={"ID":"ce9e207c-e539-496f-bab8-5a9fc850e0f0","Type":"ContainerStarted","Data":"0d3e01a4b9ecfef7db54cc68a0af4afa92ac14ae16f69cb2110eb532b3e16f4e"}
Jul 06 14:09:38.605149 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.605101    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" podStartSLOduration=1.6050852500000001 podStartE2EDuration="1.60508525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:38.604951152 +0000 UTC m=+1478.364923086" watchObservedRunningTime="2026-07-06 14:09:38.60508525 +0000 UTC m=+1478.365057172"
Jul 06 14:09:38.736108 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.736068    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:38.741057 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.741033    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:38.761810 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.761771    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a" path="/var/lib/kubelet/pods/f008d5fb-03e7-4cdb-a5c2-32b1bce71b4a/volumes"
Jul 06 14:09:38.781026 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.780993    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"]
Jul 06 14:09:38.784682 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.784660    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.786553 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.786531    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-23cf4773-serving-cert\""
Jul 06 14:09:38.786659 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.786580    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:09:38.796578 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.796553    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"]
Jul 06 14:09:38.871466 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.871428    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e935faf-1e01-4b61-90cc-45d4b608a5c2-openshift-service-ca\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.871637 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.871553    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.871637 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.871582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnshk\" (UniqueName: \"kubernetes.io/projected/2e935faf-1e01-4b61-90cc-45d4b608a5c2-kube-api-access-vnshk\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.972918 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.972885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e935faf-1e01-4b61-90cc-45d4b608a5c2-openshift-service-ca\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.973388 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.973030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.973388 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.973060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnshk\" (UniqueName: \"kubernetes.io/projected/2e935faf-1e01-4b61-90cc-45d4b608a5c2-kube-api-access-vnshk\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.973388 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:38.973171    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-23cf4773-serving-cert: secret "maas-api-e2e-ait-23cf4773-serving-cert" not found
Jul 06 14:09:38.973388 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:38.973250    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls podName:2e935faf-1e01-4b61-90cc-45d4b608a5c2 nodeName:}" failed. No retries permitted until 2026-07-06 14:09:39.473230322 +0000 UTC m=+1479.233202226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls") pod "maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g" (UID: "2e935faf-1e01-4b61-90cc-45d4b608a5c2") : secret "maas-api-e2e-ait-23cf4773-serving-cert" not found
Jul 06 14:09:38.973701 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.973678    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e935faf-1e01-4b61-90cc-45d4b608a5c2-openshift-service-ca\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:38.994257 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:38.994230    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnshk\" (UniqueName: \"kubernetes.io/projected/2e935faf-1e01-4b61-90cc-45d4b608a5c2-kube-api-access-vnshk\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:39.477736 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:39.477704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:39.480155 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:39.480135    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls\") pod \"maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") " pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:39.592091 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:39.592062    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:39.593093 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:39.593074    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:39.696398 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:39.696363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:39.828184 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:39.828144    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"]
Jul 06 14:09:39.830632 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:09:39.830599    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e935faf_1e01_4b61_90cc_45d4b608a5c2.slice/crio-004f0fa0a71763d1f3b5bac032090f5895bdabe8863866e596064b8f47b610ff WatchSource:0}: Error finding container 004f0fa0a71763d1f3b5bac032090f5895bdabe8863866e596064b8f47b610ff: Status 404 returned error can't find the container with id 004f0fa0a71763d1f3b5bac032090f5895bdabe8863866e596064b8f47b610ff
Jul 06 14:09:40.600597 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:40.600564    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g" event={"ID":"2e935faf-1e01-4b61-90cc-45d4b608a5c2","Type":"ContainerStarted","Data":"004f0fa0a71763d1f3b5bac032090f5895bdabe8863866e596064b8f47b610ff"}
Jul 06 14:09:41.607876 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:41.607826    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g" event={"ID":"2e935faf-1e01-4b61-90cc-45d4b608a5c2","Type":"ContainerStarted","Data":"9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5"}
Jul 06 14:09:41.608294 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:41.607968    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:41.625037 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:41.624987    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g" podStartSLOduration=2.789317397 podStartE2EDuration="3.62497098s" totalImagesPullingTime="835.653583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:41.624287474 +0000 UTC m=+1481.384259396" watchObservedRunningTime="2026-07-06 14:09:41.62497098 +0000 UTC m=+1481.384942901"
Jul 06 14:09:44.040338 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.040301    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"]
Jul 06 14:09:44.040745 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.040717    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g" podUID="2e935faf-1e01-4b61-90cc-45d4b608a5c2" containerName="maas-api" containerID="cri-o://9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5" gracePeriod=30
Jul 06 14:09:44.339905 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.339882    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:44.425573 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.425541    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls\") pod \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") "
Jul 06 14:09:44.425784 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.425586    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnshk\" (UniqueName: \"kubernetes.io/projected/2e935faf-1e01-4b61-90cc-45d4b608a5c2-kube-api-access-vnshk\") pod \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") "
Jul 06 14:09:44.425784 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.425703    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e935faf-1e01-4b61-90cc-45d4b608a5c2-openshift-service-ca\") pod \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\" (UID: \"2e935faf-1e01-4b61-90cc-45d4b608a5c2\") "
Jul 06 14:09:44.426020 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.425988    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e935faf-1e01-4b61-90cc-45d4b608a5c2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e935faf-1e01-4b61-90cc-45d4b608a5c2" (UID: "2e935faf-1e01-4b61-90cc-45d4b608a5c2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:09:44.427583 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.427558    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e935faf-1e01-4b61-90cc-45d4b608a5c2" (UID: "2e935faf-1e01-4b61-90cc-45d4b608a5c2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:09:44.428028 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.428007    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e935faf-1e01-4b61-90cc-45d4b608a5c2-kube-api-access-vnshk" (OuterVolumeSpecName: "kube-api-access-vnshk") pod "2e935faf-1e01-4b61-90cc-45d4b608a5c2" (UID: "2e935faf-1e01-4b61-90cc-45d4b608a5c2"). InnerVolumeSpecName "kube-api-access-vnshk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:09:44.526800 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.526768    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e935faf-1e01-4b61-90cc-45d4b608a5c2-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:44.526800 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.526794    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e935faf-1e01-4b61-90cc-45d4b608a5c2-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:44.526800 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.526805    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnshk\" (UniqueName: \"kubernetes.io/projected/2e935faf-1e01-4b61-90cc-45d4b608a5c2-kube-api-access-vnshk\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:44.623298 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.623269    2572 generic.go:356] "Generic (PLEG): container finished" podID="2e935faf-1e01-4b61-90cc-45d4b608a5c2" containerID="9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5" exitCode=0
Jul 06 14:09:44.623479 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.623327    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"
Jul 06 14:09:44.623479 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.623368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g" event={"ID":"2e935faf-1e01-4b61-90cc-45d4b608a5c2","Type":"ContainerDied","Data":"9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5"}
Jul 06 14:09:44.623479 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.623404    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g" event={"ID":"2e935faf-1e01-4b61-90cc-45d4b608a5c2","Type":"ContainerDied","Data":"004f0fa0a71763d1f3b5bac032090f5895bdabe8863866e596064b8f47b610ff"}
Jul 06 14:09:44.623479 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.623425    2572 scope.go:117] "RemoveContainer" containerID="9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5"
Jul 06 14:09:44.632640 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.632581    2572 scope.go:117] "RemoveContainer" containerID="9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5"
Jul 06 14:09:44.632827 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:44.632803    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5\": container with ID starting with 9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5 not found: ID does not exist" containerID="9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5"
Jul 06 14:09:44.632885 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.632831    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5"} err="failed to get container status \"9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5\": rpc error: code = NotFound desc = could not find container \"9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5\": container with ID starting with 9717a2e3dfb4b92bac168f007336b776b2dbf59ab930679c709398241ab1f8d5 not found: ID does not exist"
Jul 06 14:09:44.644440 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.644416    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"]
Jul 06 14:09:44.647926 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.647904    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-23cf4773-79b5494bd9-tms5g"]
Jul 06 14:09:44.761139 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:44.761109    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e935faf-1e01-4b61-90cc-45d4b608a5c2" path="/var/lib/kubelet/pods/2e935faf-1e01-4b61-90cc-45d4b608a5c2/volumes"
Jul 06 14:09:49.651341 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:49.651303    2572 generic.go:356] "Generic (PLEG): container finished" podID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerID="de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe" exitCode=0
Jul 06 14:09:49.651787 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:49.651379    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" event={"ID":"ce9e207c-e539-496f-bab8-5a9fc850e0f0","Type":"ContainerDied","Data":"de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe"}
Jul 06 14:09:49.651835 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:49.651787    2572 scope.go:117] "RemoveContainer" containerID="de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe"
Jul 06 14:09:49.652754 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:49.652725    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:49.652853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:49.652795    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:49.652853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:49.652825    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:50.161864 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:50.161824    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"]
Jul 06 14:09:50.658754 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:50.658711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" event={"ID":"ce9e207c-e539-496f-bab8-5a9fc850e0f0","Type":"ContainerStarted","Data":"d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763"}
Jul 06 14:09:50.659161 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:50.658800    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerName="istio-proxy" containerID="cri-o://d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763" gracePeriod=30
Jul 06 14:09:54.592299 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:54.592266    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:55.911924 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:55.911900    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:56.036594 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036501    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-data\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.036594 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036587    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istiod-ca-cert\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.036833 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036615    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-podinfo\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.036833 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036638    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-envoy\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.036833 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036672    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-credential-socket\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.036833 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036713    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-socket\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.036833 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036765    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-token\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.036833 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036820    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlrz2\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-kube-api-access-zlrz2\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.037139 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.036868    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-certs\") pod \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\" (UID: \"ce9e207c-e539-496f-bab8-5a9fc850e0f0\") "
Jul 06 14:09:56.037242 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.037191    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:56.037312 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.037245    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:09:56.037312 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.037261    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:56.037417 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.037339    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:56.037549 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.037523    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:56.038861 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.038824    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:09:56.039178 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.039145    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-kube-api-access-zlrz2" (OuterVolumeSpecName: "kube-api-access-zlrz2") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "kube-api-access-zlrz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:09:56.039458 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.039428    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:09:56.039533 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.039437    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce9e207c-e539-496f-bab8-5a9fc850e0f0" (UID: "ce9e207c-e539-496f-bab8-5a9fc850e0f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:09:56.137927 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137894    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlrz2\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-kube-api-access-zlrz2\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.137927 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137923    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.137927 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137933    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.138152 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137942    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.138152 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137950    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.138152 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137957    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.138152 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137965    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.138152 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137973    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9e207c-e539-496f-bab8-5a9fc850e0f0-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.138152 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.137981    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9e207c-e539-496f-bab8-5a9fc850e0f0-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:09:56.377053 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377021    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"]
Jul 06 14:09:56.377427 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377411    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerName="istio-proxy"
Jul 06 14:09:56.377495 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377427    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerName="istio-proxy"
Jul 06 14:09:56.377495 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377439    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerName="istio-proxy"
Jul 06 14:09:56.377495 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377445    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerName="istio-proxy"
Jul 06 14:09:56.377495 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377456    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e935faf-1e01-4b61-90cc-45d4b608a5c2" containerName="maas-api"
Jul 06 14:09:56.377495 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377464    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e935faf-1e01-4b61-90cc-45d4b608a5c2" containerName="maas-api"
Jul 06 14:09:56.377766 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377537    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerName="istio-proxy"
Jul 06 14:09:56.377766 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377547    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerName="istio-proxy"
Jul 06 14:09:56.377766 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.377556    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e935faf-1e01-4b61-90cc-45d4b608a5c2" containerName="maas-api"
Jul 06 14:09:56.379976 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.379957    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.383605 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.383584    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bcca3e97-openshift-default-dockercfg-ks5g5\""
Jul 06 14:09:56.398254 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.398233    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"]
Jul 06 14:09:56.542089 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542053    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-socket\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542288 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-certs\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542288 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542131    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-envoy\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542288 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-podinfo\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542288 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-data\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542288 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a7150a-32bb-43e2-88d0-cee4813b6c29-istiod-ca-cert\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542288 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-token\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542500 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542303    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-credential-socket\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.542500 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.542322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wzv\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-kube-api-access-h7wzv\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643536 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643450    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-certs\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643536 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643487    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-envoy\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643536 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-podinfo\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643536 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643536    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-data\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a7150a-32bb-43e2-88d0-cee4813b6c29-istiod-ca-cert\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643593    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-token\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-credential-socket\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wzv\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-kube-api-access-h7wzv\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.643853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-socket\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.644114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643905    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-certs\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.644114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643927    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-data\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.644114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.643992    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-credential-socket\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.644114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.644099    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-socket\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.644488 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.644467    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a7150a-32bb-43e2-88d0-cee4813b6c29-istiod-ca-cert\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.645766 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.645739    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-envoy\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.645961 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.645943    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-podinfo\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.651165 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.651139    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wzv\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-kube-api-access-h7wzv\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.651361 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.651344    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-token\") pod \"e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") " pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.688428 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.688400    2572 generic.go:356] "Generic (PLEG): container finished" podID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" containerID="d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763" exitCode=0
Jul 06 14:09:56.688535 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.688444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" event={"ID":"ce9e207c-e539-496f-bab8-5a9fc850e0f0","Type":"ContainerDied","Data":"d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763"}
Jul 06 14:09:56.688535 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.688449    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"
Jul 06 14:09:56.688535 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.688486    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f" event={"ID":"ce9e207c-e539-496f-bab8-5a9fc850e0f0","Type":"ContainerDied","Data":"0d3e01a4b9ecfef7db54cc68a0af4afa92ac14ae16f69cb2110eb532b3e16f4e"}
Jul 06 14:09:56.688535 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.688508    2572 scope.go:117] "RemoveContainer" containerID="d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763"
Jul 06 14:09:56.691084 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.691066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:56.697395 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.697377    2572 scope.go:117] "RemoveContainer" containerID="de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe"
Jul 06 14:09:56.707789 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.707758    2572 scope.go:117] "RemoveContainer" containerID="d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763"
Jul 06 14:09:56.708086 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:56.708064    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763\": container with ID starting with d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763 not found: ID does not exist" containerID="d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763"
Jul 06 14:09:56.708160 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.708092    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763"} err="failed to get container status \"d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763\": rpc error: code = NotFound desc = could not find container \"d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763\": container with ID starting with d8a4e4d2936e34a8419b39a2b3409b7496c738fb2598916230c9c10298748763 not found: ID does not exist"
Jul 06 14:09:56.708160 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.708110    2572 scope.go:117] "RemoveContainer" containerID="de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe"
Jul 06 14:09:56.708412 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:56.708388    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe\": container with ID starting with de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe not found: ID does not exist" containerID="de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe"
Jul 06 14:09:56.708486 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.708419    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe"} err="failed to get container status \"de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe\": rpc error: code = NotFound desc = could not find container \"de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe\": container with ID starting with de2f2c5c64b88ac26d325cec99622616d2b0fe30be8b1940d6243e42f81c6abe not found: ID does not exist"
Jul 06 14:09:56.711260 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.711238    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"]
Jul 06 14:09:56.718791 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.718772    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-23cf4773-openshift-default-5f98f75749-n6f6f"]
Jul 06 14:09:56.762501 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.762472    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce9e207c-e539-496f-bab8-5a9fc850e0f0" path="/var/lib/kubelet/pods/ce9e207c-e539-496f-bab8-5a9fc850e0f0/volumes"
Jul 06 14:09:56.837979 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.837946    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"]
Jul 06 14:09:56.842222 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:09:56.842179    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a7150a_32bb_43e2_88d0_cee4813b6c29.slice/crio-a6454fa6b3a807fce13edb5259c201166e8c0b0493529f1b617717b0eaea3cd9 WatchSource:0}: Error finding container a6454fa6b3a807fce13edb5259c201166e8c0b0493529f1b617717b0eaea3cd9: Status 404 returned error can't find the container with id a6454fa6b3a807fce13edb5259c201166e8c0b0493529f1b617717b0eaea3cd9
Jul 06 14:09:56.844446 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.844413    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:56.844555 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.844488    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:56.844555 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:56.844533    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:09:57.695062 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.695021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn" event={"ID":"24a7150a-32bb-43e2-88d0-cee4813b6c29","Type":"ContainerStarted","Data":"e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83"}
Jul 06 14:09:57.695561 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.695110    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn" event={"ID":"24a7150a-32bb-43e2-88d0-cee4813b6c29","Type":"ContainerStarted","Data":"a6454fa6b3a807fce13edb5259c201166e8c0b0493529f1b617717b0eaea3cd9"}
Jul 06 14:09:57.716969 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.716918    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn" podStartSLOduration=1.716903414 podStartE2EDuration="1.716903414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:57.715873497 +0000 UTC m=+1497.475845419" watchObservedRunningTime="2026-07-06 14:09:57.716903414 +0000 UTC m=+1497.476875335"
Jul 06 14:09:57.806409 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.806382    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"]
Jul 06 14:09:57.809037 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.809022    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:57.811083 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.811045    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-bcca3e97-serving-cert\""
Jul 06 14:09:57.811422 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.811408    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:09:57.823152 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.823120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"]
Jul 06 14:09:57.959265 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.959170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5gdz\" (UniqueName: \"kubernetes.io/projected/4068963d-55f0-49d1-85b2-089f12df0fde-kube-api-access-j5gdz\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:57.959265 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.959243    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4068963d-55f0-49d1-85b2-089f12df0fde-openshift-service-ca\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:57.959447 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:57.959309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.060724 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.060684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.060920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.060771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5gdz\" (UniqueName: \"kubernetes.io/projected/4068963d-55f0-49d1-85b2-089f12df0fde-kube-api-access-j5gdz\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.060920 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:58.060827    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-bcca3e97-serving-cert: secret "maas-api-e2e-derive-bcca3e97-serving-cert" not found
Jul 06 14:09:58.060920 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:09:58.060892    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls podName:4068963d-55f0-49d1-85b2-089f12df0fde nodeName:}" failed. No retries permitted until 2026-07-06 14:09:58.56087556 +0000 UTC m=+1498.320847464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls") pod "maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d" (UID: "4068963d-55f0-49d1-85b2-089f12df0fde") : secret "maas-api-e2e-derive-bcca3e97-serving-cert" not found
Jul 06 14:09:58.060920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.060834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4068963d-55f0-49d1-85b2-089f12df0fde-openshift-service-ca\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.061529 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.061506    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4068963d-55f0-49d1-85b2-089f12df0fde-openshift-service-ca\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.076298 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.076271    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5gdz\" (UniqueName: \"kubernetes.io/projected/4068963d-55f0-49d1-85b2-089f12df0fde-kube-api-access-j5gdz\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.564061 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.564024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.566638 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.566611    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls\") pod \"maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") " pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.692174 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.692141    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:58.696978 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.696951    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:58.700795 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.700767    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:58.701567 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.701549    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:09:58.718923 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.718898    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:09:58.861138 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:58.861115    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"]
Jul 06 14:09:58.863815 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:09:58.863787    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4068963d_55f0_49d1_85b2_089f12df0fde.slice/crio-2662c2b2c8463b102fb34e7661820f4f462146162df144edb5a83ee3bde7e444 WatchSource:0}: Error finding container 2662c2b2c8463b102fb34e7661820f4f462146162df144edb5a83ee3bde7e444: Status 404 returned error can't find the container with id 2662c2b2c8463b102fb34e7661820f4f462146162df144edb5a83ee3bde7e444
Jul 06 14:09:59.706647 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:09:59.706610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d" event={"ID":"4068963d-55f0-49d1-85b2-089f12df0fde","Type":"ContainerStarted","Data":"2662c2b2c8463b102fb34e7661820f4f462146162df144edb5a83ee3bde7e444"}
Jul 06 14:10:00.712160 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:00.712128    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d" event={"ID":"4068963d-55f0-49d1-85b2-089f12df0fde","Type":"ContainerStarted","Data":"7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b"}
Jul 06 14:10:00.712549 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:00.712347    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:10:00.729429 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:00.729387    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d" podStartSLOduration=2.689855021 podStartE2EDuration="3.729372492s" totalImagesPullingTime="1.039517471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:10:00.727588258 +0000 UTC m=+1500.487560181" watchObservedRunningTime="2026-07-06 14:10:00.729372492 +0000 UTC m=+1500.489344432"
Jul 06 14:10:02.236163 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:02.236095    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"]
Jul 06 14:10:02.236581 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:02.236320    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn" podUID="24a7150a-32bb-43e2-88d0-cee4813b6c29" containerName="istio-proxy" containerID="cri-o://e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83" gracePeriod=30
Jul 06 14:10:02.349452 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:02.349419    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"]
Jul 06 14:10:02.722665 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:02.722619    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d" podUID="4068963d-55f0-49d1-85b2-089f12df0fde" containerName="maas-api" containerID="cri-o://7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b" gracePeriod=30
Jul 06 14:10:02.955252 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:02.955226    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:10:03.109975 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.109948    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5gdz\" (UniqueName: \"kubernetes.io/projected/4068963d-55f0-49d1-85b2-089f12df0fde-kube-api-access-j5gdz\") pod \"4068963d-55f0-49d1-85b2-089f12df0fde\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") "
Jul 06 14:10:03.110151 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.109985    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls\") pod \"4068963d-55f0-49d1-85b2-089f12df0fde\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") "
Jul 06 14:10:03.110151 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.110040    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4068963d-55f0-49d1-85b2-089f12df0fde-openshift-service-ca\") pod \"4068963d-55f0-49d1-85b2-089f12df0fde\" (UID: \"4068963d-55f0-49d1-85b2-089f12df0fde\") "
Jul 06 14:10:03.110497 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.110467    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4068963d-55f0-49d1-85b2-089f12df0fde-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4068963d-55f0-49d1-85b2-089f12df0fde" (UID: "4068963d-55f0-49d1-85b2-089f12df0fde"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:10:03.112082 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.112055    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4068963d-55f0-49d1-85b2-089f12df0fde" (UID: "4068963d-55f0-49d1-85b2-089f12df0fde"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:10:03.112082 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.112066    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4068963d-55f0-49d1-85b2-089f12df0fde-kube-api-access-j5gdz" (OuterVolumeSpecName: "kube-api-access-j5gdz") pod "4068963d-55f0-49d1-85b2-089f12df0fde" (UID: "4068963d-55f0-49d1-85b2-089f12df0fde"). InnerVolumeSpecName "kube-api-access-j5gdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:10:03.211338 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.211299    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5gdz\" (UniqueName: \"kubernetes.io/projected/4068963d-55f0-49d1-85b2-089f12df0fde-kube-api-access-j5gdz\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:03.211338 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.211334    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4068963d-55f0-49d1-85b2-089f12df0fde-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:03.211543 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.211349    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4068963d-55f0-49d1-85b2-089f12df0fde-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:03.729449 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.729415    2572 generic.go:356] "Generic (PLEG): container finished" podID="4068963d-55f0-49d1-85b2-089f12df0fde" containerID="7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b" exitCode=0
Jul 06 14:10:03.729914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.729467    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"
Jul 06 14:10:03.729914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.729504    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d" event={"ID":"4068963d-55f0-49d1-85b2-089f12df0fde","Type":"ContainerDied","Data":"7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b"}
Jul 06 14:10:03.729914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.729561    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d" event={"ID":"4068963d-55f0-49d1-85b2-089f12df0fde","Type":"ContainerDied","Data":"2662c2b2c8463b102fb34e7661820f4f462146162df144edb5a83ee3bde7e444"}
Jul 06 14:10:03.729914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.729584    2572 scope.go:117] "RemoveContainer" containerID="7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b"
Jul 06 14:10:03.739127 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.739110    2572 scope.go:117] "RemoveContainer" containerID="7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b"
Jul 06 14:10:03.739438 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:10:03.739416    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b\": container with ID starting with 7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b not found: ID does not exist" containerID="7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b"
Jul 06 14:10:03.739536 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.739445    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b"} err="failed to get container status \"7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b\": rpc error: code = NotFound desc = could not find container \"7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b\": container with ID starting with 7ff3de0265c657d6c0c1f075a3305f1a7c0f0e79dcf2829746977bdf9310224b not found: ID does not exist"
Jul 06 14:10:03.751059 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.751033    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"]
Jul 06 14:10:03.754890 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:03.754869    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-bcca3e97-6dbff9c6dd-4sl2d"]
Jul 06 14:10:04.761017 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:04.760980    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4068963d-55f0-49d1-85b2-089f12df0fde" path="/var/lib/kubelet/pods/4068963d-55f0-49d1-85b2-089f12df0fde/volumes"
Jul 06 14:10:07.480143 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.480116    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:10:07.549750 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549661    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a7150a-32bb-43e2-88d0-cee4813b6c29-istiod-ca-cert\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.549750 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549726    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-certs\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.549750 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549741    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-data\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.550036 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549761    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-envoy\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.550036 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549779    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-token\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.550036 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549795    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7wzv\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-kube-api-access-h7wzv\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.550036 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549817    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-credential-socket\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.550036 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549859    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-podinfo\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.550036 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.549921    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-socket\") pod \"24a7150a-32bb-43e2-88d0-cee4813b6c29\" (UID: \"24a7150a-32bb-43e2-88d0-cee4813b6c29\") "
Jul 06 14:10:07.550377 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.550106    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a7150a-32bb-43e2-88d0-cee4813b6c29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:10:07.550377 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.550311    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:07.550377 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.550111    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-data" (OuterVolumeSpecName: "istio-data") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:07.550377 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.550352    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:07.550377 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.550359    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24a7150a-32bb-43e2-88d0-cee4813b6c29-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.550577 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.550446    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:07.552079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.552050    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:10:07.552191 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.552078    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-token" (OuterVolumeSpecName: "istio-token") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:10:07.552425 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.552400    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:10:07.552425 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.552409    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-kube-api-access-h7wzv" (OuterVolumeSpecName: "kube-api-access-h7wzv") pod "24a7150a-32bb-43e2-88d0-cee4813b6c29" (UID: "24a7150a-32bb-43e2-88d0-cee4813b6c29"). InnerVolumeSpecName "kube-api-access-h7wzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:10:07.651500 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651458    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.651500 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651490    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.651500 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651502    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.651500 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651509    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.651775 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651519    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7wzv\" (UniqueName: \"kubernetes.io/projected/24a7150a-32bb-43e2-88d0-cee4813b6c29-kube-api-access-h7wzv\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.651775 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651529    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.651775 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651537    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24a7150a-32bb-43e2-88d0-cee4813b6c29-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.651775 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.651545    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24a7150a-32bb-43e2-88d0-cee4813b6c29-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:10:07.749876 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.749840    2572 generic.go:356] "Generic (PLEG): container finished" podID="24a7150a-32bb-43e2-88d0-cee4813b6c29" containerID="e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83" exitCode=0
Jul 06 14:10:07.750024 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.749885    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn" event={"ID":"24a7150a-32bb-43e2-88d0-cee4813b6c29","Type":"ContainerDied","Data":"e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83"}
Jul 06 14:10:07.750024 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.749938    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn" event={"ID":"24a7150a-32bb-43e2-88d0-cee4813b6c29","Type":"ContainerDied","Data":"a6454fa6b3a807fce13edb5259c201166e8c0b0493529f1b617717b0eaea3cd9"}
Jul 06 14:10:07.750024 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.749960    2572 scope.go:117] "RemoveContainer" containerID="e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83"
Jul 06 14:10:07.750024 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.749892    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"
Jul 06 14:10:07.759411 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.759394    2572 scope.go:117] "RemoveContainer" containerID="e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83"
Jul 06 14:10:07.759639 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:10:07.759623    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83\": container with ID starting with e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83 not found: ID does not exist" containerID="e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83"
Jul 06 14:10:07.759685 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.759645    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83"} err="failed to get container status \"e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83\": rpc error: code = NotFound desc = could not find container \"e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83\": container with ID starting with e670b5671afcd9b40505c9c63437d53322e0a79f9a645314fcb9ae2f18bedb83 not found: ID does not exist"
Jul 06 14:10:07.775378 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.775339    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"]
Jul 06 14:10:07.776972 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:07.776949    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bcca3e97-openshift-default-57dc6d56b7-zwkcn"]
Jul 06 14:10:08.760535 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:10:08.760498    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a7150a-32bb-43e2-88d0-cee4813b6c29" path="/var/lib/kubelet/pods/24a7150a-32bb-43e2-88d0-cee4813b6c29/volumes"
Jul 06 14:11:44.540161 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.540130    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"]
Jul 06 14:11:44.540914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.540533    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a7150a-32bb-43e2-88d0-cee4813b6c29" containerName="istio-proxy"
Jul 06 14:11:44.540914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.540545    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a7150a-32bb-43e2-88d0-cee4813b6c29" containerName="istio-proxy"
Jul 06 14:11:44.540914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.540568    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4068963d-55f0-49d1-85b2-089f12df0fde" containerName="maas-api"
Jul 06 14:11:44.540914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.540575    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4068963d-55f0-49d1-85b2-089f12df0fde" containerName="maas-api"
Jul 06 14:11:44.540914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.540635    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a7150a-32bb-43e2-88d0-cee4813b6c29" containerName="istio-proxy"
Jul 06 14:11:44.540914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.540645    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4068963d-55f0-49d1-85b2-089f12df0fde" containerName="maas-api"
Jul 06 14:11:44.542517 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.542501    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.544394 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.544373    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 14:11:44.544541 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.544521    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-db3d99b3-openshift-default-dockercfg-pjgz7\""
Jul 06 14:11:44.567445 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.567425    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"]
Jul 06 14:11:44.627282 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627250    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-data\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627282 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627285    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-token\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627476 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-socket\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627476 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-podinfo\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627476 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627414    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-credential-socket\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627476 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627443    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-envoy\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627476 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a01be24d-a763-49b1-aad1-e05c03601bd5-istiod-ca-cert\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627645 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-certs\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.627645 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.627514    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqpkl\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-kube-api-access-xqpkl\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728067 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-credential-socket\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728067 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728067    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-envoy\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728310 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a01be24d-a763-49b1-aad1-e05c03601bd5-istiod-ca-cert\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728310 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-certs\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728310 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728129    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqpkl\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-kube-api-access-xqpkl\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728310 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728261    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-data\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728310 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-token\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728545 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728323    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-socket\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.728751 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.728686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-podinfo\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.729286 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.729257    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a01be24d-a763-49b1-aad1-e05c03601bd5-istiod-ca-cert\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.729461 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.729296    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-credential-socket\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.729575 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.729318    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-data\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.734941 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.733429    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-socket\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.735754 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.735563    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-certs\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.735901 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.735876    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-envoy\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.736247 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.736172    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-podinfo\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.738322 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.738292    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-token\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.738489 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.738470    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqpkl\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-kube-api-access-xqpkl\") pod \"e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") " pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.852790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.852706    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:44.986123 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.986091    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"]
Jul 06 14:11:44.989204 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:11:44.989167    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01be24d_a763_49b1_aad1_e05c03601bd5.slice/crio-2fe4c66958df0424943d44002a433a8bd36d9c85eba976991b61a7b46c7e39c4 WatchSource:0}: Error finding container 2fe4c66958df0424943d44002a433a8bd36d9c85eba976991b61a7b46c7e39c4: Status 404 returned error can't find the container with id 2fe4c66958df0424943d44002a433a8bd36d9c85eba976991b61a7b46c7e39c4
Jul 06 14:11:44.991519 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.991481    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:11:44.991623 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.991555    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:11:44.991623 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:44.991585    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:11:45.192605 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:45.192569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" event={"ID":"a01be24d-a763-49b1-aad1-e05c03601bd5","Type":"ContainerStarted","Data":"adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de"}
Jul 06 14:11:45.192753 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:45.192630    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" event={"ID":"a01be24d-a763-49b1-aad1-e05c03601bd5","Type":"ContainerStarted","Data":"2fe4c66958df0424943d44002a433a8bd36d9c85eba976991b61a7b46c7e39c4"}
Jul 06 14:11:45.211438 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:45.211366    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" podStartSLOduration=1.211349048 podStartE2EDuration="1.211349048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:45.209785046 +0000 UTC m=+1604.969756972" watchObservedRunningTime="2026-07-06 14:11:45.211349048 +0000 UTC m=+1604.971320972"
Jul 06 14:11:45.853601 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:45.853566    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:46.858895 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:46.858868    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:47.202644 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.202558    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:47.203416 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.203397    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:11:47.394420 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.394387    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"]
Jul 06 14:11:47.397192 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.397169    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.399840 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.399815    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-db3d99b3-serving-cert\""
Jul 06 14:11:47.400415 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.400396    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:11:47.417765 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.417734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"]
Jul 06 14:11:47.456701 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.456605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.456701 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.456648    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5def55-a4a8-4edb-81a4-0c4235edab79-openshift-service-ca\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.456923 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.456732    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88cr\" (UniqueName: \"kubernetes.io/projected/7a5def55-a4a8-4edb-81a4-0c4235edab79-kube-api-access-j88cr\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.557964 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.557921    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.557964 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.557967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5def55-a4a8-4edb-81a4-0c4235edab79-openshift-service-ca\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.558261 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:11:47.558086    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-db3d99b3-serving-cert: secret "maas-api-e2e-mt-db3d99b3-serving-cert" not found
Jul 06 14:11:47.558261 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:11:47.558155    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls podName:7a5def55-a4a8-4edb-81a4-0c4235edab79 nodeName:}" failed. No retries permitted until 2026-07-06 14:11:48.058134197 +0000 UTC m=+1607.818106117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls") pod "maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk" (UID: "7a5def55-a4a8-4edb-81a4-0c4235edab79") : secret "maas-api-e2e-mt-db3d99b3-serving-cert" not found
Jul 06 14:11:47.558261 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.558176    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88cr\" (UniqueName: \"kubernetes.io/projected/7a5def55-a4a8-4edb-81a4-0c4235edab79-kube-api-access-j88cr\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.558750 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.558720    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5def55-a4a8-4edb-81a4-0c4235edab79-openshift-service-ca\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:47.576146 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:47.576109    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88cr\" (UniqueName: \"kubernetes.io/projected/7a5def55-a4a8-4edb-81a4-0c4235edab79-kube-api-access-j88cr\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:48.063802 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:48.063761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:48.066132 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:48.066107    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls\") pod \"maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") " pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:48.309193 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:48.309140    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:48.460415 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:48.460383    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"]
Jul 06 14:11:48.463201 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:11:48.463149    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5def55_a4a8_4edb_81a4_0c4235edab79.slice/crio-d9ffc54ca5860c35dbf037b4e82cb150e91efe3dc75f50bbd715c23d28a7c87f WatchSource:0}: Error finding container d9ffc54ca5860c35dbf037b4e82cb150e91efe3dc75f50bbd715c23d28a7c87f: Status 404 returned error can't find the container with id d9ffc54ca5860c35dbf037b4e82cb150e91efe3dc75f50bbd715c23d28a7c87f
Jul 06 14:11:49.213533 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:49.213482    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk" event={"ID":"7a5def55-a4a8-4edb-81a4-0c4235edab79","Type":"ContainerStarted","Data":"e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b"}
Jul 06 14:11:49.213963 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:49.213590    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk" event={"ID":"7a5def55-a4a8-4edb-81a4-0c4235edab79","Type":"ContainerStarted","Data":"d9ffc54ca5860c35dbf037b4e82cb150e91efe3dc75f50bbd715c23d28a7c87f"}
Jul 06 14:11:49.213963 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:49.213710    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:49.233655 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:49.233609    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk" podStartSLOduration=1.8482700840000001 podStartE2EDuration="2.2335941s" totalImagesPullingTime="385.324016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:49.232128202 +0000 UTC m=+1608.992100123" watchObservedRunningTime="2026-07-06 14:11:49.2335941 +0000 UTC m=+1608.993566021"
Jul 06 14:11:55.224557 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:55.224529    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:59.339185 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.339149    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"]
Jul 06 14:11:59.339616 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.339365    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk" podUID="7a5def55-a4a8-4edb-81a4-0c4235edab79" containerName="maas-api" containerID="cri-o://e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b" gracePeriod=30
Jul 06 14:11:59.603465 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.603440    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:11:59.668812 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.668775    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls\") pod \"7a5def55-a4a8-4edb-81a4-0c4235edab79\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") "
Jul 06 14:11:59.669014 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.668972    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j88cr\" (UniqueName: \"kubernetes.io/projected/7a5def55-a4a8-4edb-81a4-0c4235edab79-kube-api-access-j88cr\") pod \"7a5def55-a4a8-4edb-81a4-0c4235edab79\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") "
Jul 06 14:11:59.669078 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.669022    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5def55-a4a8-4edb-81a4-0c4235edab79-openshift-service-ca\") pod \"7a5def55-a4a8-4edb-81a4-0c4235edab79\" (UID: \"7a5def55-a4a8-4edb-81a4-0c4235edab79\") "
Jul 06 14:11:59.669506 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.669469    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a5def55-a4a8-4edb-81a4-0c4235edab79-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a5def55-a4a8-4edb-81a4-0c4235edab79" (UID: "7a5def55-a4a8-4edb-81a4-0c4235edab79"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:11:59.670897 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.670872    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a5def55-a4a8-4edb-81a4-0c4235edab79" (UID: "7a5def55-a4a8-4edb-81a4-0c4235edab79"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:11:59.671103 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.671086    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a5def55-a4a8-4edb-81a4-0c4235edab79-kube-api-access-j88cr" (OuterVolumeSpecName: "kube-api-access-j88cr") pod "7a5def55-a4a8-4edb-81a4-0c4235edab79" (UID: "7a5def55-a4a8-4edb-81a4-0c4235edab79"). InnerVolumeSpecName "kube-api-access-j88cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:11:59.770137 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.770055    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5def55-a4a8-4edb-81a4-0c4235edab79-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:11:59.770137 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.770087    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5def55-a4a8-4edb-81a4-0c4235edab79-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:11:59.770137 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:11:59.770097    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88cr\" (UniqueName: \"kubernetes.io/projected/7a5def55-a4a8-4edb-81a4-0c4235edab79-kube-api-access-j88cr\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:00.281040 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.280997    2572 generic.go:356] "Generic (PLEG): container finished" podID="7a5def55-a4a8-4edb-81a4-0c4235edab79" containerID="e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b" exitCode=0
Jul 06 14:12:00.281276 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.281069    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"
Jul 06 14:12:00.281276 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.281081    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk" event={"ID":"7a5def55-a4a8-4edb-81a4-0c4235edab79","Type":"ContainerDied","Data":"e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b"}
Jul 06 14:12:00.281276 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.281170    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk" event={"ID":"7a5def55-a4a8-4edb-81a4-0c4235edab79","Type":"ContainerDied","Data":"d9ffc54ca5860c35dbf037b4e82cb150e91efe3dc75f50bbd715c23d28a7c87f"}
Jul 06 14:12:00.281276 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.281194    2572 scope.go:117] "RemoveContainer" containerID="e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b"
Jul 06 14:12:00.291514 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.291494    2572 scope.go:117] "RemoveContainer" containerID="e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b"
Jul 06 14:12:00.291822 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:12:00.291803    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b\": container with ID starting with e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b not found: ID does not exist" containerID="e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b"
Jul 06 14:12:00.291893 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.291829    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b"} err="failed to get container status \"e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b\": rpc error: code = NotFound desc = could not find container \"e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b\": container with ID starting with e5990c69cefc81382172d4c4fa2b229291a7b3f86aac5e73b6d87658969e2b6b not found: ID does not exist"
Jul 06 14:12:00.303556 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.303459    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"]
Jul 06 14:12:00.305375 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.305350    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-db3d99b3-5754f5b5c5-qklkk"]
Jul 06 14:12:00.762837 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:00.762804    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a5def55-a4a8-4edb-81a4-0c4235edab79" path="/var/lib/kubelet/pods/7a5def55-a4a8-4edb-81a4-0c4235edab79/volumes"
Jul 06 14:12:02.203565 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.203526    2572 patch_prober.go:28] interesting pod/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 14:12:02.204010 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.203602    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 14:12:02.292363 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.292278    2572 generic.go:356] "Generic (PLEG): container finished" podID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerID="adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de" exitCode=0
Jul 06 14:12:02.292503 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.292363    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" event={"ID":"a01be24d-a763-49b1-aad1-e05c03601bd5","Type":"ContainerDied","Data":"adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de"}
Jul 06 14:12:02.292761 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.292746    2572 scope.go:117] "RemoveContainer" containerID="adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de"
Jul 06 14:12:02.293724 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.293699    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:02.293778 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.293765    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:02.293819 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:02.293796    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:03.299035 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:03.299002    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" event={"ID":"a01be24d-a763-49b1-aad1-e05c03601bd5","Type":"ContainerStarted","Data":"e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d"}
Jul 06 14:12:03.853811 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:03.853779    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:12:03.857649 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:03.857623    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:12:04.304114 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:04.304021    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:12:04.304891 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:04.304873    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:12:05.664317 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:05.664284    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"]
Jul 06 14:12:06.313357 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:06.313321    2572 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" secret="" err="secret \"e2e-mt-db3d99b3-openshift-default-dockercfg-pjgz7\" not found"
Jul 06 14:12:07.317411 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:07.317368    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy" containerID="cri-o://e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d" gracePeriod=30
Jul 06 14:12:12.570241 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.570193    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:12:12.697549 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697517    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-token\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697549 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697562    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a01be24d-a763-49b1-aad1-e05c03601bd5-istiod-ca-cert\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697822 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697616    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-envoy\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697822 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697636    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-socket\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697822 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697659    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-credential-socket\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697822 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697724    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-podinfo\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697822 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697748    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-certs\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697822 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697779    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqpkl\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-kube-api-access-xqpkl\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.697822 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697819    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-data\") pod \"a01be24d-a763-49b1-aad1-e05c03601bd5\" (UID: \"a01be24d-a763-49b1-aad1-e05c03601bd5\") "
Jul 06 14:12:12.698247 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697914    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:12:12.698247 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.697996    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:12:12.698247 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.698144    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:12:12.698247 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.698180    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a01be24d-a763-49b1-aad1-e05c03601bd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:12:12.698247 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.698237    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.698468 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.698260    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.698703 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.698681    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:12:12.699814 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.699794    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:12:12.700084 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.700068    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-kube-api-access-xqpkl" (OuterVolumeSpecName: "kube-api-access-xqpkl") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "kube-api-access-xqpkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:12:12.700296 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.700268    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:12:12.700392 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.700301    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a01be24d-a763-49b1-aad1-e05c03601bd5" (UID: "a01be24d-a763-49b1-aad1-e05c03601bd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:12:12.798882 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.798855    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.798882 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.798877    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.799038 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.798887    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.799038 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.798901    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqpkl\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-kube-api-access-xqpkl\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.799038 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.798911    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.799038 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.798920    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a01be24d-a763-49b1-aad1-e05c03601bd5-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:12.799038 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:12.798929    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a01be24d-a763-49b1-aad1-e05c03601bd5-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:12:13.346324 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.346292    2572 generic.go:356] "Generic (PLEG): container finished" podID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerID="e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d" exitCode=0
Jul 06 14:12:13.346497 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.346341    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"
Jul 06 14:12:13.346497 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.346369    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" event={"ID":"a01be24d-a763-49b1-aad1-e05c03601bd5","Type":"ContainerDied","Data":"e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d"}
Jul 06 14:12:13.346497 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.346424    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv" event={"ID":"a01be24d-a763-49b1-aad1-e05c03601bd5","Type":"ContainerDied","Data":"2fe4c66958df0424943d44002a433a8bd36d9c85eba976991b61a7b46c7e39c4"}
Jul 06 14:12:13.346497 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.346445    2572 scope.go:117] "RemoveContainer" containerID="e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d"
Jul 06 14:12:13.357597 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.357576    2572 scope.go:117] "RemoveContainer" containerID="adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de"
Jul 06 14:12:13.361611 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.361590    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"]
Jul 06 14:12:13.365954 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.365452    2572 scope.go:117] "RemoveContainer" containerID="e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d"
Jul 06 14:12:13.365954 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:12:13.365812    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d\": container with ID starting with e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d not found: ID does not exist" containerID="e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d"
Jul 06 14:12:13.365954 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.365843    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d"} err="failed to get container status \"e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d\": rpc error: code = NotFound desc = could not find container \"e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d\": container with ID starting with e31abc59b4685d6e913df778bb88b8cdfde39fbe0b411df76feb2893973d7a0d not found: ID does not exist"
Jul 06 14:12:13.365954 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.365866    2572 scope.go:117] "RemoveContainer" containerID="adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de"
Jul 06 14:12:13.366345 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:12:13.366120    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de\": container with ID starting with adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de not found: ID does not exist" containerID="adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de"
Jul 06 14:12:13.366345 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.366148    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de"} err="failed to get container status \"adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de\": rpc error: code = NotFound desc = could not find container \"adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de\": container with ID starting with adbc91ba06dd0b9a1a1db889136f751e2a08f346a400896d18a48003ae8d25de not found: ID does not exist"
Jul 06 14:12:13.367672 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:13.367655    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-db3d99b3-openshift-default-56755d5dc9-bj6lv"]
Jul 06 14:12:14.761265 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:14.761231    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" path="/var/lib/kubelet/pods/a01be24d-a763-49b1-aad1-e05c03601bd5/volumes"
Jul 06 14:12:25.730921 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.730886    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"]
Jul 06 14:12:25.731371 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731303    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy"
Jul 06 14:12:25.731371 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731315    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy"
Jul 06 14:12:25.731371 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731326    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy"
Jul 06 14:12:25.731371 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731331    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy"
Jul 06 14:12:25.731371 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731340    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5def55-a4a8-4edb-81a4-0c4235edab79" containerName="maas-api"
Jul 06 14:12:25.731371 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731345    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5def55-a4a8-4edb-81a4-0c4235edab79" containerName="maas-api"
Jul 06 14:12:25.731564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731402    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy"
Jul 06 14:12:25.731564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731409    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a01be24d-a763-49b1-aad1-e05c03601bd5" containerName="istio-proxy"
Jul 06 14:12:25.731564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.731417    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a5def55-a4a8-4edb-81a4-0c4235edab79" containerName="maas-api"
Jul 06 14:12:25.734248 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.734230    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.737139 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.737120    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ae0c799d-openshift-default-dockercfg-xcg2x\""
Jul 06 14:12:25.737793 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.737777    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 14:12:25.747685 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.747663    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"]
Jul 06 14:12:25.811337 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-token\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811337 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811338    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f31b2b7-368b-42c7-8aa1-d992336c44be-istiod-ca-cert\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811596 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-socket\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811596 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-envoy\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811596 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811575    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-podinfo\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811596 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-certs\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811829 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811650    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw4r4\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-kube-api-access-kw4r4\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811829 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-data\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.811829 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.811715    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-credential-socket\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912568 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-podinfo\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912568 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-certs\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw4r4\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-kube-api-access-kw4r4\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912635    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-data\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-credential-socket\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-token\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f31b2b7-368b-42c7-8aa1-d992336c44be-istiod-ca-cert\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-socket\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.912824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-envoy\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.913205 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.912988    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-certs\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.913205 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.913065    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-credential-socket\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.913348 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.913262    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-socket\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.913348 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.913306    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-data\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.913486 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.913466    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f31b2b7-368b-42c7-8aa1-d992336c44be-istiod-ca-cert\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.914969 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.914947    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-envoy\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.915185 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.915168    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-podinfo\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.921315 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.921298    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw4r4\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-kube-api-access-kw4r4\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:25.921646 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:25.921626    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-token\") pod \"e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") " pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:26.044750 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.044672    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:26.202504 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.202480    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"]
Jul 06 14:12:26.204204 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:12:26.204167    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f31b2b7_368b_42c7_8aa1_d992336c44be.slice/crio-11caf05c794244daece58a770c76096ce2952cc203ddf4e25d6e37f9158a3a01 WatchSource:0}: Error finding container 11caf05c794244daece58a770c76096ce2952cc203ddf4e25d6e37f9158a3a01: Status 404 returned error can't find the container with id 11caf05c794244daece58a770c76096ce2952cc203ddf4e25d6e37f9158a3a01
Jul 06 14:12:26.206296 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.206258    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:26.206367 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.206345    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:26.206411 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.206372    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:26.418828 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.418795    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" event={"ID":"3f31b2b7-368b-42c7-8aa1-d992336c44be","Type":"ContainerStarted","Data":"42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf"}
Jul 06 14:12:26.419008 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.418854    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" event={"ID":"3f31b2b7-368b-42c7-8aa1-d992336c44be","Type":"ContainerStarted","Data":"11caf05c794244daece58a770c76096ce2952cc203ddf4e25d6e37f9158a3a01"}
Jul 06 14:12:26.440567 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:26.440518    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" podStartSLOduration=1.44050252 podStartE2EDuration="1.44050252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:12:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:12:26.438476684 +0000 UTC m=+1646.198448606" watchObservedRunningTime="2026-07-06 14:12:26.44050252 +0000 UTC m=+1646.200474441"
Jul 06 14:12:27.045837 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:27.045806    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:27.050542 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:27.050513    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:27.423228 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:27.423181    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:27.424341 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:27.424318    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:28.530877 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.530847    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"]
Jul 06 14:12:28.533656 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.533637    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.535686 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.535667    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ae0c799d-serving-cert\""
Jul 06 14:12:28.535843 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.535824    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:12:28.545914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.545894    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"]
Jul 06 14:12:28.637143 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.637105    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.637348 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.637151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcggc\" (UniqueName: \"kubernetes.io/projected/970a373c-1738-498e-8928-3ed654bc3d2f-kube-api-access-bcggc\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.637348 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.637257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/970a373c-1738-498e-8928-3ed654bc3d2f-openshift-service-ca\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.738470 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.738432    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.738470 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.738480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcggc\" (UniqueName: \"kubernetes.io/projected/970a373c-1738-498e-8928-3ed654bc3d2f-kube-api-access-bcggc\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.738747 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.738527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/970a373c-1738-498e-8928-3ed654bc3d2f-openshift-service-ca\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.738747 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:12:28.738603    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-ae0c799d-serving-cert: secret "maas-api-e2e-mt-ae0c799d-serving-cert" not found
Jul 06 14:12:28.738747 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:12:28.738674    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls podName:970a373c-1738-498e-8928-3ed654bc3d2f nodeName:}" failed. No retries permitted until 2026-07-06 14:12:29.238653772 +0000 UTC m=+1648.998625673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls") pod "maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s" (UID: "970a373c-1738-498e-8928-3ed654bc3d2f") : secret "maas-api-e2e-mt-ae0c799d-serving-cert" not found
Jul 06 14:12:28.739283 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.739264    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/970a373c-1738-498e-8928-3ed654bc3d2f-openshift-service-ca\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:28.749254 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:28.749229    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcggc\" (UniqueName: \"kubernetes.io/projected/970a373c-1738-498e-8928-3ed654bc3d2f-kube-api-access-bcggc\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:29.242824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:29.242788    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:29.245186 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:29.245167    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls\") pod \"maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") " pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:29.445071 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:29.445042    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:29.781148 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:29.781077    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"]
Jul 06 14:12:29.784465 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:12:29.784437    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970a373c_1738_498e_8928_3ed654bc3d2f.slice/crio-e34101a1215be554659d66de3422213dbd8ef684a62dcd3f53f57df323e3b185 WatchSource:0}: Error finding container e34101a1215be554659d66de3422213dbd8ef684a62dcd3f53f57df323e3b185: Status 404 returned error can't find the container with id e34101a1215be554659d66de3422213dbd8ef684a62dcd3f53f57df323e3b185
Jul 06 14:12:30.438669 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:30.438639    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s" event={"ID":"970a373c-1738-498e-8928-3ed654bc3d2f","Type":"ContainerStarted","Data":"e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f"}
Jul 06 14:12:30.438808 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:30.438691    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s" event={"ID":"970a373c-1738-498e-8928-3ed654bc3d2f","Type":"ContainerStarted","Data":"e34101a1215be554659d66de3422213dbd8ef684a62dcd3f53f57df323e3b185"}
Jul 06 14:12:30.438808 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:30.438722    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:30.454809 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:30.454768    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s" podStartSLOduration=1.88491305 podStartE2EDuration="2.454752564s" totalImagesPullingTime="569.839514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:12:30.45309772 +0000 UTC m=+1650.213069642" watchObservedRunningTime="2026-07-06 14:12:30.454752564 +0000 UTC m=+1650.214724485"
Jul 06 14:12:36.449294 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:36.449264    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:12:40.676932 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.676895    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"]
Jul 06 14:12:40.680259 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.680241    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.682973 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.682951    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ae0c799d\"/\"default-dockercfg-q2f9t\""
Jul 06 14:12:40.683098 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.682996    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ae0c799d\"/\"kube-root-ca.crt\""
Jul 06 14:12:40.683098 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.683039    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ae0c799d\"/\"e2e-lifecycle-model-ae0c799d-kserve-self-signed-certs\""
Jul 06 14:12:40.683345 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.683329    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ae0c799d\"/\"openshift-service-ca.crt\""
Jul 06 14:12:40.688771 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.688753    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"]
Jul 06 14:12:40.757610 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.757574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0432bb7-021c-4925-9af9-66263be7872e-tls-certs\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.757791 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.757618    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hknfz\" (UniqueName: \"kubernetes.io/projected/f0432bb7-021c-4925-9af9-66263be7872e-kube-api-access-hknfz\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.757791 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.757719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-model-cache\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.757925 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.757818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-tmp-dir\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.757925 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.757853    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-home\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.758052 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.757948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-dshm\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.858579 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.858529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-dshm\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.858903 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.858613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0432bb7-021c-4925-9af9-66263be7872e-tls-certs\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.858903 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.858640    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hknfz\" (UniqueName: \"kubernetes.io/projected/f0432bb7-021c-4925-9af9-66263be7872e-kube-api-access-hknfz\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.858903 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.858736    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-model-cache\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.858903 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.858775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-tmp-dir\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.858903 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.858802    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-home\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.859443 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.859418    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-home\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.859554 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.859439    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-tmp-dir\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.859554 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.859424    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-model-cache\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.861012 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.860988    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-dshm\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.861193 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.861178    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0432bb7-021c-4925-9af9-66263be7872e-tls-certs\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.865763 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.865739    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hknfz\" (UniqueName: \"kubernetes.io/projected/f0432bb7-021c-4925-9af9-66263be7872e-kube-api-access-hknfz\") pod \"e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") " pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:40.993167 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:40.993091    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:41.128515 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:41.128490    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"]
Jul 06 14:12:41.130961 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:12:41.130932    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0432bb7_021c_4925_9af9_66263be7872e.slice/crio-882ef3557ad647a346eb27696a00d5c82b649db0edea734cb9ebcf9314c9fba8 WatchSource:0}: Error finding container 882ef3557ad647a346eb27696a00d5c82b649db0edea734cb9ebcf9314c9fba8: Status 404 returned error can't find the container with id 882ef3557ad647a346eb27696a00d5c82b649db0edea734cb9ebcf9314c9fba8
Jul 06 14:12:41.501241 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:41.501196    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk" event={"ID":"f0432bb7-021c-4925-9af9-66263be7872e","Type":"ContainerStarted","Data":"d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646"}
Jul 06 14:12:41.501400 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:41.501259    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk" event={"ID":"f0432bb7-021c-4925-9af9-66263be7872e","Type":"ContainerStarted","Data":"882ef3557ad647a346eb27696a00d5c82b649db0edea734cb9ebcf9314c9fba8"}
Jul 06 14:12:41.520541 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:41.520496    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk" podStartSLOduration=1.520481529 podStartE2EDuration="1.520481529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:12:41.518381106 +0000 UTC m=+1661.278353029" watchObservedRunningTime="2026-07-06 14:12:41.520481529 +0000 UTC m=+1661.280453451"
Jul 06 14:12:42.424440 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.424406    2572 patch_prober.go:28] interesting pod/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 06 14:12:42.424873 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.424465    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 06 14:12:42.507123 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.507094    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerID="42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf" exitCode=0
Jul 06 14:12:42.507314 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.507171    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" event={"ID":"3f31b2b7-368b-42c7-8aa1-d992336c44be","Type":"ContainerDied","Data":"42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf"}
Jul 06 14:12:42.507574 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.507559    2572 scope.go:117] "RemoveContainer" containerID="42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf"
Jul 06 14:12:42.508502 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.508477    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:42.508598 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.508541    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:42.508598 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:42.508577    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:12:43.514265 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:43.514230    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" event={"ID":"3f31b2b7-368b-42c7-8aa1-d992336c44be","Type":"ContainerStarted","Data":"81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5"}
Jul 06 14:12:44.045303 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:44.045265    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:44.045490 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:44.045464    2572 patch_prober.go:28] interesting pod/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 06 14:12:44.045537 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:44.045522    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 06 14:12:45.045463 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:45.045427    2572 patch_prober.go:28] interesting pod/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 06 14:12:45.045851 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:45.045479    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 06 14:12:46.045556 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:46.045520    2572 patch_prober.go:28] interesting pod/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 06 14:12:46.046006 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:46.045574    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 06 14:12:47.045506 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:47.045471    2572 patch_prober.go:28] interesting pod/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 06 14:12:47.045688 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:47.045531    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 06 14:12:48.048730 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:48.048702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:48.049154 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:48.049037    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:48.049759 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:48.049740    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:12:50.993834 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:50.993802    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:50.994219 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:50.993850    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:51.006783 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:51.006755    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:12:51.563025 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:12:51.562991    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:13:05.944606 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:05.944567    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"]
Jul 06 14:13:05.945184 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:05.944809    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s" podUID="970a373c-1738-498e-8928-3ed654bc3d2f" containerName="maas-api" containerID="cri-o://e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f" gracePeriod=30
Jul 06 14:13:06.199988 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.199929    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:13:06.294576 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.294547    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcggc\" (UniqueName: \"kubernetes.io/projected/970a373c-1738-498e-8928-3ed654bc3d2f-kube-api-access-bcggc\") pod \"970a373c-1738-498e-8928-3ed654bc3d2f\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") "
Jul 06 14:13:06.294576 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.294580    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/970a373c-1738-498e-8928-3ed654bc3d2f-openshift-service-ca\") pod \"970a373c-1738-498e-8928-3ed654bc3d2f\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") "
Jul 06 14:13:06.294843 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.294628    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls\") pod \"970a373c-1738-498e-8928-3ed654bc3d2f\" (UID: \"970a373c-1738-498e-8928-3ed654bc3d2f\") "
Jul 06 14:13:06.294976 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.294951    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970a373c-1738-498e-8928-3ed654bc3d2f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "970a373c-1738-498e-8928-3ed654bc3d2f" (UID: "970a373c-1738-498e-8928-3ed654bc3d2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:13:06.296704 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.296684    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/970a373c-1738-498e-8928-3ed654bc3d2f-kube-api-access-bcggc" (OuterVolumeSpecName: "kube-api-access-bcggc") pod "970a373c-1738-498e-8928-3ed654bc3d2f" (UID: "970a373c-1738-498e-8928-3ed654bc3d2f"). InnerVolumeSpecName "kube-api-access-bcggc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:13:06.296759 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.296700    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "970a373c-1738-498e-8928-3ed654bc3d2f" (UID: "970a373c-1738-498e-8928-3ed654bc3d2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:13:06.395908 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.395883    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcggc\" (UniqueName: \"kubernetes.io/projected/970a373c-1738-498e-8928-3ed654bc3d2f-kube-api-access-bcggc\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:06.395908 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.395905    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/970a373c-1738-498e-8928-3ed654bc3d2f-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:06.396068 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.395915    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/970a373c-1738-498e-8928-3ed654bc3d2f-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:06.623758 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.623728    2572 generic.go:356] "Generic (PLEG): container finished" podID="970a373c-1738-498e-8928-3ed654bc3d2f" containerID="e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f" exitCode=0
Jul 06 14:13:06.623920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.623775    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"
Jul 06 14:13:06.623920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.623808    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s" event={"ID":"970a373c-1738-498e-8928-3ed654bc3d2f","Type":"ContainerDied","Data":"e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f"}
Jul 06 14:13:06.623920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.623859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s" event={"ID":"970a373c-1738-498e-8928-3ed654bc3d2f","Type":"ContainerDied","Data":"e34101a1215be554659d66de3422213dbd8ef684a62dcd3f53f57df323e3b185"}
Jul 06 14:13:06.623920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.623882    2572 scope.go:117] "RemoveContainer" containerID="e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f"
Jul 06 14:13:06.633000 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.632984    2572 scope.go:117] "RemoveContainer" containerID="e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f"
Jul 06 14:13:06.633268 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:13:06.633250    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f\": container with ID starting with e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f not found: ID does not exist" containerID="e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f"
Jul 06 14:13:06.633320 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.633278    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f"} err="failed to get container status \"e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f\": rpc error: code = NotFound desc = could not find container \"e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f\": container with ID starting with e4788817d7ba567e0b18d03fe7523e5ec0d9f9b281b9d95bd1fe53b53eeaf23f not found: ID does not exist"
Jul 06 14:13:06.642857 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.642833    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"]
Jul 06 14:13:06.646510 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.646483    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae0c799d-7fbcc4cc85-dmc5s"]
Jul 06 14:13:06.767610 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:06.767577    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="970a373c-1738-498e-8928-3ed654bc3d2f" path="/var/lib/kubelet/pods/970a373c-1738-498e-8928-3ed654bc3d2f/volumes"
Jul 06 14:13:16.389778 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:16.389745    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"]
Jul 06 14:13:31.410916 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.410810    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk" podUID="f0432bb7-021c-4925-9af9-66263be7872e" containerName="main" containerID="cri-o://d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646" gracePeriod=45
Jul 06 14:13:31.552519 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.552474    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk" podUID="f0432bb7-021c-4925-9af9-66263be7872e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": dial tcp 10.133.0.44:8000: connect: connection refused"
Jul 06 14:13:31.661673 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.661610    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:13:31.751664 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.751634    2572 generic.go:356] "Generic (PLEG): container finished" podID="f0432bb7-021c-4925-9af9-66263be7872e" containerID="d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646" exitCode=0
Jul 06 14:13:31.751824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.751675    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"
Jul 06 14:13:31.751824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.751721    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk" event={"ID":"f0432bb7-021c-4925-9af9-66263be7872e","Type":"ContainerDied","Data":"d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646"}
Jul 06 14:13:31.751824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.751763    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk" event={"ID":"f0432bb7-021c-4925-9af9-66263be7872e","Type":"ContainerDied","Data":"882ef3557ad647a346eb27696a00d5c82b649db0edea734cb9ebcf9314c9fba8"}
Jul 06 14:13:31.751824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.751779    2572 scope.go:117] "RemoveContainer" containerID="d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646"
Jul 06 14:13:31.759847 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.759833    2572 scope.go:117] "RemoveContainer" containerID="d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646"
Jul 06 14:13:31.760074 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:13:31.760057    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646\": container with ID starting with d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646 not found: ID does not exist" containerID="d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646"
Jul 06 14:13:31.760123 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.760082    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646"} err="failed to get container status \"d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646\": rpc error: code = NotFound desc = could not find container \"d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646\": container with ID starting with d50948582ec2f01a80afd747c37e46bdbce8197a187c845659c81b94f7760646 not found: ID does not exist"
Jul 06 14:13:31.833905 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.833883    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-tmp-dir\") pod \"f0432bb7-021c-4925-9af9-66263be7872e\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") "
Jul 06 14:13:31.834005 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.833929    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-home\") pod \"f0432bb7-021c-4925-9af9-66263be7872e\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") "
Jul 06 14:13:31.834005 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.833983    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-model-cache\") pod \"f0432bb7-021c-4925-9af9-66263be7872e\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") "
Jul 06 14:13:31.834096 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834037    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hknfz\" (UniqueName: \"kubernetes.io/projected/f0432bb7-021c-4925-9af9-66263be7872e-kube-api-access-hknfz\") pod \"f0432bb7-021c-4925-9af9-66263be7872e\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") "
Jul 06 14:13:31.834096 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834061    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-dshm\") pod \"f0432bb7-021c-4925-9af9-66263be7872e\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") "
Jul 06 14:13:31.834199 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834120    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0432bb7-021c-4925-9af9-66263be7872e-tls-certs\") pod \"f0432bb7-021c-4925-9af9-66263be7872e\" (UID: \"f0432bb7-021c-4925-9af9-66263be7872e\") "
Jul 06 14:13:31.834199 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834148    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0432bb7-021c-4925-9af9-66263be7872e" (UID: "f0432bb7-021c-4925-9af9-66263be7872e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:13:31.834345 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834186    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-home" (OuterVolumeSpecName: "home") pod "f0432bb7-021c-4925-9af9-66263be7872e" (UID: "f0432bb7-021c-4925-9af9-66263be7872e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:13:31.834404 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834344    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0432bb7-021c-4925-9af9-66263be7872e" (UID: "f0432bb7-021c-4925-9af9-66263be7872e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:13:31.834460 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834402    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-tmp-dir\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:31.834460 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.834419    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-home\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:31.836301 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.836278    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0432bb7-021c-4925-9af9-66263be7872e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0432bb7-021c-4925-9af9-66263be7872e" (UID: "f0432bb7-021c-4925-9af9-66263be7872e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:13:31.836396 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.836339    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-dshm" (OuterVolumeSpecName: "dshm") pod "f0432bb7-021c-4925-9af9-66263be7872e" (UID: "f0432bb7-021c-4925-9af9-66263be7872e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:13:31.836396 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.836349    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0432bb7-021c-4925-9af9-66263be7872e-kube-api-access-hknfz" (OuterVolumeSpecName: "kube-api-access-hknfz") pod "f0432bb7-021c-4925-9af9-66263be7872e" (UID: "f0432bb7-021c-4925-9af9-66263be7872e"). InnerVolumeSpecName "kube-api-access-hknfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:13:31.934987 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.934924    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-model-cache\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:31.934987 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.934947    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hknfz\" (UniqueName: \"kubernetes.io/projected/f0432bb7-021c-4925-9af9-66263be7872e-kube-api-access-hknfz\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:31.934987 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.934956    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0432bb7-021c-4925-9af9-66263be7872e-dshm\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:31.934987 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:31.934966    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0432bb7-021c-4925-9af9-66263be7872e-tls-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:13:32.074258 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:32.074234    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"]
Jul 06 14:13:32.078169 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:32.078150    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ae0c799d/e2e-lifecycle-model-ae0c799d-kserve-548d556bf5-df4hk"]
Jul 06 14:13:32.760809 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:13:32.760776    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0432bb7-021c-4925-9af9-66263be7872e" path="/var/lib/kubelet/pods/f0432bb7-021c-4925-9af9-66263be7872e/volumes"
Jul 06 14:14:05.187954 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:05.187923    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"]
Jul 06 14:14:05.188426 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:05.188131    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy" containerID="cri-o://81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5" gracePeriod=30
Jul 06 14:14:10.439642 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.439617    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:14:10.585605 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585510    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw4r4\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-kube-api-access-kw4r4\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.585605 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585553    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-socket\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.585605 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585572    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-envoy\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.585605 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585593    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-certs\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.586011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585614    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-credential-socket\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.586011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585637    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f31b2b7-368b-42c7-8aa1-d992336c44be-istiod-ca-cert\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.586011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585669    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-token\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.586011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585688    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-podinfo\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.586011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585707    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-data\") pod \"3f31b2b7-368b-42c7-8aa1-d992336c44be\" (UID: \"3f31b2b7-368b-42c7-8aa1-d992336c44be\") "
Jul 06 14:14:10.586011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585905    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:10.586011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.585957    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:10.586330 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.586259    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f31b2b7-368b-42c7-8aa1-d992336c44be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:14:10.586330 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.586046    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:10.586790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.586772    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:10.587984 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.587959    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:14:10.588092 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.587983    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:14:10.588266 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.588243    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:14:10.588399 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.588265    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-kube-api-access-kw4r4" (OuterVolumeSpecName: "kube-api-access-kw4r4") pod "3f31b2b7-368b-42c7-8aa1-d992336c44be" (UID: "3f31b2b7-368b-42c7-8aa1-d992336c44be"). InnerVolumeSpecName "kube-api-access-kw4r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:14:10.686728 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686692    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw4r4\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-kube-api-access-kw4r4\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686728 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686724    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686728 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686733    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686985 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686752    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686985 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686761    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686985 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686769    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f31b2b7-368b-42c7-8aa1-d992336c44be-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686985 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686778    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686985 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686787    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.686985 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.686794    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f31b2b7-368b-42c7-8aa1-d992336c44be-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:14:10.944938 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.944904    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerID="81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5" exitCode=0
Jul 06 14:14:10.945109 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.944950    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"
Jul 06 14:14:10.945109 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.944984    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" event={"ID":"3f31b2b7-368b-42c7-8aa1-d992336c44be","Type":"ContainerDied","Data":"81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5"}
Jul 06 14:14:10.945109 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.945036    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm" event={"ID":"3f31b2b7-368b-42c7-8aa1-d992336c44be","Type":"ContainerDied","Data":"11caf05c794244daece58a770c76096ce2952cc203ddf4e25d6e37f9158a3a01"}
Jul 06 14:14:10.945109 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.945059    2572 scope.go:117] "RemoveContainer" containerID="81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5"
Jul 06 14:14:10.953233 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.953220    2572 scope.go:117] "RemoveContainer" containerID="42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf"
Jul 06 14:14:10.960785 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.960770    2572 scope.go:117] "RemoveContainer" containerID="81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5"
Jul 06 14:14:10.961037 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:14:10.961021    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5\": container with ID starting with 81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5 not found: ID does not exist" containerID="81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5"
Jul 06 14:14:10.961083 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.961045    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5"} err="failed to get container status \"81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5\": rpc error: code = NotFound desc = could not find container \"81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5\": container with ID starting with 81772e5c705710fe497b7d6fafc33d5a91a3f8cbe4790c7d116aaa0eb19100d5 not found: ID does not exist"
Jul 06 14:14:10.961083 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.961059    2572 scope.go:117] "RemoveContainer" containerID="42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf"
Jul 06 14:14:10.961324 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:14:10.961298    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf\": container with ID starting with 42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf not found: ID does not exist" containerID="42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf"
Jul 06 14:14:10.961383 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.961335    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf"} err="failed to get container status \"42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf\": rpc error: code = NotFound desc = could not find container \"42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf\": container with ID starting with 42f970b4cf26ddeea635cdd19b8e9573c0ffe3057e46d0648431e2606af6fcbf not found: ID does not exist"
Jul 06 14:14:10.964144 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.964118    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"]
Jul 06 14:14:10.976186 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:10.970784    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ae0c799d-openshift-default-869dc7774c-shqlm"]
Jul 06 14:14:12.761321 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:14:12.761288    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" path="/var/lib/kubelet/pods/3f31b2b7-368b-42c7-8aa1-d992336c44be/volumes"
Jul 06 14:15:00.030433 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030398    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"]
Jul 06 14:15:00.030877 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030774    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy"
Jul 06 14:15:00.030877 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030786    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy"
Jul 06 14:15:00.030877 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030798    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0432bb7-021c-4925-9af9-66263be7872e" containerName="main"
Jul 06 14:15:00.030877 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030804    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0432bb7-021c-4925-9af9-66263be7872e" containerName="main"
Jul 06 14:15:00.030877 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030815    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="970a373c-1738-498e-8928-3ed654bc3d2f" containerName="maas-api"
Jul 06 14:15:00.030877 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030820    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="970a373c-1738-498e-8928-3ed654bc3d2f" containerName="maas-api"
Jul 06 14:15:00.031075 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030888    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy"
Jul 06 14:15:00.031075 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030896    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0432bb7-021c-4925-9af9-66263be7872e" containerName="main"
Jul 06 14:15:00.031075 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030903    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy"
Jul 06 14:15:00.031075 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.030909    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="970a373c-1738-498e-8928-3ed654bc3d2f" containerName="maas-api"
Jul 06 14:15:00.032899 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.032882    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.035605 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.035584    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 14:15:00.035793 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.035771    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2beb98-openshift-default-dockercfg-lpsjk\""
Jul 06 14:15:00.046137 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.046110    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"]
Jul 06 14:15:00.133421 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-socket\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133421 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133420    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-data\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133691 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-token\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133691 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvpcx\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-kube-api-access-hvpcx\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133691 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d10a33-2a32-4de0-9ab8-f865322606d8-istiod-ca-cert\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133691 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-credential-socket\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133691 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-podinfo\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133890 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133730    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-certs\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.133890 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.133777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-envoy\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.137841 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.137814    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722455-vv9c5"]
Jul 06 14:15:00.138266 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.138250    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy"
Jul 06 14:15:00.138360 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.138268    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f31b2b7-368b-42c7-8aa1-d992336c44be" containerName="istio-proxy"
Jul 06 14:15:00.140550 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.140532    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5"
Jul 06 14:15:00.142577 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.142558    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:15:00.149027 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.149007    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722455-vv9c5"]
Jul 06 14:15:00.234918 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.234888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-socket\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.234918 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.234921    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-data\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235143 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.234956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-token\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235143 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235006    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpcx\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-kube-api-access-hvpcx\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235143 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d10a33-2a32-4de0-9ab8-f865322606d8-istiod-ca-cert\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235143 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-credential-socket\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235143 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-podinfo\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235379 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235349    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm2pn\" (UniqueName: \"kubernetes.io/projected/e6df76a0-4c07-4f8c-8d25-ab5f87ec8463-kube-api-access-rm2pn\") pod \"maas-api-key-cleanup-29722455-vv9c5\" (UID: \"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463\") " pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5"
Jul 06 14:15:00.235441 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-certs\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235441 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235427    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-socket\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235560 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235436    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-data\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235560 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235518    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-envoy\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235560 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235535    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-credential-socket\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235714 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235694    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-certs\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.235835 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.235816    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d10a33-2a32-4de0-9ab8-f865322606d8-istiod-ca-cert\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.237552 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.237533    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-envoy\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.237628 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.237613    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-podinfo\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.242816 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.242791    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-token\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.243810 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.243792    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpcx\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-kube-api-access-hvpcx\") pod \"e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") " pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.336888 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.336800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2pn\" (UniqueName: \"kubernetes.io/projected/e6df76a0-4c07-4f8c-8d25-ab5f87ec8463-kube-api-access-rm2pn\") pod \"maas-api-key-cleanup-29722455-vv9c5\" (UID: \"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463\") " pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5"
Jul 06 14:15:00.343063 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.343035    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:00.345722 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.345374    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm2pn\" (UniqueName: \"kubernetes.io/projected/e6df76a0-4c07-4f8c-8d25-ab5f87ec8463-kube-api-access-rm2pn\") pod \"maas-api-key-cleanup-29722455-vv9c5\" (UID: \"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463\") " pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5"
Jul 06 14:15:00.452445 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.452411    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5"
Jul 06 14:15:00.481996 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.481845    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"]
Jul 06 14:15:00.484713 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:15:00.484686    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d10a33_2a32_4de0_9ab8_f865322606d8.slice/crio-d3e8cc82dfee95c899c1079a8730482a4b35fcaa772e26ce1eccfabec3a654bd WatchSource:0}: Error finding container d3e8cc82dfee95c899c1079a8730482a4b35fcaa772e26ce1eccfabec3a654bd: Status 404 returned error can't find the container with id d3e8cc82dfee95c899c1079a8730482a4b35fcaa772e26ce1eccfabec3a654bd
Jul 06 14:15:00.486961 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.486929    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:00.487038 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.487002    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:00.487038 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.487031    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:00.596952 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.596926    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722455-vv9c5"]
Jul 06 14:15:00.598977 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:15:00.598946    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6df76a0_4c07_4f8c_8d25_ab5f87ec8463.slice/crio-869c82adad331598bc8fedbd4dc319766094ae83353365afcb96097663aaed61 WatchSource:0}: Error finding container 869c82adad331598bc8fedbd4dc319766094ae83353365afcb96097663aaed61: Status 404 returned error can't find the container with id 869c82adad331598bc8fedbd4dc319766094ae83353365afcb96097663aaed61
Jul 06 14:15:00.601096 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:00.601075    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:15:01.174435 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:01.174332    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5" event={"ID":"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463","Type":"ContainerStarted","Data":"869c82adad331598bc8fedbd4dc319766094ae83353365afcb96097663aaed61"}
Jul 06 14:15:01.175775 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:01.175751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" event={"ID":"d4d10a33-2a32-4de0-9ab8-f865322606d8","Type":"ContainerStarted","Data":"1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab"}
Jul 06 14:15:01.175900 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:01.175796    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" event={"ID":"d4d10a33-2a32-4de0-9ab8-f865322606d8","Type":"ContainerStarted","Data":"d3e8cc82dfee95c899c1079a8730482a4b35fcaa772e26ce1eccfabec3a654bd"}
Jul 06 14:15:01.198123 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:01.198071    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podStartSLOduration=1.198056138 podStartE2EDuration="1.198056138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:01.196859535 +0000 UTC m=+1800.956831484" watchObservedRunningTime="2026-07-06 14:15:01.198056138 +0000 UTC m=+1800.958028060"
Jul 06 14:15:01.343956 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:01.343916    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:01.348869 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:01.348842    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:02.181192 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:02.181153    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:02.182253 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:02.182228    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:03.367808 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.367769    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"]
Jul 06 14:15:03.370511 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.370489    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.372547 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.372523    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-2beb98-serving-cert\""
Jul 06 14:15:03.380376 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.380345    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"]
Jul 06 14:15:03.469588 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.469560    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f4c878-3429-409c-b882-b93cfc340e91-maas-api-tls\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.469751 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.469608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f4c878-3429-409c-b882-b93cfc340e91-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.469751 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.469637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrw9\" (UniqueName: \"kubernetes.io/projected/33f4c878-3429-409c-b882-b93cfc340e91-kube-api-access-tbrw9\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.570573 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.570543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f4c878-3429-409c-b882-b93cfc340e91-maas-api-tls\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.570768 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.570601    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f4c878-3429-409c-b882-b93cfc340e91-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.570768 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.570621    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrw9\" (UniqueName: \"kubernetes.io/projected/33f4c878-3429-409c-b882-b93cfc340e91-kube-api-access-tbrw9\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.571303 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.571279    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f4c878-3429-409c-b882-b93cfc340e91-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.573004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.572982    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f4c878-3429-409c-b882-b93cfc340e91-maas-api-tls\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.579851 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.579830    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrw9\" (UniqueName: \"kubernetes.io/projected/33f4c878-3429-409c-b882-b93cfc340e91-kube-api-access-tbrw9\") pod \"maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") " pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.682348 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.682306    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:03.825536 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:03.825451    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"]
Jul 06 14:15:03.828542 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:15:03.828515    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f4c878_3429_409c_b882_b93cfc340e91.slice/crio-3d178bdb22e848f2ab0d3c7028ed631c4a294a5559f28f09f83fe50aa52d9d74 WatchSource:0}: Error finding container 3d178bdb22e848f2ab0d3c7028ed631c4a294a5559f28f09f83fe50aa52d9d74: Status 404 returned error can't find the container with id 3d178bdb22e848f2ab0d3c7028ed631c4a294a5559f28f09f83fe50aa52d9d74
Jul 06 14:15:04.192948 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:04.192915    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5" event={"ID":"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463","Type":"ContainerStarted","Data":"ba410ebb58d54ec165c4b90a1cba755520f55bc82cda85d048e35f633821abc0"}
Jul 06 14:15:04.193931 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:04.193909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb" event={"ID":"33f4c878-3429-409c-b882-b93cfc340e91","Type":"ContainerStarted","Data":"3d178bdb22e848f2ab0d3c7028ed631c4a294a5559f28f09f83fe50aa52d9d74"}
Jul 06 14:15:04.210574 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:04.210533    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5" podStartSLOduration=1.500841606 podStartE2EDuration="4.210518059s" totalImagesPullingTime="2.709676453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:04.208698888 +0000 UTC m=+1803.968670810" watchObservedRunningTime="2026-07-06 14:15:04.210518059 +0000 UTC m=+1803.970489981"
Jul 06 14:15:05.199834 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:05.199802    2572 generic.go:356] "Generic (PLEG): container finished" podID="e6df76a0-4c07-4f8c-8d25-ab5f87ec8463" containerID="ba410ebb58d54ec165c4b90a1cba755520f55bc82cda85d048e35f633821abc0" exitCode=0
Jul 06 14:15:05.200257 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:05.199875    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5" event={"ID":"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463","Type":"ContainerDied","Data":"ba410ebb58d54ec165c4b90a1cba755520f55bc82cda85d048e35f633821abc0"}
Jul 06 14:15:05.201373 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:05.201351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb" event={"ID":"33f4c878-3429-409c-b882-b93cfc340e91","Type":"ContainerStarted","Data":"b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209"}
Jul 06 14:15:05.201491 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:05.201477    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:05.232634 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:05.232593    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb" podStartSLOduration=1.070135346 podStartE2EDuration="2.232580536s" totalImagesPullingTime="1.16244519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:05.230911468 +0000 UTC m=+1804.990883394" watchObservedRunningTime="2026-07-06 14:15:05.232580536 +0000 UTC m=+1804.992552457"
Jul 06 14:15:06.346001 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:06.345978    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5"
Jul 06 14:15:06.397106 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:06.397078    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm2pn\" (UniqueName: \"kubernetes.io/projected/e6df76a0-4c07-4f8c-8d25-ab5f87ec8463-kube-api-access-rm2pn\") pod \"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463\" (UID: \"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463\") "
Jul 06 14:15:06.399126 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:06.399096    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6df76a0-4c07-4f8c-8d25-ab5f87ec8463-kube-api-access-rm2pn" (OuterVolumeSpecName: "kube-api-access-rm2pn") pod "e6df76a0-4c07-4f8c-8d25-ab5f87ec8463" (UID: "e6df76a0-4c07-4f8c-8d25-ab5f87ec8463"). InnerVolumeSpecName "kube-api-access-rm2pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:15:06.497919 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:06.497824    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm2pn\" (UniqueName: \"kubernetes.io/projected/e6df76a0-4c07-4f8c-8d25-ab5f87ec8463-kube-api-access-rm2pn\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:15:07.213554 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:07.213525    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5"
Jul 06 14:15:07.213745 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:07.213557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722455-vv9c5" event={"ID":"e6df76a0-4c07-4f8c-8d25-ab5f87ec8463","Type":"ContainerDied","Data":"869c82adad331598bc8fedbd4dc319766094ae83353365afcb96097663aaed61"}
Jul 06 14:15:07.213745 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:07.213600    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="869c82adad331598bc8fedbd4dc319766094ae83353365afcb96097663aaed61"
Jul 06 14:15:08.334367 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.334340    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"]
Jul 06 14:15:08.334742 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.334720    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6df76a0-4c07-4f8c-8d25-ab5f87ec8463" containerName="cleanup"
Jul 06 14:15:08.334789 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.334746    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6df76a0-4c07-4f8c-8d25-ab5f87ec8463" containerName="cleanup"
Jul 06 14:15:08.334842 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.334832    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6df76a0-4c07-4f8c-8d25-ab5f87ec8463" containerName="cleanup"
Jul 06 14:15:08.337469 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.337450    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.339574 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.339552    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-53d7c5-openshift-default-dockercfg-wc5pk\""
Jul 06 14:15:08.347900 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.347878    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"]
Jul 06 14:15:08.414896 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.414873    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-data\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415025 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.414931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-token\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415025 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.415000    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-credential-socket\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415116 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.415037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istiod-ca-cert\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415116 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.415060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-certs\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415116 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.415077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-podinfo\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415116 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.415103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lq95\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-kube-api-access-7lq95\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415280 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.415159    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-envoy\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.415280 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.415179    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-socket\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516296 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516266    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-token\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516460 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-credential-socket\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516460 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istiod-ca-cert\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516460 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-certs\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516460 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516408    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-podinfo\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516669 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516541    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lq95\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-kube-api-access-7lq95\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516669 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516604    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-envoy\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516669 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-socket\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-data\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516782    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-credential-socket\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.516827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.516805    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-certs\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.517025 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.517002    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-socket\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.517077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.517015    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-data\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.517453 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.517437    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istiod-ca-cert\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.518718 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.518699    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-envoy\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.518936 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.518919    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-podinfo\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.523600 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.523579    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-token\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.523809 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.523791    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lq95\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-kube-api-access-7lq95\") pod \"e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") " pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.648581 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.648556    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:08.783337 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.783298    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"]
Jul 06 14:15:08.786746 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:15:08.786713    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c8e0c0_c00e_42ba_aa2a_b9f501d33221.slice/crio-a8d2d6fe381bcd9cbb31b3a4923b2b005b3a3b65e1267223addf005e4631953e WatchSource:0}: Error finding container a8d2d6fe381bcd9cbb31b3a4923b2b005b3a3b65e1267223addf005e4631953e: Status 404 returned error can't find the container with id a8d2d6fe381bcd9cbb31b3a4923b2b005b3a3b65e1267223addf005e4631953e
Jul 06 14:15:08.789259 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.789226    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:08.789362 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.789305    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:08.789362 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:08.789351    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:09.223604 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:09.223562    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" event={"ID":"50c8e0c0-c00e-42ba-aa2a-b9f501d33221","Type":"ContainerStarted","Data":"aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62"}
Jul 06 14:15:09.223794 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:09.223621    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" event={"ID":"50c8e0c0-c00e-42ba-aa2a-b9f501d33221","Type":"ContainerStarted","Data":"a8d2d6fe381bcd9cbb31b3a4923b2b005b3a3b65e1267223addf005e4631953e"}
Jul 06 14:15:09.244155 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:09.244114    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podStartSLOduration=1.244095868 podStartE2EDuration="1.244095868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:09.242625437 +0000 UTC m=+1809.002597352" watchObservedRunningTime="2026-07-06 14:15:09.244095868 +0000 UTC m=+1809.004067790"
Jul 06 14:15:09.648992 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:09.648962    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:09.653852 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:09.653826    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:10.228903 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:10.228870    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:10.229725 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:10.229708    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:11.213001 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.212972    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:15:11.316061 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.316029    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"]
Jul 06 14:15:11.330408 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.330380    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"]
Jul 06 14:15:11.330563 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.330504    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.332717 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.332698    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-53d7c5-serving-cert\""
Jul 06 14:15:11.445077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.445041    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trl7n\" (UniqueName: \"kubernetes.io/projected/d7e59e61-00e3-4858-919c-655484a1d2be-kube-api-access-trl7n\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.445274 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.445230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e59e61-00e3-4858-919c-655484a1d2be-openshift-service-ca\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.445274 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.445261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.546185 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.546101    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e59e61-00e3-4858-919c-655484a1d2be-openshift-service-ca\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.546185 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.546142    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.546416 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.546228    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trl7n\" (UniqueName: \"kubernetes.io/projected/d7e59e61-00e3-4858-919c-655484a1d2be-kube-api-access-trl7n\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.546416 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:15:11.546319    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-53d7c5-serving-cert: secret "maas-api-e2e-inf-b-53d7c5-serving-cert" not found
Jul 06 14:15:11.546416 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:15:11.546380    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls podName:d7e59e61-00e3-4858-919c-655484a1d2be nodeName:}" failed. No retries permitted until 2026-07-06 14:15:12.046363432 +0000 UTC m=+1811.806335336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls") pod "maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h" (UID: "d7e59e61-00e3-4858-919c-655484a1d2be") : secret "maas-api-e2e-inf-b-53d7c5-serving-cert" not found
Jul 06 14:15:11.546856 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.546839    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e59e61-00e3-4858-919c-655484a1d2be-openshift-service-ca\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:11.554419 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:11.554395    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trl7n\" (UniqueName: \"kubernetes.io/projected/d7e59e61-00e3-4858-919c-655484a1d2be-kube-api-access-trl7n\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:12.050563 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:12.050528    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:12.052907 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:12.052889    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls\") pod \"maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") " pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:12.244145 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:12.244111    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:12.425387 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:12.425363    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"]
Jul 06 14:15:12.427363 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:15:12.427338    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e59e61_00e3_4858_919c_655484a1d2be.slice/crio-585cc014896fbac88ab3cdcd4153cc425ad5e06eee27cc578444861a1f691924 WatchSource:0}: Error finding container 585cc014896fbac88ab3cdcd4153cc425ad5e06eee27cc578444861a1f691924: Status 404 returned error can't find the container with id 585cc014896fbac88ab3cdcd4153cc425ad5e06eee27cc578444861a1f691924
Jul 06 14:15:13.243786 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:13.243748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h" event={"ID":"d7e59e61-00e3-4858-919c-655484a1d2be","Type":"ContainerStarted","Data":"585cc014896fbac88ab3cdcd4153cc425ad5e06eee27cc578444861a1f691924"}
Jul 06 14:15:15.254688 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:15.254654    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h" event={"ID":"d7e59e61-00e3-4858-919c-655484a1d2be","Type":"ContainerStarted","Data":"d7f0a7883500d766485013660eef9bb4ef0935318f4f6cd7bba378e6cfcaf589"}
Jul 06 14:15:15.255105 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:15.254778    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:18.224396 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:18.224342    2572 patch_prober.go:28] interesting pod/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 14:15:18.224920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:18.224405    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 14:15:19.282431 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:19.282393    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerID="1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab" exitCode=0
Jul 06 14:15:19.283023 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:19.282473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" event={"ID":"d4d10a33-2a32-4de0-9ab8-f865322606d8","Type":"ContainerDied","Data":"1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab"}
Jul 06 14:15:19.283676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:19.283657    2572 scope.go:117] "RemoveContainer" containerID="1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab"
Jul 06 14:15:19.285102 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:19.285063    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:19.285224 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:19.285158    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:19.285304 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:19.285220    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:19.313824 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:19.313777    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h" podStartSLOduration=6.401980997 podStartE2EDuration="8.313761141s" totalImagesPullingTime="1.911780144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:15.275675406 +0000 UTC m=+1815.035647348" watchObservedRunningTime="2026-07-06 14:15:19.313761141 +0000 UTC m=+1819.073733071"
Jul 06 14:15:20.292829 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:20.292789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" event={"ID":"d4d10a33-2a32-4de0-9ab8-f865322606d8","Type":"ContainerStarted","Data":"b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6"}
Jul 06 14:15:20.344111 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:20.344084    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:20.344384 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:20.344362    2572 patch_prober.go:28] interesting pod/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 14:15:20.344461 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:20.344409    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 14:15:21.277521 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:21.277481    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:15:21.343468 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:21.343432    2572 patch_prober.go:28] interesting pod/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 14:15:21.343935 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:21.343504    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 14:15:22.344198 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:22.344162    2572 patch_prober.go:28] interesting pod/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 14:15:22.344586 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:22.344231    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 14:15:23.344318 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:23.344277    2572 patch_prober.go:28] interesting pod/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 14:15:23.344684 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:23.344340    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 14:15:24.347407 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:24.347374    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:24.347892 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:24.347872    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:24.348708 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:24.348693    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:15:25.229862 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.229823    2572 patch_prober.go:28] interesting pod/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 14:15:25.230068 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.229874    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 14:15:25.323043 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.323012    2572 generic.go:356] "Generic (PLEG): container finished" podID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerID="aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62" exitCode=0
Jul 06 14:15:25.323250 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.323086    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" event={"ID":"50c8e0c0-c00e-42ba-aa2a-b9f501d33221","Type":"ContainerDied","Data":"aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62"}
Jul 06 14:15:25.323592 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.323578    2572 scope.go:117] "RemoveContainer" containerID="aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62"
Jul 06 14:15:25.324503 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.324480    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:25.324570 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.324558    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:25.324617 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:25.324598    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:15:26.330227 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:26.330171    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" event={"ID":"50c8e0c0-c00e-42ba-aa2a-b9f501d33221","Type":"ContainerStarted","Data":"18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38"}
Jul 06 14:15:26.649700 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:26.649663    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:26.649885 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:26.649851    2572 patch_prober.go:28] interesting pod/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 14:15:26.649931 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:26.649904    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 14:15:27.649074 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:27.649040    2572 patch_prober.go:28] interesting pod/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 14:15:27.649497 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:27.649091    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 14:15:28.649442 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:28.649392    2572 patch_prober.go:28] interesting pod/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 14:15:28.649903 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:28.649452    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 14:15:29.649557 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:29.649514    2572 patch_prober.go:28] interesting pod/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 06 14:15:29.649964 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:29.649571    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 06 14:15:30.653151 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:30.653120    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:30.653651 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:30.653477    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:15:30.654190 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:15:30.654171    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:16:26.555414 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:26.555326    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"]
Jul 06 14:16:26.556000 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:26.555578    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb" podUID="33f4c878-3429-409c-b882-b93cfc340e91" containerName="maas-api" containerID="cri-o://b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209" gracePeriod=30
Jul 06 14:16:27.016432 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.016404    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:16:27.083294 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.083189    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f4c878-3429-409c-b882-b93cfc340e91-maas-api-tls\") pod \"33f4c878-3429-409c-b882-b93cfc340e91\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") "
Jul 06 14:16:27.083294 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.083248    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f4c878-3429-409c-b882-b93cfc340e91-openshift-service-ca\") pod \"33f4c878-3429-409c-b882-b93cfc340e91\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") "
Jul 06 14:16:27.083294 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.083295    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbrw9\" (UniqueName: \"kubernetes.io/projected/33f4c878-3429-409c-b882-b93cfc340e91-kube-api-access-tbrw9\") pod \"33f4c878-3429-409c-b882-b93cfc340e91\" (UID: \"33f4c878-3429-409c-b882-b93cfc340e91\") "
Jul 06 14:16:27.083620 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.083591    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33f4c878-3429-409c-b882-b93cfc340e91-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33f4c878-3429-409c-b882-b93cfc340e91" (UID: "33f4c878-3429-409c-b882-b93cfc340e91"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:16:27.085413 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.085384    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f4c878-3429-409c-b882-b93cfc340e91-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33f4c878-3429-409c-b882-b93cfc340e91" (UID: "33f4c878-3429-409c-b882-b93cfc340e91"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:16:27.085549 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.085432    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f4c878-3429-409c-b882-b93cfc340e91-kube-api-access-tbrw9" (OuterVolumeSpecName: "kube-api-access-tbrw9") pod "33f4c878-3429-409c-b882-b93cfc340e91" (UID: "33f4c878-3429-409c-b882-b93cfc340e91"). InnerVolumeSpecName "kube-api-access-tbrw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:16:27.183986 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.183956    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbrw9\" (UniqueName: \"kubernetes.io/projected/33f4c878-3429-409c-b882-b93cfc340e91-kube-api-access-tbrw9\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:27.183986 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.183983    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f4c878-3429-409c-b882-b93cfc340e91-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:27.183986 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.183995    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f4c878-3429-409c-b882-b93cfc340e91-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:27.629080 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.629050    2572 generic.go:356] "Generic (PLEG): container finished" podID="33f4c878-3429-409c-b882-b93cfc340e91" containerID="b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209" exitCode=0
Jul 06 14:16:27.629532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.629095    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"
Jul 06 14:16:27.629532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.629143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb" event={"ID":"33f4c878-3429-409c-b882-b93cfc340e91","Type":"ContainerDied","Data":"b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209"}
Jul 06 14:16:27.629532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.629193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb" event={"ID":"33f4c878-3429-409c-b882-b93cfc340e91","Type":"ContainerDied","Data":"3d178bdb22e848f2ab0d3c7028ed631c4a294a5559f28f09f83fe50aa52d9d74"}
Jul 06 14:16:27.629532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.629227    2572 scope.go:117] "RemoveContainer" containerID="b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209"
Jul 06 14:16:27.638362 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.638344    2572 scope.go:117] "RemoveContainer" containerID="b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209"
Jul 06 14:16:27.638618 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:16:27.638601    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209\": container with ID starting with b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209 not found: ID does not exist" containerID="b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209"
Jul 06 14:16:27.638673 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.638626    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209"} err="failed to get container status \"b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209\": rpc error: code = NotFound desc = could not find container \"b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209\": container with ID starting with b07147779b4a81e259500dea995f88ddab8f24a8fc31468be919994d295b3209 not found: ID does not exist"
Jul 06 14:16:27.652978 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.652950    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"]
Jul 06 14:16:27.657633 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:27.657612    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2beb98-5658d6db6c-c6nrb"]
Jul 06 14:16:28.761202 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:28.761169    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f4c878-3429-409c-b882-b93cfc340e91" path="/var/lib/kubelet/pods/33f4c878-3429-409c-b882-b93cfc340e91/volumes"
Jul 06 14:16:50.135345 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:50.135309    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"]
Jul 06 14:16:50.135829 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:50.135516    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy" containerID="cri-o://b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6" gracePeriod=30
Jul 06 14:16:51.517399 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.517362    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"]
Jul 06 14:16:51.517801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.517635    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h" podUID="d7e59e61-00e3-4858-919c-655484a1d2be" containerName="maas-api" containerID="cri-o://d7f0a7883500d766485013660eef9bb4ef0935318f4f6cd7bba378e6cfcaf589" gracePeriod=30
Jul 06 14:16:51.746583 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.746550    2572 generic.go:356] "Generic (PLEG): container finished" podID="d7e59e61-00e3-4858-919c-655484a1d2be" containerID="d7f0a7883500d766485013660eef9bb4ef0935318f4f6cd7bba378e6cfcaf589" exitCode=0
Jul 06 14:16:51.746752 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.746618    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h" event={"ID":"d7e59e61-00e3-4858-919c-655484a1d2be","Type":"ContainerDied","Data":"d7f0a7883500d766485013660eef9bb4ef0935318f4f6cd7bba378e6cfcaf589"}
Jul 06 14:16:51.775565 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.775502    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:16:51.909106 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.909074    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e59e61-00e3-4858-919c-655484a1d2be-openshift-service-ca\") pod \"d7e59e61-00e3-4858-919c-655484a1d2be\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") "
Jul 06 14:16:51.909106 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.909107    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls\") pod \"d7e59e61-00e3-4858-919c-655484a1d2be\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") "
Jul 06 14:16:51.909365 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.909170    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trl7n\" (UniqueName: \"kubernetes.io/projected/d7e59e61-00e3-4858-919c-655484a1d2be-kube-api-access-trl7n\") pod \"d7e59e61-00e3-4858-919c-655484a1d2be\" (UID: \"d7e59e61-00e3-4858-919c-655484a1d2be\") "
Jul 06 14:16:51.909480 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.909451    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e59e61-00e3-4858-919c-655484a1d2be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d7e59e61-00e3-4858-919c-655484a1d2be" (UID: "d7e59e61-00e3-4858-919c-655484a1d2be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:16:51.911356 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.911244    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d7e59e61-00e3-4858-919c-655484a1d2be" (UID: "d7e59e61-00e3-4858-919c-655484a1d2be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:16:51.911356 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:51.911327    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e59e61-00e3-4858-919c-655484a1d2be-kube-api-access-trl7n" (OuterVolumeSpecName: "kube-api-access-trl7n") pod "d7e59e61-00e3-4858-919c-655484a1d2be" (UID: "d7e59e61-00e3-4858-919c-655484a1d2be"). InnerVolumeSpecName "kube-api-access-trl7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:16:52.010541 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.010486    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trl7n\" (UniqueName: \"kubernetes.io/projected/d7e59e61-00e3-4858-919c-655484a1d2be-kube-api-access-trl7n\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:52.010541 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.010534    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e59e61-00e3-4858-919c-655484a1d2be-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:52.010541 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.010545    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7e59e61-00e3-4858-919c-655484a1d2be-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:52.752551 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.752522    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"
Jul 06 14:16:52.753022 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.752558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h" event={"ID":"d7e59e61-00e3-4858-919c-655484a1d2be","Type":"ContainerDied","Data":"585cc014896fbac88ab3cdcd4153cc425ad5e06eee27cc578444861a1f691924"}
Jul 06 14:16:52.753022 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.752618    2572 scope.go:117] "RemoveContainer" containerID="d7f0a7883500d766485013660eef9bb4ef0935318f4f6cd7bba378e6cfcaf589"
Jul 06 14:16:52.783103 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.783071    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"]
Jul 06 14:16:52.789198 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:52.789175    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-53d7c5-77ff7869f5-lkb4h"]
Jul 06 14:16:54.350266 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:54.350231    2572 patch_prober.go:28] interesting pod/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:16:54.350654 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:54.350299    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:16:54.761625 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:54.761581    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e59e61-00e3-4858-919c-655484a1d2be" path="/var/lib/kubelet/pods/d7e59e61-00e3-4858-919c-655484a1d2be/volumes"
Jul 06 14:16:55.386363 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.386339    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:16:55.444776 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444692    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-podinfo\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.444776 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444725    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-envoy\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.444776 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444777    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-socket\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.445077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444806    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvpcx\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-kube-api-access-hvpcx\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.445077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444825    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-data\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.445077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444871    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-token\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.445077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444918    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-certs\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.445077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444957    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d10a33-2a32-4de0-9ab8-f865322606d8-istiod-ca-cert\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.445077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.444987    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-credential-socket\") pod \"d4d10a33-2a32-4de0-9ab8-f865322606d8\" (UID: \"d4d10a33-2a32-4de0-9ab8-f865322606d8\") "
Jul 06 14:16:55.445423 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.445157    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:55.445423 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.445346    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.445423 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.445350    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:55.445596 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.445529    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:55.445596 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.445544    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d10a33-2a32-4de0-9ab8-f865322606d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:16:55.445816 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.445797    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:55.447117 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.447088    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-kube-api-access-hvpcx" (OuterVolumeSpecName: "kube-api-access-hvpcx") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "kube-api-access-hvpcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:16:55.447251 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.447167    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:16:55.447470 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.447449    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:16:55.447470 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.447458    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4d10a33-2a32-4de0-9ab8-f865322606d8" (UID: "d4d10a33-2a32-4de0-9ab8-f865322606d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:16:55.545770 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545731    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.545770 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545761    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d10a33-2a32-4de0-9ab8-f865322606d8-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.545770 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545771    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.545770 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545780    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.546042 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545788    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.546042 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545797    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvpcx\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-kube-api-access-hvpcx\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.546042 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545805    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.546042 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.545812    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d10a33-2a32-4de0-9ab8-f865322606d8-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:16:55.769315 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.769198    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerID="b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6" exitCode=0
Jul 06 14:16:55.769315 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.769245    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" event={"ID":"d4d10a33-2a32-4de0-9ab8-f865322606d8","Type":"ContainerDied","Data":"b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6"}
Jul 06 14:16:55.769315 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.769262    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"
Jul 06 14:16:55.769315 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.769297    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn" event={"ID":"d4d10a33-2a32-4de0-9ab8-f865322606d8","Type":"ContainerDied","Data":"d3e8cc82dfee95c899c1079a8730482a4b35fcaa772e26ce1eccfabec3a654bd"}
Jul 06 14:16:55.769591 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.769320    2572 scope.go:117] "RemoveContainer" containerID="b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6"
Jul 06 14:16:55.778555 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.778533    2572 scope.go:117] "RemoveContainer" containerID="1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab"
Jul 06 14:16:55.792331 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.792307    2572 scope.go:117] "RemoveContainer" containerID="b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6"
Jul 06 14:16:55.792631 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:16:55.792610    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6\": container with ID starting with b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6 not found: ID does not exist" containerID="b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6"
Jul 06 14:16:55.792702 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.792638    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6"} err="failed to get container status \"b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6\": rpc error: code = NotFound desc = could not find container \"b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6\": container with ID starting with b7fd69bd04bcfd268b05d45a97724ac1c75df7a5774ff74a25f5a1bc43961da6 not found: ID does not exist"
Jul 06 14:16:55.792702 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.792662    2572 scope.go:117] "RemoveContainer" containerID="1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab"
Jul 06 14:16:55.792907 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:16:55.792888    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab\": container with ID starting with 1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab not found: ID does not exist" containerID="1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab"
Jul 06 14:16:55.792946 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.792914    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab"} err="failed to get container status \"1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab\": rpc error: code = NotFound desc = could not find container \"1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab\": container with ID starting with 1cc3de8758395139fa003600e32b26cb3900a03be8fa60edf4b5342fbce7d7ab not found: ID does not exist"
Jul 06 14:16:55.803110 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.803086    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"]
Jul 06 14:16:55.821703 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:55.821666    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2beb98-openshift-default-6cb58ff89c-c2mxn"]
Jul 06 14:16:56.761672 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:56.761641    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" path="/var/lib/kubelet/pods/d4d10a33-2a32-4de0-9ab8-f865322606d8/volumes"
Jul 06 14:16:58.192888 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:58.192859    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"]
Jul 06 14:16:58.193407 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:58.193050    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy" containerID="cri-o://18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38" gracePeriod=30
Jul 06 14:16:59.180141 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180112    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"]
Jul 06 14:16:59.180511 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180497    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f4c878-3429-409c-b882-b93cfc340e91" containerName="maas-api"
Jul 06 14:16:59.180564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180513    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f4c878-3429-409c-b882-b93cfc340e91" containerName="maas-api"
Jul 06 14:16:59.180564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180529    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy"
Jul 06 14:16:59.180564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180536    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy"
Jul 06 14:16:59.180564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180546    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e59e61-00e3-4858-919c-655484a1d2be" containerName="maas-api"
Jul 06 14:16:59.180564 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180551    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e59e61-00e3-4858-919c-655484a1d2be" containerName="maas-api"
Jul 06 14:16:59.180740 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180616    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy"
Jul 06 14:16:59.180740 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180624    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy"
Jul 06 14:16:59.180740 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180632    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e59e61-00e3-4858-919c-655484a1d2be" containerName="maas-api"
Jul 06 14:16:59.180740 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.180638    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f4c878-3429-409c-b882-b93cfc340e91" containerName="maas-api"
Jul 06 14:16:59.185047 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.185029    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.189572 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.189551    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7854c3-openshift-default-dockercfg-p2427\""
Jul 06 14:16:59.200655 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.200632    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"]
Jul 06 14:16:59.279166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-envoy\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-data\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279406 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279202    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5kk\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-kube-api-access-7m5kk\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279406 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279248    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-podinfo\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279406 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-socket\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279406 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279346    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-certs\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279542 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-credential-socket\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279542 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279448    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c055dc1-eff5-45ad-8188-bc964d934bf6-istiod-ca-cert\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.279542 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.279518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-token\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380358 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380315    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-token\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380358 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-envoy\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380575 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380376    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-data\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380575 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5kk\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-kube-api-access-7m5kk\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380575 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-podinfo\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380575 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380528    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-socket\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380575 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-certs\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380832 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380604    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-credential-socket\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380832 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c055dc1-eff5-45ad-8188-bc964d934bf6-istiod-ca-cert\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.380942 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380917    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-data\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.381020 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.380993    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-socket\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.381111 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.381076    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-credential-socket\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.381111 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.381104    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-certs\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.381380 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.381359    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c055dc1-eff5-45ad-8188-bc964d934bf6-istiod-ca-cert\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.382694 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.382675    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-envoy\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.383106 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.383084    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-podinfo\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.391124 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.391100    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-token\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.393018 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.393001    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5kk\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-kube-api-access-7m5kk\") pod \"e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") " pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.495089 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.494994    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:16:59.670682 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.670559    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"]
Jul 06 14:16:59.673372 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:16:59.673349    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c055dc1_eff5_45ad_8188_bc964d934bf6.slice/crio-46581d012c7b1ee0cc549d5415bafabfc7a05560e7d71636cd3ec45b697507b6 WatchSource:0}: Error finding container 46581d012c7b1ee0cc549d5415bafabfc7a05560e7d71636cd3ec45b697507b6: Status 404 returned error can't find the container with id 46581d012c7b1ee0cc549d5415bafabfc7a05560e7d71636cd3ec45b697507b6
Jul 06 14:16:59.675427 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.675398    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:16:59.675512 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.675460    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:16:59.675512 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.675487    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:16:59.792290 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.792180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" event={"ID":"7c055dc1-eff5-45ad-8188-bc964d934bf6","Type":"ContainerStarted","Data":"7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138"}
Jul 06 14:16:59.792290 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.792254    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" event={"ID":"7c055dc1-eff5-45ad-8188-bc964d934bf6","Type":"ContainerStarted","Data":"46581d012c7b1ee0cc549d5415bafabfc7a05560e7d71636cd3ec45b697507b6"}
Jul 06 14:16:59.816716 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:16:59.816664    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" podStartSLOduration=0.81664592 podStartE2EDuration="816.64592ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:59.815119166 +0000 UTC m=+1919.575091089" watchObservedRunningTime="2026-07-06 14:16:59.81664592 +0000 UTC m=+1919.576617841"
Jul 06 14:17:00.495553 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:00.495518    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:00.500414 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:00.500387    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:00.655485 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:00.655449    2572 patch_prober.go:28] interesting pod/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:17:00.655704 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:00.655511    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:17:00.797520 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:00.797424    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:00.798271 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:00.798250    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:02.106461 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.106423    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"]
Jul 06 14:17:02.107099 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.107077    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy"
Jul 06 14:17:02.107158 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.107103    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d10a33-2a32-4de0-9ab8-f865322606d8" containerName="istio-proxy"
Jul 06 14:17:02.112063 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.112041    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.116755 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.116730    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-7854c3-serving-cert\""
Jul 06 14:17:02.116868 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.116736    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:17:02.131958 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.131928    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"]
Jul 06 14:17:02.207451 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.207408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwm5f\" (UniqueName: \"kubernetes.io/projected/998f49a9-9a64-4608-9bd1-08ff50fb6726-kube-api-access-cwm5f\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.207614 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.207505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.207614 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.207562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998f49a9-9a64-4608-9bd1-08ff50fb6726-openshift-service-ca\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.308786 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.308745    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwm5f\" (UniqueName: \"kubernetes.io/projected/998f49a9-9a64-4608-9bd1-08ff50fb6726-kube-api-access-cwm5f\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.308994 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.308810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.308994 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.308846    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998f49a9-9a64-4608-9bd1-08ff50fb6726-openshift-service-ca\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.308994 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:02.308980    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-7854c3-serving-cert: secret "maas-api-e2e-api-a-7854c3-serving-cert" not found
Jul 06 14:17:02.309177 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:02.309073    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls podName:998f49a9-9a64-4608-9bd1-08ff50fb6726 nodeName:}" failed. No retries permitted until 2026-07-06 14:17:02.809050093 +0000 UTC m=+1922.569022013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls") pod "maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf" (UID: "998f49a9-9a64-4608-9bd1-08ff50fb6726") : secret "maas-api-e2e-api-a-7854c3-serving-cert" not found
Jul 06 14:17:02.309523 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.309505    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998f49a9-9a64-4608-9bd1-08ff50fb6726-openshift-service-ca\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.320145 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.320115    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwm5f\" (UniqueName: \"kubernetes.io/projected/998f49a9-9a64-4608-9bd1-08ff50fb6726-kube-api-access-cwm5f\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.813729 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.813695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:02.816109 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:02.816087    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls\") pod \"maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") " pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:03.022033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.022000    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:03.161688 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.161665    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"]
Jul 06 14:17:03.164065 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:17:03.164039    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998f49a9_9a64_4608_9bd1_08ff50fb6726.slice/crio-adf5aac23c58d3c5e23bfbc185d16e18d27ac523422956d891939bf10e73dd75 WatchSource:0}: Error finding container adf5aac23c58d3c5e23bfbc185d16e18d27ac523422956d891939bf10e73dd75: Status 404 returned error can't find the container with id adf5aac23c58d3c5e23bfbc185d16e18d27ac523422956d891939bf10e73dd75
Jul 06 14:17:03.445570 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.445543    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:17:03.620043 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620005    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-envoy\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620144 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620051    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-podinfo\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620144 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620088    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-token\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620144 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620121    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-credential-socket\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620313 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620158    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istiod-ca-cert\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620313 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620193    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-data\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620313 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620248    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-certs\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620313 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620292    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lq95\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-kube-api-access-7lq95\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620531 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620349    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-socket\") pod \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\" (UID: \"50c8e0c0-c00e-42ba-aa2a-b9f501d33221\") "
Jul 06 14:17:03.620531 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620477    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:03.620710 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620687    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:03.620823 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620803    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.620883 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.620822    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.621189 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.621140    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:03.621405 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.621377    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:03.621530 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.621440    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-data" (OuterVolumeSpecName: "istio-data") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:03.622274 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.622253    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:03.622367 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.622338    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:17:03.622584 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.622564    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-token" (OuterVolumeSpecName: "istio-token") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:03.622878 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.622857    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-kube-api-access-7lq95" (OuterVolumeSpecName: "kube-api-access-7lq95") pod "50c8e0c0-c00e-42ba-aa2a-b9f501d33221" (UID: "50c8e0c0-c00e-42ba-aa2a-b9f501d33221"). InnerVolumeSpecName "kube-api-access-7lq95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:03.721895 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.721860    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.721895 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.721889    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.721895 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.721898    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lq95\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-kube-api-access-7lq95\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.722125 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.721909    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.722125 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.721917    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.722125 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.721925    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.722125 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.721932    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c8e0c0-c00e-42ba-aa2a-b9f501d33221-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:03.814008 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.813974    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf" event={"ID":"998f49a9-9a64-4608-9bd1-08ff50fb6726","Type":"ContainerStarted","Data":"7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104"}
Jul 06 14:17:03.814229 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.814027    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf" event={"ID":"998f49a9-9a64-4608-9bd1-08ff50fb6726","Type":"ContainerStarted","Data":"adf5aac23c58d3c5e23bfbc185d16e18d27ac523422956d891939bf10e73dd75"}
Jul 06 14:17:03.814229 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.814087    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:03.815749 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.815717    2572 generic.go:356] "Generic (PLEG): container finished" podID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerID="18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38" exitCode=0
Jul 06 14:17:03.815847 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.815749    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" event={"ID":"50c8e0c0-c00e-42ba-aa2a-b9f501d33221","Type":"ContainerDied","Data":"18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38"}
Jul 06 14:17:03.815847 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.815767    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"
Jul 06 14:17:03.815847 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.815798    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92" event={"ID":"50c8e0c0-c00e-42ba-aa2a-b9f501d33221","Type":"ContainerDied","Data":"a8d2d6fe381bcd9cbb31b3a4923b2b005b3a3b65e1267223addf005e4631953e"}
Jul 06 14:17:03.815847 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.815827    2572 scope.go:117] "RemoveContainer" containerID="18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38"
Jul 06 14:17:03.828723 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.828705    2572 scope.go:117] "RemoveContainer" containerID="aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62"
Jul 06 14:17:03.836485 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.836471    2572 scope.go:117] "RemoveContainer" containerID="18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38"
Jul 06 14:17:03.836716 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:03.836699    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38\": container with ID starting with 18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38 not found: ID does not exist" containerID="18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38"
Jul 06 14:17:03.836755 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.836726    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38"} err="failed to get container status \"18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38\": rpc error: code = NotFound desc = could not find container \"18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38\": container with ID starting with 18ca5d69db38c2c6227b755b6c76e13d1edd70c11e3011bc9048ab1f3b06ed38 not found: ID does not exist"
Jul 06 14:17:03.836755 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.836743    2572 scope.go:117] "RemoveContainer" containerID="aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62"
Jul 06 14:17:03.836959 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:03.836943    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62\": container with ID starting with aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62 not found: ID does not exist" containerID="aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62"
Jul 06 14:17:03.837003 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.836964    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62"} err="failed to get container status \"aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62\": rpc error: code = NotFound desc = could not find container \"aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62\": container with ID starting with aa7516e41665dc24579e61cb17c242f25010bf92facf65f41e20bb767c5ffa62 not found: ID does not exist"
Jul 06 14:17:03.845302 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.845253    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf" podStartSLOduration=1.461995491 podStartE2EDuration="1.845232807s" totalImagesPullingTime="383.237316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:03.844517341 +0000 UTC m=+1923.604489263" watchObservedRunningTime="2026-07-06 14:17:03.845232807 +0000 UTC m=+1923.605204719"
Jul 06 14:17:03.872524 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.872497    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"]
Jul 06 14:17:03.875683 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:03.875661    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-53d7c5-openshift-default-5496499485-b4r92"]
Jul 06 14:17:04.762281 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:04.762248    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" path="/var/lib/kubelet/pods/50c8e0c0-c00e-42ba-aa2a-b9f501d33221/volumes"
Jul 06 14:17:07.442224 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.442185    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"]
Jul 06 14:17:07.442617 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.442600    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy"
Jul 06 14:17:07.442617 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.442611    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy"
Jul 06 14:17:07.442698 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.442621    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy"
Jul 06 14:17:07.442698 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.442626    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy"
Jul 06 14:17:07.442698 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.442683    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy"
Jul 06 14:17:07.442698 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.442693    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c8e0c0-c00e-42ba-aa2a-b9f501d33221" containerName="istio-proxy"
Jul 06 14:17:07.447259 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.447241    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.449719 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.449691    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-db164d-openshift-default-dockercfg-gddqv\""
Jul 06 14:17:07.460419 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.460393    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"]
Jul 06 14:17:07.560275 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz5xj\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-kube-api-access-qz5xj\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560275 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560277    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-credential-socket\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560484 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560303    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-token\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560484 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560388    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-socket\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560484 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560453    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-certs\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560582 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560491    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e5d1b2-24c8-4292-a6eb-a22115743634-istiod-ca-cert\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560582 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-envoy\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560582 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-podinfo\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.560582 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.560560    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-data\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.661955 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.661911    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz5xj\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-kube-api-access-qz5xj\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.661955 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.661957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-credential-socket\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.661985    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-token\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-socket\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-certs\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e5d1b2-24c8-4292-a6eb-a22115743634-istiod-ca-cert\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-envoy\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662173    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-podinfo\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662379    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-data\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662454    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-credential-socket\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662702 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662570    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-socket\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662702 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662661    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-certs\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662702 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662694    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-data\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.662972 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.662950    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e5d1b2-24c8-4292-a6eb-a22115743634-istiod-ca-cert\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.664487 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.664468    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-envoy\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.664538 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.664512    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-podinfo\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.674407 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.674383    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-token\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.676297 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.676270    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz5xj\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-kube-api-access-qz5xj\") pod \"e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") " pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.757636 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.757560    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:07.909297 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.909269    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"]
Jul 06 14:17:07.911943 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:17:07.911920    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e5d1b2_24c8_4292_a6eb_a22115743634.slice/crio-ce39eaede903fc240035da7c4b10b66d56ec0d7e609e4fe734be3b9ff043818f WatchSource:0}: Error finding container ce39eaede903fc240035da7c4b10b66d56ec0d7e609e4fe734be3b9ff043818f: Status 404 returned error can't find the container with id ce39eaede903fc240035da7c4b10b66d56ec0d7e609e4fe734be3b9ff043818f
Jul 06 14:17:07.914132 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.914096    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:07.914239 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.914167    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:07.914239 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:07.914196    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:08.842301 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:08.842265    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" event={"ID":"f3e5d1b2-24c8-4292-a6eb-a22115743634","Type":"ContainerStarted","Data":"5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37"}
Jul 06 14:17:08.842682 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:08.842315    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" event={"ID":"f3e5d1b2-24c8-4292-a6eb-a22115743634","Type":"ContainerStarted","Data":"ce39eaede903fc240035da7c4b10b66d56ec0d7e609e4fe734be3b9ff043818f"}
Jul 06 14:17:09.758369 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:09.758331    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:09.763468 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:09.763441    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:09.785046 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:09.784987    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" podStartSLOduration=2.78496807 podStartE2EDuration="2.78496807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:08.870911018 +0000 UTC m=+1928.630882942" watchObservedRunningTime="2026-07-06 14:17:09.78496807 +0000 UTC m=+1929.544939993"
Jul 06 14:17:09.826787 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:09.826756    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:09.847376 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:09.847346    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:09.848272 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:09.848249    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:11.183546 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.183499    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"]
Jul 06 14:17:11.188110 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.188077    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.191475 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.191445    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-db164d-serving-cert\""
Jul 06 14:17:11.205565 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.205542    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"]
Jul 06 14:17:11.210836 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.210809    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d64160-4ccd-475a-a486-eed792efe278-openshift-service-ca\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.210965 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.210847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmjlv\" (UniqueName: \"kubernetes.io/projected/98d64160-4ccd-475a-a486-eed792efe278-kube-api-access-bmjlv\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.210965 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.210951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.311947 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.311907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d64160-4ccd-475a-a486-eed792efe278-openshift-service-ca\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.311947 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.311948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmjlv\" (UniqueName: \"kubernetes.io/projected/98d64160-4ccd-475a-a486-eed792efe278-kube-api-access-bmjlv\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.312165 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.312062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.312241 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:11.312190    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-db164d-serving-cert: secret "maas-api-e2e-api-b-db164d-serving-cert" not found
Jul 06 14:17:11.312302 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:11.312289    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls podName:98d64160-4ccd-475a-a486-eed792efe278 nodeName:}" failed. No retries permitted until 2026-07-06 14:17:11.812268262 +0000 UTC m=+1931.572240175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls") pod "maas-api-e2e-api-b-db164d-7f5566cccb-zjkth" (UID: "98d64160-4ccd-475a-a486-eed792efe278") : secret "maas-api-e2e-api-b-db164d-serving-cert" not found
Jul 06 14:17:11.312671 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.312654    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d64160-4ccd-475a-a486-eed792efe278-openshift-service-ca\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.322664 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.322638    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmjlv\" (UniqueName: \"kubernetes.io/projected/98d64160-4ccd-475a-a486-eed792efe278-kube-api-access-bmjlv\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.816669 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.816628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:11.819458 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:11.819427    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls\") pod \"maas-api-e2e-api-b-db164d-7f5566cccb-zjkth\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") " pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:12.101000 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:12.100899    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:12.257162 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:12.257137    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"]
Jul 06 14:17:12.259857 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:17:12.259832    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d64160_4ccd_475a_a486_eed792efe278.slice/crio-0f836c55cfa95d709c213e05daf5fb472999d24c974fcbdcf996513adaf0479e WatchSource:0}: Error finding container 0f836c55cfa95d709c213e05daf5fb472999d24c974fcbdcf996513adaf0479e: Status 404 returned error can't find the container with id 0f836c55cfa95d709c213e05daf5fb472999d24c974fcbdcf996513adaf0479e
Jul 06 14:17:12.863656 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:12.863624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth" event={"ID":"98d64160-4ccd-475a-a486-eed792efe278","Type":"ContainerStarted","Data":"c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239"}
Jul 06 14:17:12.863801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:12.863675    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth" event={"ID":"98d64160-4ccd-475a-a486-eed792efe278","Type":"ContainerStarted","Data":"0f836c55cfa95d709c213e05daf5fb472999d24c974fcbdcf996513adaf0479e"}
Jul 06 14:17:12.863801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:12.863739    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:12.883095 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:12.883038    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth" podStartSLOduration=1.418966086 podStartE2EDuration="1.883020472s" totalImagesPullingTime="464.054386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:12.881957875 +0000 UTC m=+1932.641929797" watchObservedRunningTime="2026-07-06 14:17:12.883020472 +0000 UTC m=+1932.642992405"
Jul 06 14:17:15.798746 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.798702    2572 patch_prober.go:28] interesting pod/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:17:15.799165 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.798766    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 14:17:15.885145 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.885109    2572 generic.go:356] "Generic (PLEG): container finished" podID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerID="7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138" exitCode=0
Jul 06 14:17:15.885322 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.885178    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" event={"ID":"7c055dc1-eff5-45ad-8188-bc964d934bf6","Type":"ContainerDied","Data":"7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138"}
Jul 06 14:17:15.885685 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.885667    2572 scope.go:117] "RemoveContainer" containerID="7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138"
Jul 06 14:17:15.886773 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.886744    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:15.886860 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.886825    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:15.886860 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:15.886855    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:16.893768 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:16.893730    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" event={"ID":"7c055dc1-eff5-45ad-8188-bc964d934bf6","Type":"ContainerStarted","Data":"46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720"}
Jul 06 14:17:17.496219 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:17.496158    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:17.496512 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:17.496485    2572 patch_prober.go:28] interesting pod/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:17:17.496563 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:17.496545    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 14:17:18.496190 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:18.496149    2572 patch_prober.go:28] interesting pod/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:17:18.496633 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:18.496244    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 14:17:18.878931 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:18.878901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:19.496102 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:19.496043    2572 patch_prober.go:28] interesting pod/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:17:19.496431 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:19.496402    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 14:17:20.495793 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:20.495727    2572 patch_prober.go:28] interesting pod/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 06 14:17:20.496089 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:20.496057    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 06 14:17:21.499790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:21.499753    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:21.500167 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:21.500017    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:21.507459 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:21.507434    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:24.515574 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.515538    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"]
Jul 06 14:17:24.516086 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.515789    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf" podUID="998f49a9-9a64-4608-9bd1-08ff50fb6726" containerName="maas-api" containerID="cri-o://7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104" gracePeriod=30
Jul 06 14:17:24.784619 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.784594    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:24.840652 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.840617    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998f49a9-9a64-4608-9bd1-08ff50fb6726-openshift-service-ca\") pod \"998f49a9-9a64-4608-9bd1-08ff50fb6726\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") "
Jul 06 14:17:24.840848 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.840685    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls\") pod \"998f49a9-9a64-4608-9bd1-08ff50fb6726\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") "
Jul 06 14:17:24.840848 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.840715    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwm5f\" (UniqueName: \"kubernetes.io/projected/998f49a9-9a64-4608-9bd1-08ff50fb6726-kube-api-access-cwm5f\") pod \"998f49a9-9a64-4608-9bd1-08ff50fb6726\" (UID: \"998f49a9-9a64-4608-9bd1-08ff50fb6726\") "
Jul 06 14:17:24.841067 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.841040    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/998f49a9-9a64-4608-9bd1-08ff50fb6726-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "998f49a9-9a64-4608-9bd1-08ff50fb6726" (UID: "998f49a9-9a64-4608-9bd1-08ff50fb6726"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:24.841270 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.841248    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/998f49a9-9a64-4608-9bd1-08ff50fb6726-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:24.842955 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.842933    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "998f49a9-9a64-4608-9bd1-08ff50fb6726" (UID: "998f49a9-9a64-4608-9bd1-08ff50fb6726"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:24.843043 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.842931    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/998f49a9-9a64-4608-9bd1-08ff50fb6726-kube-api-access-cwm5f" (OuterVolumeSpecName: "kube-api-access-cwm5f") pod "998f49a9-9a64-4608-9bd1-08ff50fb6726" (UID: "998f49a9-9a64-4608-9bd1-08ff50fb6726"). InnerVolumeSpecName "kube-api-access-cwm5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:24.939887 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.939852    2572 generic.go:356] "Generic (PLEG): container finished" podID="998f49a9-9a64-4608-9bd1-08ff50fb6726" containerID="7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104" exitCode=0
Jul 06 14:17:24.940066 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.939893    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"
Jul 06 14:17:24.940066 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.939926    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf" event={"ID":"998f49a9-9a64-4608-9bd1-08ff50fb6726","Type":"ContainerDied","Data":"7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104"}
Jul 06 14:17:24.940066 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.939983    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf" event={"ID":"998f49a9-9a64-4608-9bd1-08ff50fb6726","Type":"ContainerDied","Data":"adf5aac23c58d3c5e23bfbc185d16e18d27ac523422956d891939bf10e73dd75"}
Jul 06 14:17:24.940066 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.940005    2572 scope.go:117] "RemoveContainer" containerID="7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104"
Jul 06 14:17:24.941733 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.941713    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwm5f\" (UniqueName: \"kubernetes.io/projected/998f49a9-9a64-4608-9bd1-08ff50fb6726-kube-api-access-cwm5f\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:24.941733 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.941733    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/998f49a9-9a64-4608-9bd1-08ff50fb6726-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:24.949300 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.949284    2572 scope.go:117] "RemoveContainer" containerID="7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104"
Jul 06 14:17:24.949554 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:24.949536    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104\": container with ID starting with 7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104 not found: ID does not exist" containerID="7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104"
Jul 06 14:17:24.949619 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.949561    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104"} err="failed to get container status \"7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104\": rpc error: code = NotFound desc = could not find container \"7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104\": container with ID starting with 7e188ad2c53b3ca16b115a7bffddbf23d5b87c254256d049476113f9e9cb6104 not found: ID does not exist"
Jul 06 14:17:24.962948 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.962923    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"]
Jul 06 14:17:24.969258 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:24.969237    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7854c3-69df87fd66-rc4nf"]
Jul 06 14:17:25.888402 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:25.888362    2572 patch_prober.go:28] interesting pod/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 14:17:25.888803 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:25.888441    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 14:17:26.766397 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:26.764197    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="998f49a9-9a64-4608-9bd1-08ff50fb6726" path="/var/lib/kubelet/pods/998f49a9-9a64-4608-9bd1-08ff50fb6726/volumes"
Jul 06 14:17:26.953532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:26.953501    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerID="5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37" exitCode=0
Jul 06 14:17:26.953920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:26.953579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" event={"ID":"f3e5d1b2-24c8-4292-a6eb-a22115743634","Type":"ContainerDied","Data":"5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37"}
Jul 06 14:17:26.953978 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:26.953965    2572 scope.go:117] "RemoveContainer" containerID="5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37"
Jul 06 14:17:26.954944 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:26.954917    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:26.955043 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:26.955003    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:26.955105 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:26.955047    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:27.961907 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:27.961870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" event={"ID":"f3e5d1b2-24c8-4292-a6eb-a22115743634","Type":"ContainerStarted","Data":"05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b"}
Jul 06 14:17:28.757971 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:28.757938    2572 patch_prober.go:28] interesting pod/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 06 14:17:28.758136 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:28.757998    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 06 14:17:28.761577 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:28.761549    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:29.758423 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:29.758383    2572 patch_prober.go:28] interesting pod/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 06 14:17:29.758920 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:29.758455    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 06 14:17:30.759969 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:30.759940    2572 patch_prober.go:28] interesting pod/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 06 14:17:30.760490 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:30.760264    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 06 14:17:31.129032 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:31.128994    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"]
Jul 06 14:17:31.129269 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:31.129242    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy" containerID="cri-o://46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720" gracePeriod=30
Jul 06 14:17:31.758831 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:31.758792    2572 patch_prober.go:28] interesting pod/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 06 14:17:31.759021 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:31.758846    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 06 14:17:32.325516 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.325469    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"]
Jul 06 14:17:32.325946 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.325690    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth" podUID="98d64160-4ccd-475a-a486-eed792efe278" containerName="maas-api" containerID="cri-o://c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239" gracePeriod=30
Jul 06 14:17:32.581599 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.581535    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:32.622290 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.622256    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d64160-4ccd-475a-a486-eed792efe278-openshift-service-ca\") pod \"98d64160-4ccd-475a-a486-eed792efe278\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") "
Jul 06 14:17:32.622459 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.622372    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls\") pod \"98d64160-4ccd-475a-a486-eed792efe278\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") "
Jul 06 14:17:32.622459 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.622428    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmjlv\" (UniqueName: \"kubernetes.io/projected/98d64160-4ccd-475a-a486-eed792efe278-kube-api-access-bmjlv\") pod \"98d64160-4ccd-475a-a486-eed792efe278\" (UID: \"98d64160-4ccd-475a-a486-eed792efe278\") "
Jul 06 14:17:32.622642 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.622617    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d64160-4ccd-475a-a486-eed792efe278-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "98d64160-4ccd-475a-a486-eed792efe278" (UID: "98d64160-4ccd-475a-a486-eed792efe278"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:32.622794 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.622776    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98d64160-4ccd-475a-a486-eed792efe278-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:32.624514 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.624487    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "98d64160-4ccd-475a-a486-eed792efe278" (UID: "98d64160-4ccd-475a-a486-eed792efe278"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:32.624514 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.624487    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d64160-4ccd-475a-a486-eed792efe278-kube-api-access-bmjlv" (OuterVolumeSpecName: "kube-api-access-bmjlv") pod "98d64160-4ccd-475a-a486-eed792efe278" (UID: "98d64160-4ccd-475a-a486-eed792efe278"). InnerVolumeSpecName "kube-api-access-bmjlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:32.723572 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.723534    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98d64160-4ccd-475a-a486-eed792efe278-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:32.723572 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.723566    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmjlv\" (UniqueName: \"kubernetes.io/projected/98d64160-4ccd-475a-a486-eed792efe278-kube-api-access-bmjlv\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:32.762001 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.761975    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:32.762251 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.762232    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:32.762917 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.762897    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:32.997632 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.997594    2572 generic.go:356] "Generic (PLEG): container finished" podID="98d64160-4ccd-475a-a486-eed792efe278" containerID="c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239" exitCode=0
Jul 06 14:17:32.997830 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.997637    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth" event={"ID":"98d64160-4ccd-475a-a486-eed792efe278","Type":"ContainerDied","Data":"c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239"}
Jul 06 14:17:32.997830 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.997665    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"
Jul 06 14:17:32.997830 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.997705    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth" event={"ID":"98d64160-4ccd-475a-a486-eed792efe278","Type":"ContainerDied","Data":"0f836c55cfa95d709c213e05daf5fb472999d24c974fcbdcf996513adaf0479e"}
Jul 06 14:17:32.997830 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:32.997737    2572 scope.go:117] "RemoveContainer" containerID="c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239"
Jul 06 14:17:33.006532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:33.006513    2572 scope.go:117] "RemoveContainer" containerID="c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239"
Jul 06 14:17:33.006830 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:33.006809    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239\": container with ID starting with c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239 not found: ID does not exist" containerID="c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239"
Jul 06 14:17:33.006922 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:33.006843    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239"} err="failed to get container status \"c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239\": rpc error: code = NotFound desc = could not find container \"c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239\": container with ID starting with c080e1fa06b5914cba6e2e5fae6c94a541e94887c1d1fb472b6d1bd1f416b239 not found: ID does not exist"
Jul 06 14:17:33.017188 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:33.017163    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"]
Jul 06 14:17:33.019506 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:33.019478    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-db164d-7f5566cccb-zjkth"]
Jul 06 14:17:34.761799 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:34.761766    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d64160-4ccd-475a-a486-eed792efe278" path="/var/lib/kubelet/pods/98d64160-4ccd-475a-a486-eed792efe278/volumes"
Jul 06 14:17:36.389777 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.389753    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:36.461384 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461294    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-data\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461384 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461353    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-podinfo\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461384 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461377    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-socket\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461657 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461402    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-certs\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461657 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461421    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m5kk\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-kube-api-access-7m5kk\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461657 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461443    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-envoy\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461657 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461465    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c055dc1-eff5-45ad-8188-bc964d934bf6-istiod-ca-cert\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461657 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461489    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-token\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461657 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461589    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-credential-socket\") pod \"7c055dc1-eff5-45ad-8188-bc964d934bf6\" (UID: \"7c055dc1-eff5-45ad-8188-bc964d934bf6\") "
Jul 06 14:17:36.461968 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461795    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:36.461968 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461806    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:36.462088 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461973    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.462088 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461993    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.462088 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.461990    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:36.462088 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.462037    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c055dc1-eff5-45ad-8188-bc964d934bf6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:36.462289 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.462239    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:36.463745 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.463719    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-kube-api-access-7m5kk" (OuterVolumeSpecName: "kube-api-access-7m5kk") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "kube-api-access-7m5kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:36.463745 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.463733    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:17:36.464199 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.464181    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:36.464199 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.464186    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c055dc1-eff5-45ad-8188-bc964d934bf6" (UID: "7c055dc1-eff5-45ad-8188-bc964d934bf6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:36.562570 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.562532    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.562570 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.562563    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.562570 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.562575    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.562827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.562585    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m5kk\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-kube-api-access-7m5kk\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.562827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.562598    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.562827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.562608    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c055dc1-eff5-45ad-8188-bc964d934bf6-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:36.562827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:36.562618    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c055dc1-eff5-45ad-8188-bc964d934bf6-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:37.025803 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.025700    2572 generic.go:356] "Generic (PLEG): container finished" podID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerID="46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720" exitCode=0
Jul 06 14:17:37.025803 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.025760    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"
Jul 06 14:17:37.025803 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.025781    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" event={"ID":"7c055dc1-eff5-45ad-8188-bc964d934bf6","Type":"ContainerDied","Data":"46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720"}
Jul 06 14:17:37.026076 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.025855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w" event={"ID":"7c055dc1-eff5-45ad-8188-bc964d934bf6","Type":"ContainerDied","Data":"46581d012c7b1ee0cc549d5415bafabfc7a05560e7d71636cd3ec45b697507b6"}
Jul 06 14:17:37.026076 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.025878    2572 scope.go:117] "RemoveContainer" containerID="46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720"
Jul 06 14:17:37.034658 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.034637    2572 scope.go:117] "RemoveContainer" containerID="7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138"
Jul 06 14:17:37.042762 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.042744    2572 scope.go:117] "RemoveContainer" containerID="46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720"
Jul 06 14:17:37.043022 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:37.043001    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720\": container with ID starting with 46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720 not found: ID does not exist" containerID="46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720"
Jul 06 14:17:37.043116 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.043035    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720"} err="failed to get container status \"46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720\": rpc error: code = NotFound desc = could not find container \"46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720\": container with ID starting with 46290e4666d6ce6e8055edc9b9062abb91af331388c1fbfe5ce134d4f6c01720 not found: ID does not exist"
Jul 06 14:17:37.043116 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.043060    2572 scope.go:117] "RemoveContainer" containerID="7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138"
Jul 06 14:17:37.043357 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:37.043341    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138\": container with ID starting with 7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138 not found: ID does not exist" containerID="7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138"
Jul 06 14:17:37.043406 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.043362    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138"} err="failed to get container status \"7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138\": rpc error: code = NotFound desc = could not find container \"7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138\": container with ID starting with 7ae927d1c80a4f9cd2fa64ffa138a78b5d5e128a0a34dda872f0815ff7ce9138 not found: ID does not exist"
Jul 06 14:17:37.051811 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.051789    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"]
Jul 06 14:17:37.056223 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:37.056191    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7854c3-openshift-default-584b9fff59-n5k5w"]
Jul 06 14:17:38.557828 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:38.557789    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"]
Jul 06 14:17:38.558301 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:38.558046    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy" containerID="cri-o://05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b" gracePeriod=30
Jul 06 14:17:38.760890 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:38.760855    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" path="/var/lib/kubelet/pods/7c055dc1-eff5-45ad-8188-bc964d934bf6/volumes"
Jul 06 14:17:39.452283 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452252    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"]
Jul 06 14:17:39.452623 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452611    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998f49a9-9a64-4608-9bd1-08ff50fb6726" containerName="maas-api"
Jul 06 14:17:39.452665 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452624    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="998f49a9-9a64-4608-9bd1-08ff50fb6726" containerName="maas-api"
Jul 06 14:17:39.452665 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452632    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy"
Jul 06 14:17:39.452665 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452638    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy"
Jul 06 14:17:39.452665 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452651    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d64160-4ccd-475a-a486-eed792efe278" containerName="maas-api"
Jul 06 14:17:39.452665 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452657    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d64160-4ccd-475a-a486-eed792efe278" containerName="maas-api"
Jul 06 14:17:39.452665 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452664    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy"
Jul 06 14:17:39.452844 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452669    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy"
Jul 06 14:17:39.452844 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452729    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d64160-4ccd-475a-a486-eed792efe278" containerName="maas-api"
Jul 06 14:17:39.452844 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452736    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy"
Jul 06 14:17:39.452844 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.452743    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="998f49a9-9a64-4608-9bd1-08ff50fb6726" containerName="maas-api"
Jul 06 14:17:39.456959 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.456940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.458966 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.458944    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0ba2b8-openshift-default-dockercfg-8fjw8\""
Jul 06 14:17:39.472017 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.471993    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"]
Jul 06 14:17:39.591914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.591884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rwc\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-kube-api-access-22rwc\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.591922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-data\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.591953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-podinfo\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.591976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-token\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.592033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-socket\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.592161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-certs\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.592198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-envoy\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.592256    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-credential-socket\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.592295 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.592279    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b786b9f-f360-4db3-b34e-14826c7daf75-istiod-ca-cert\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.692825 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-certs\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.692825 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-envoy\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692857    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-credential-socket\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b786b9f-f360-4db3-b34e-14826c7daf75-istiod-ca-cert\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rwc\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-kube-api-access-22rwc\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-data\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692962    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-podinfo\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.692982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-token\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.693006    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-socket\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693450 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.693288    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-certs\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693450 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.693353    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-credential-socket\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693450 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.693418    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-data\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693654 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.693633    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-socket\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.693728 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.693706    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b786b9f-f360-4db3-b34e-14826c7daf75-istiod-ca-cert\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.695042 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.695016    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-envoy\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.695572 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.695553    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-podinfo\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.703893 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.703824    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rwc\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-kube-api-access-22rwc\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.705488 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.705464    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-token\") pod \"e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") " pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.767190 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.767157    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:39.905656 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.905630    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"]
Jul 06 14:17:39.907555 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:17:39.907530    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b786b9f_f360_4db3_b34e_14826c7daf75.slice/crio-ad8722f5d834dd3190d20076f10a10fb67a805b5750faa71dd653f00220e451d WatchSource:0}: Error finding container ad8722f5d834dd3190d20076f10a10fb67a805b5750faa71dd653f00220e451d: Status 404 returned error can't find the container with id ad8722f5d834dd3190d20076f10a10fb67a805b5750faa71dd653f00220e451d
Jul 06 14:17:39.909784 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.909753    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:39.909856 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.909824    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:39.909891 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:39.909853    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:40.045408 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:40.045373    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" event={"ID":"3b786b9f-f360-4db3-b34e-14826c7daf75","Type":"ContainerStarted","Data":"e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1"}
Jul 06 14:17:40.045627 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:40.045429    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" event={"ID":"3b786b9f-f360-4db3-b34e-14826c7daf75","Type":"ContainerStarted","Data":"ad8722f5d834dd3190d20076f10a10fb67a805b5750faa71dd653f00220e451d"}
Jul 06 14:17:40.066872 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:40.066805    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" podStartSLOduration=1.066785874 podStartE2EDuration="1.066785874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:40.065663472 +0000 UTC m=+1959.825635398" watchObservedRunningTime="2026-07-06 14:17:40.066785874 +0000 UTC m=+1959.826757797"
Jul 06 14:17:40.768271 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:40.768243    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:40.773250 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:40.773225    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:41.050185 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:41.050100    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:41.051259 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:41.051239    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:42.131448 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.131415    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"]
Jul 06 14:17:42.131860 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.131847    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c055dc1-eff5-45ad-8188-bc964d934bf6" containerName="istio-proxy"
Jul 06 14:17:42.135237 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.135196    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.137346 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.137324    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-0ba2b8-serving-cert\""
Jul 06 14:17:42.137444 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.137367    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffx9s\""
Jul 06 14:17:42.147938 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.147873    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"]
Jul 06 14:17:42.217382 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.217343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czdzq\" (UniqueName: \"kubernetes.io/projected/1cc9ae7b-d358-49be-80b9-de079098a5ed-kube-api-access-czdzq\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.217548 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.217462    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc9ae7b-d358-49be-80b9-de079098a5ed-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.217548 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.217525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cc9ae7b-d358-49be-80b9-de079098a5ed-maas-api-tls\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.318835 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.318795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc9ae7b-d358-49be-80b9-de079098a5ed-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.319041 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.318851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cc9ae7b-d358-49be-80b9-de079098a5ed-maas-api-tls\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.319041 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.318944    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czdzq\" (UniqueName: \"kubernetes.io/projected/1cc9ae7b-d358-49be-80b9-de079098a5ed-kube-api-access-czdzq\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.319516 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.319495    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc9ae7b-d358-49be-80b9-de079098a5ed-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.321368 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.321347    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cc9ae7b-d358-49be-80b9-de079098a5ed-maas-api-tls\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.327474 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.327454    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czdzq\" (UniqueName: \"kubernetes.io/projected/1cc9ae7b-d358-49be-80b9-de079098a5ed-kube-api-access-czdzq\") pod \"maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") " pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.447692 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.447596    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:42.607024 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:42.607001    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"]
Jul 06 14:17:42.609493 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:17:42.609468    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc9ae7b_d358_49be_80b9_de079098a5ed.slice/crio-e2e4efc6c39fc385ad41d50c919ac6ea57d05ffc3c73220d0eae36d7640f6441 WatchSource:0}: Error finding container e2e4efc6c39fc385ad41d50c919ac6ea57d05ffc3c73220d0eae36d7640f6441: Status 404 returned error can't find the container with id e2e4efc6c39fc385ad41d50c919ac6ea57d05ffc3c73220d0eae36d7640f6441
Jul 06 14:17:43.061086 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.061054    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf" event={"ID":"1cc9ae7b-d358-49be-80b9-de079098a5ed","Type":"ContainerStarted","Data":"3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5"}
Jul 06 14:17:43.061332 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.061114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf" event={"ID":"1cc9ae7b-d358-49be-80b9-de079098a5ed","Type":"ContainerStarted","Data":"e2e4efc6c39fc385ad41d50c919ac6ea57d05ffc3c73220d0eae36d7640f6441"}
Jul 06 14:17:43.078018 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.077961    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf" podStartSLOduration=0.691105559 podStartE2EDuration="1.077937615s" totalImagesPullingTime="386.832056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:43.076315078 +0000 UTC m=+1962.836287001" watchObservedRunningTime="2026-07-06 14:17:43.077937615 +0000 UTC m=+1962.837909537"
Jul 06 14:17:43.816392 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.816367    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:43.935596 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935562    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-envoy\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.935790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935613    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-certs\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.935790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935639    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e5d1b2-24c8-4292-a6eb-a22115743634-istiod-ca-cert\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.935790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935659    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-data\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.935790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935703    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-token\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.936023 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz5xj\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-kube-api-access-qz5xj\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.936023 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935896    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-podinfo\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.936023 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935931    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-credential-socket\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.936023 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935967    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-socket\") pod \"f3e5d1b2-24c8-4292-a6eb-a22115743634\" (UID: \"f3e5d1b2-24c8-4292-a6eb-a22115743634\") "
Jul 06 14:17:43.936023 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.935978    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:43.936341 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.936105    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e5d1b2-24c8-4292-a6eb-a22115743634-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:43.936445 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.936424    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:43.936512 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.936441    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:43.936512 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.936462    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3e5d1b2-24c8-4292-a6eb-a22115743634-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:43.936878 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.936852    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-data" (OuterVolumeSpecName: "istio-data") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:43.936965 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.936897    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:43.937958 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.937924    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-kube-api-access-qz5xj" (OuterVolumeSpecName: "kube-api-access-qz5xj") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "kube-api-access-qz5xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:43.937958 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.937929    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:43.938110 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.937988    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:43.938110 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:43.937996    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f3e5d1b2-24c8-4292-a6eb-a22115743634" (UID: "f3e5d1b2-24c8-4292-a6eb-a22115743634"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:17:44.037321 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.037287    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:44.037321 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.037316    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:44.037321 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.037325    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz5xj\" (UniqueName: \"kubernetes.io/projected/f3e5d1b2-24c8-4292-a6eb-a22115743634-kube-api-access-qz5xj\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:44.037561 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.037334    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:44.037561 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.037343    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:44.037561 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.037351    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:44.037561 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.037360    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3e5d1b2-24c8-4292-a6eb-a22115743634-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:17:44.068000 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.067969    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerID="05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b" exitCode=0
Jul 06 14:17:44.068156 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.068021    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"
Jul 06 14:17:44.068156 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.068053    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" event={"ID":"f3e5d1b2-24c8-4292-a6eb-a22115743634","Type":"ContainerDied","Data":"05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b"}
Jul 06 14:17:44.068156 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.068119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj" event={"ID":"f3e5d1b2-24c8-4292-a6eb-a22115743634","Type":"ContainerDied","Data":"ce39eaede903fc240035da7c4b10b66d56ec0d7e609e4fe734be3b9ff043818f"}
Jul 06 14:17:44.068156 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.068147    2572 scope.go:117] "RemoveContainer" containerID="05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b"
Jul 06 14:17:44.068501 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.068455    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:44.077366 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.077348    2572 scope.go:117] "RemoveContainer" containerID="5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37"
Jul 06 14:17:44.085413 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.085393    2572 scope.go:117] "RemoveContainer" containerID="05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b"
Jul 06 14:17:44.085678 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:44.085662    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b\": container with ID starting with 05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b not found: ID does not exist" containerID="05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b"
Jul 06 14:17:44.085723 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.085687    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b"} err="failed to get container status \"05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b\": rpc error: code = NotFound desc = could not find container \"05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b\": container with ID starting with 05324f4bc9c427bde75998ad9def37d4b0e4fc65b4fe26facd26eef0fd58074b not found: ID does not exist"
Jul 06 14:17:44.085723 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.085703    2572 scope.go:117] "RemoveContainer" containerID="5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37"
Jul 06 14:17:44.085935 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:44.085920    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37\": container with ID starting with 5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37 not found: ID does not exist" containerID="5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37"
Jul 06 14:17:44.085988 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.085937    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37"} err="failed to get container status \"5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37\": rpc error: code = NotFound desc = could not find container \"5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37\": container with ID starting with 5378b125559b98a58eab71a3af1f93a349aa0f0539b8018e3f9c16f784ae7c37 not found: ID does not exist"
Jul 06 14:17:44.089007 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.088986    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"]
Jul 06 14:17:44.093324 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.093304    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-db164d-openshift-default-597b8c9975-nfdbj"]
Jul 06 14:17:44.760959 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:44.760927    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" path="/var/lib/kubelet/pods/f3e5d1b2-24c8-4292-a6eb-a22115743634/volumes"
Jul 06 14:17:47.241707 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.241672    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"]
Jul 06 14:17:47.242287 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.242271    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy"
Jul 06 14:17:47.242347 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.242289    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy"
Jul 06 14:17:47.242347 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.242309    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy"
Jul 06 14:17:47.242347 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.242316    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy"
Jul 06 14:17:47.242433 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.242397    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy"
Jul 06 14:17:47.242433 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.242406    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3e5d1b2-24c8-4292-a6eb-a22115743634" containerName="istio-proxy"
Jul 06 14:17:47.247219 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.247185    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.259025 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.259007    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-74bb89-openshift-default-dockercfg-28wvs\""
Jul 06 14:17:47.295797 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.295764    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"]
Jul 06 14:17:47.390906 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.390864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-certs\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391179 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-socket\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391402 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391374    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-credential-socket\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-istio-token\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-data\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391532 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5twj6\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-kube-api-access-5twj6\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391715 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad173e52-0098-463e-b4bd-20f287af0e83-istio-podinfo\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391715 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391583    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-envoy\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.391715 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.391623    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad173e52-0098-463e-b4bd-20f287af0e83-istiod-ca-cert\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.492716 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492603    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-credential-socket\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.492716 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-istio-token\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.492716 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492712    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-data\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5twj6\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-kube-api-access-5twj6\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad173e52-0098-463e-b4bd-20f287af0e83-istio-podinfo\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-envoy\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492832    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad173e52-0098-463e-b4bd-20f287af0e83-istiod-ca-cert\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-certs\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493004 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.492933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-socket\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493332 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.493146    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-data\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493332 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.493270    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-socket\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493544 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.493499    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-certs\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493775 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.493752    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-credential-socket\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.493968 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.493943    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad173e52-0098-463e-b4bd-20f287af0e83-istiod-ca-cert\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.495615 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.495593    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-envoy\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.496106 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.496085    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad173e52-0098-463e-b4bd-20f287af0e83-istio-podinfo\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.500012 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.499985    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-istio-token\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.500394 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.500373    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5twj6\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-kube-api-access-5twj6\") pod \"e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") " pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.557933 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.557902    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:47.748994 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.748967    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"]
Jul 06 14:17:47.750809 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:17:47.750773    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad173e52_0098_463e_b4bd_20f287af0e83.slice/crio-8d0338156e909d93e9ca830685ad72ee0c4e0e5249b2fe0e80a6417eb81eff31 WatchSource:0}: Error finding container 8d0338156e909d93e9ca830685ad72ee0c4e0e5249b2fe0e80a6417eb81eff31: Status 404 returned error can't find the container with id 8d0338156e909d93e9ca830685ad72ee0c4e0e5249b2fe0e80a6417eb81eff31
Jul 06 14:17:47.752978 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.752947    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:47.753040 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.753017    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:47.753075 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:47.753048    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:48.106688 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:48.106647    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" event={"ID":"ad173e52-0098-463e-b4bd-20f287af0e83","Type":"ContainerStarted","Data":"8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903"}
Jul 06 14:17:48.106879 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:48.106716    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" event={"ID":"ad173e52-0098-463e-b4bd-20f287af0e83","Type":"ContainerStarted","Data":"8d0338156e909d93e9ca830685ad72ee0c4e0e5249b2fe0e80a6417eb81eff31"}
Jul 06 14:17:48.126698 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:48.126650    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" podStartSLOduration=1.126632167 podStartE2EDuration="1.126632167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:48.124911685 +0000 UTC m=+1967.884883607" watchObservedRunningTime="2026-07-06 14:17:48.126632167 +0000 UTC m=+1967.886604089"
Jul 06 14:17:48.558694 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:48.558599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:48.563713 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:48.563687    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:49.111356 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:49.111324    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:49.112465 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:49.112440    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:17:50.089770 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.089738    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:17:50.391325 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.391285    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"]
Jul 06 14:17:50.395227 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.395176    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.398581 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.398556    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-74bb89-serving-cert\""
Jul 06 14:17:50.411960 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.411935    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"]
Jul 06 14:17:50.416921 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.416894    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38b54df7-84cd-4fa1-837a-9c36680a3939-openshift-service-ca\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.417058 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.416972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.417058 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.416992    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mzf9\" (UniqueName: \"kubernetes.io/projected/38b54df7-84cd-4fa1-837a-9c36680a3939-kube-api-access-8mzf9\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.517609 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.517574    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.517609 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.517608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzf9\" (UniqueName: \"kubernetes.io/projected/38b54df7-84cd-4fa1-837a-9c36680a3939-kube-api-access-8mzf9\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.517853 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.517671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38b54df7-84cd-4fa1-837a-9c36680a3939-openshift-service-ca\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.517853 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:50.517735    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-74bb89-serving-cert: secret "maas-api-e2e-shared-b-74bb89-serving-cert" not found
Jul 06 14:17:50.517853 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:17:50.517812    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls podName:38b54df7-84cd-4fa1-837a-9c36680a3939 nodeName:}" failed. No retries permitted until 2026-07-06 14:17:51.017789713 +0000 UTC m=+1970.777761631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls") pod "maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" (UID: "38b54df7-84cd-4fa1-837a-9c36680a3939") : secret "maas-api-e2e-shared-b-74bb89-serving-cert" not found
Jul 06 14:17:50.518289 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.518272    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38b54df7-84cd-4fa1-837a-9c36680a3939-openshift-service-ca\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:50.528731 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:50.528709    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mzf9\" (UniqueName: \"kubernetes.io/projected/38b54df7-84cd-4fa1-837a-9c36680a3939-kube-api-access-8mzf9\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:51.022035 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:51.021996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:51.024781 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:51.024740    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls\") pod \"maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") " pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:51.307769 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:51.307662    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:51.488418 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:51.488384    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"]
Jul 06 14:17:51.489331 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:17:51.489304    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b54df7_84cd_4fa1_837a_9c36680a3939.slice/crio-11bb1b84f7d4699543168ab815d5163ad3ed1333f829c2c8cd53cbc867df14e8 WatchSource:0}: Error finding container 11bb1b84f7d4699543168ab815d5163ad3ed1333f829c2c8cd53cbc867df14e8: Status 404 returned error can't find the container with id 11bb1b84f7d4699543168ab815d5163ad3ed1333f829c2c8cd53cbc867df14e8
Jul 06 14:17:52.128656 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:52.128570    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" event={"ID":"38b54df7-84cd-4fa1-837a-9c36680a3939","Type":"ContainerStarted","Data":"d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0"}
Jul 06 14:17:52.128656 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:52.128631    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" event={"ID":"38b54df7-84cd-4fa1-837a-9c36680a3939","Type":"ContainerStarted","Data":"11bb1b84f7d4699543168ab815d5163ad3ed1333f829c2c8cd53cbc867df14e8"}
Jul 06 14:17:52.128882 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:52.128680    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:52.146536 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:52.146486    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" podStartSLOduration=1.714616068 podStartE2EDuration="2.146469557s" totalImagesPullingTime="431.853489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:52.145526646 +0000 UTC m=+1971.905498563" watchObservedRunningTime="2026-07-06 14:17:52.146469557 +0000 UTC m=+1971.906441478"
Jul 06 14:17:53.135491 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:53.135459    2572 generic.go:356] "Generic (PLEG): container finished" podID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerID="e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1" exitCode=0
Jul 06 14:17:53.135878 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:53.135529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" event={"ID":"3b786b9f-f360-4db3-b34e-14826c7daf75","Type":"ContainerDied","Data":"e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1"}
Jul 06 14:17:53.136021 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:53.136004    2572 scope.go:117] "RemoveContainer" containerID="e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1"
Jul 06 14:17:53.136941 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:53.136913    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:53.136995 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:53.136978    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:53.137030 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:53.137008    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:17:54.141754 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:54.141720    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" event={"ID":"3b786b9f-f360-4db3-b34e-14826c7daf75","Type":"ContainerStarted","Data":"a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57"}
Jul 06 14:17:54.767399 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:54.767362    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:54.768571 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:54.768545    2572 patch_prober.go:28] interesting pod/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 14:17:54.768776 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:54.768753    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 14:17:55.768620 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:55.768576    2572 patch_prober.go:28] interesting pod/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 14:17:55.769127 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:55.768641    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 14:17:56.050617 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:56.050514    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:56.767884 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:56.767841    2572 patch_prober.go:28] interesting pod/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 14:17:56.768133 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:56.767925    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 14:17:57.768047 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:57.768009    2572 patch_prober.go:28] interesting pod/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 14:17:57.768676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:57.768644    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 14:17:58.141669 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:58.141639    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:17:58.776792 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:58.776753    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:17:58.783052 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:17:58.783024    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:18:03.202949 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:03.202871    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad173e52-0098-463e-b4bd-20f287af0e83" containerID="8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903" exitCode=0
Jul 06 14:18:03.203366 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:03.202947    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" event={"ID":"ad173e52-0098-463e-b4bd-20f287af0e83","Type":"ContainerDied","Data":"8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903"}
Jul 06 14:18:03.203410 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:03.203363    2572 scope.go:117] "RemoveContainer" containerID="8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903"
Jul 06 14:18:03.204360 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:03.204330    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:18:03.204468 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:03.204392    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:18:03.204468 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:03.204422    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 14:18:04.111283 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:04.111237    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:18:04.209589 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:04.209549    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" event={"ID":"ad173e52-0098-463e-b4bd-20f287af0e83","Type":"ContainerStarted","Data":"9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b"}
Jul 06 14:18:04.558704 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:04.558576    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:18:04.560124 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:04.560098    2572 patch_prober.go:28] interesting pod/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 14:18:04.560280 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:04.560162    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 14:18:05.558528 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:05.558486    2572 patch_prober.go:28] interesting pod/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 14:18:05.559037 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:05.558546    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 14:18:06.558701 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:06.558661    2572 patch_prober.go:28] interesting pod/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 14:18:06.559101 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:06.558719    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 14:18:07.558479 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:07.558443    2572 patch_prober.go:28] interesting pod/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 14:18:07.558667 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:07.558496    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 14:18:08.563252 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:08.563197    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:18:08.563675 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:08.563556    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:18:08.564156 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:18:08.564134    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:21:04.484492 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.484459    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"]
Jul 06 14:21:04.487796 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.487773    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.490155 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.490134    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"sub-test-model-74bb89-kserve-self-signed-certs\""
Jul 06 14:21:04.490731 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.490704    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"openshift-service-ca.crt\""
Jul 06 14:21:04.490816 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.490729    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"kube-root-ca.crt\""
Jul 06 14:21:04.490893 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.490815    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-74bb89\"/\"default-dockercfg-6ql69\""
Jul 06 14:21:04.496054 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.496035    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"]
Jul 06 14:21:04.557740 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.557704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-model-cache\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.557740 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.557754    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-home\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.557982 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.557785    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daec47a-f660-403e-8d28-d77432270b55-tls-certs\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.557982 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.557831    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mppxv\" (UniqueName: \"kubernetes.io/projected/3daec47a-f660-403e-8d28-d77432270b55-kube-api-access-mppxv\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.557982 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.557870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-tmp-dir\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.557982 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.557908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-dshm\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.658520 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.658480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daec47a-f660-403e-8d28-d77432270b55-tls-certs\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.658520 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.658524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mppxv\" (UniqueName: \"kubernetes.io/projected/3daec47a-f660-403e-8d28-d77432270b55-kube-api-access-mppxv\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.658813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.658557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-tmp-dir\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.658813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.658598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-dshm\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.658813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.658641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-model-cache\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.658813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.658764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-home\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.659064 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.659044    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-model-cache\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.659120 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.659097    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-tmp-dir\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.659185 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.659169    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-home\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.660980 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.660960    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-dshm\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.661283 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.661264    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daec47a-f660-403e-8d28-d77432270b55-tls-certs\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.666760 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.666734    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mppxv\" (UniqueName: \"kubernetes.io/projected/3daec47a-f660-403e-8d28-d77432270b55-kube-api-access-mppxv\") pod \"sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") " pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.799065 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.798973    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:04.936898 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:04.936873    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"]
Jul 06 14:21:04.939529 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:21:04.939502    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3daec47a_f660_403e_8d28_d77432270b55.slice/crio-221056dc1f83e5c72697983cf36a597e40f7328cfaf158faf22a65942aaf57c3 WatchSource:0}: Error finding container 221056dc1f83e5c72697983cf36a597e40f7328cfaf158faf22a65942aaf57c3: Status 404 returned error can't find the container with id 221056dc1f83e5c72697983cf36a597e40f7328cfaf158faf22a65942aaf57c3
Jul 06 14:21:05.099725 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:05.099634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9" event={"ID":"3daec47a-f660-403e-8d28-d77432270b55","Type":"ContainerStarted","Data":"44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205"}
Jul 06 14:21:05.099725 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:05.099680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9" event={"ID":"3daec47a-f660-403e-8d28-d77432270b55","Type":"ContainerStarted","Data":"221056dc1f83e5c72697983cf36a597e40f7328cfaf158faf22a65942aaf57c3"}
Jul 06 14:21:05.115840 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:05.115788    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9" podStartSLOduration=1.115770706 podStartE2EDuration="1.115770706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:05.114578307 +0000 UTC m=+2164.874550229" watchObservedRunningTime="2026-07-06 14:21:05.115770706 +0000 UTC m=+2164.875742627"
Jul 06 14:21:14.799821 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:14.799781    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:14.800360 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:14.800034    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:14.812453 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:14.812425    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:15.159956 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:15.159928    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:21:54.799149 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:21:54.799111    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"]
Jul 06 14:22:09.819381 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:09.819333    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9" podUID="3daec47a-f660-403e-8d28-d77432270b55" containerName="main" containerID="cri-o://44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205" gracePeriod=45
Jul 06 14:22:10.068798 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.068774    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:22:10.181804 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.181770    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daec47a-f660-403e-8d28-d77432270b55-tls-certs\") pod \"3daec47a-f660-403e-8d28-d77432270b55\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") "
Jul 06 14:22:10.181804 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.181821    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-home\") pod \"3daec47a-f660-403e-8d28-d77432270b55\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") "
Jul 06 14:22:10.182035 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.181858    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-tmp-dir\") pod \"3daec47a-f660-403e-8d28-d77432270b55\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") "
Jul 06 14:22:10.182035 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.181883    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-model-cache\") pod \"3daec47a-f660-403e-8d28-d77432270b55\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") "
Jul 06 14:22:10.182035 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.181949    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-dshm\") pod \"3daec47a-f660-403e-8d28-d77432270b55\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") "
Jul 06 14:22:10.182035 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.181979    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mppxv\" (UniqueName: \"kubernetes.io/projected/3daec47a-f660-403e-8d28-d77432270b55-kube-api-access-mppxv\") pod \"3daec47a-f660-403e-8d28-d77432270b55\" (UID: \"3daec47a-f660-403e-8d28-d77432270b55\") "
Jul 06 14:22:10.182299 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.182103    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3daec47a-f660-403e-8d28-d77432270b55" (UID: "3daec47a-f660-403e-8d28-d77432270b55"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:10.182299 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.182141    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-home" (OuterVolumeSpecName: "home") pod "3daec47a-f660-403e-8d28-d77432270b55" (UID: "3daec47a-f660-403e-8d28-d77432270b55"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:10.182299 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.182180    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-model-cache" (OuterVolumeSpecName: "model-cache") pod "3daec47a-f660-403e-8d28-d77432270b55" (UID: "3daec47a-f660-403e-8d28-d77432270b55"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:10.182299 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.182297    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-model-cache\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:22:10.182456 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.182315    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-home\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:22:10.182456 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.182324    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-tmp-dir\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:22:10.184173 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.184145    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3daec47a-f660-403e-8d28-d77432270b55-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3daec47a-f660-403e-8d28-d77432270b55" (UID: "3daec47a-f660-403e-8d28-d77432270b55"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:10.184327 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.184153    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-dshm" (OuterVolumeSpecName: "dshm") pod "3daec47a-f660-403e-8d28-d77432270b55" (UID: "3daec47a-f660-403e-8d28-d77432270b55"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:10.184327 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.184181    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3daec47a-f660-403e-8d28-d77432270b55-kube-api-access-mppxv" (OuterVolumeSpecName: "kube-api-access-mppxv") pod "3daec47a-f660-403e-8d28-d77432270b55" (UID: "3daec47a-f660-403e-8d28-d77432270b55"). InnerVolumeSpecName "kube-api-access-mppxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:22:10.283791 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.283749    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daec47a-f660-403e-8d28-d77432270b55-dshm\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:22:10.283791 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.283786    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mppxv\" (UniqueName: \"kubernetes.io/projected/3daec47a-f660-403e-8d28-d77432270b55-kube-api-access-mppxv\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:22:10.283791 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.283796    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daec47a-f660-403e-8d28-d77432270b55-tls-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:22:10.424510 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.424474    2572 generic.go:356] "Generic (PLEG): container finished" podID="3daec47a-f660-403e-8d28-d77432270b55" containerID="44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205" exitCode=0
Jul 06 14:22:10.424676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.424518    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"
Jul 06 14:22:10.424676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.424562    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9" event={"ID":"3daec47a-f660-403e-8d28-d77432270b55","Type":"ContainerDied","Data":"44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205"}
Jul 06 14:22:10.424676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.424607    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9" event={"ID":"3daec47a-f660-403e-8d28-d77432270b55","Type":"ContainerDied","Data":"221056dc1f83e5c72697983cf36a597e40f7328cfaf158faf22a65942aaf57c3"}
Jul 06 14:22:10.424676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.424626    2572 scope.go:117] "RemoveContainer" containerID="44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205"
Jul 06 14:22:10.433914 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.433896    2572 scope.go:117] "RemoveContainer" containerID="44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205"
Jul 06 14:22:10.434176 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:22:10.434156    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205\": container with ID starting with 44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205 not found: ID does not exist" containerID="44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205"
Jul 06 14:22:10.434232 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.434186    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205"} err="failed to get container status \"44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205\": rpc error: code = NotFound desc = could not find container \"44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205\": container with ID starting with 44895bbeeded13b0acb0bcb27cede0938933276b78423154479efd5e07091205 not found: ID does not exist"
Jul 06 14:22:10.444823 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.444801    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"]
Jul 06 14:22:10.450259 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.450239    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-74bb89/sub-test-model-74bb89-kserve-7bccbfc5bc-djzl9"]
Jul 06 14:22:10.762079 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:22:10.761996    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3daec47a-f660-403e-8d28-d77432270b55" path="/var/lib/kubelet/pods/3daec47a-f660-403e-8d28-d77432270b55/volumes"
Jul 06 14:23:29.501336 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:29.501302    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"]
Jul 06 14:23:29.504009 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:29.501512    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf" podUID="1cc9ae7b-d358-49be-80b9-de079098a5ed" containerName="maas-api" containerID="cri-o://3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5" gracePeriod=30
Jul 06 14:23:29.944451 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:29.944426    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:23:30.022184 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.022154    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cc9ae7b-d358-49be-80b9-de079098a5ed-maas-api-tls\") pod \"1cc9ae7b-d358-49be-80b9-de079098a5ed\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") "
Jul 06 14:23:30.022387 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.022238    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc9ae7b-d358-49be-80b9-de079098a5ed-openshift-service-ca\") pod \"1cc9ae7b-d358-49be-80b9-de079098a5ed\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") "
Jul 06 14:23:30.022387 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.022334    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czdzq\" (UniqueName: \"kubernetes.io/projected/1cc9ae7b-d358-49be-80b9-de079098a5ed-kube-api-access-czdzq\") pod \"1cc9ae7b-d358-49be-80b9-de079098a5ed\" (UID: \"1cc9ae7b-d358-49be-80b9-de079098a5ed\") "
Jul 06 14:23:30.022590 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.022567    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc9ae7b-d358-49be-80b9-de079098a5ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1cc9ae7b-d358-49be-80b9-de079098a5ed" (UID: "1cc9ae7b-d358-49be-80b9-de079098a5ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:23:30.024204 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.024183    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cc9ae7b-d358-49be-80b9-de079098a5ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1cc9ae7b-d358-49be-80b9-de079098a5ed" (UID: "1cc9ae7b-d358-49be-80b9-de079098a5ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:23:30.024311 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.024294    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc9ae7b-d358-49be-80b9-de079098a5ed-kube-api-access-czdzq" (OuterVolumeSpecName: "kube-api-access-czdzq") pod "1cc9ae7b-d358-49be-80b9-de079098a5ed" (UID: "1cc9ae7b-d358-49be-80b9-de079098a5ed"). InnerVolumeSpecName "kube-api-access-czdzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:23:30.123333 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.123304    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czdzq\" (UniqueName: \"kubernetes.io/projected/1cc9ae7b-d358-49be-80b9-de079098a5ed-kube-api-access-czdzq\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:23:30.123333 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.123327    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cc9ae7b-d358-49be-80b9-de079098a5ed-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:23:30.123333 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.123337    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc9ae7b-d358-49be-80b9-de079098a5ed-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:23:30.813012 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.812974    2572 generic.go:356] "Generic (PLEG): container finished" podID="1cc9ae7b-d358-49be-80b9-de079098a5ed" containerID="3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5" exitCode=0
Jul 06 14:23:30.813012 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.813008    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"
Jul 06 14:23:30.813518 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.813020    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf" event={"ID":"1cc9ae7b-d358-49be-80b9-de079098a5ed","Type":"ContainerDied","Data":"3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5"}
Jul 06 14:23:30.813518 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.813064    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf" event={"ID":"1cc9ae7b-d358-49be-80b9-de079098a5ed","Type":"ContainerDied","Data":"e2e4efc6c39fc385ad41d50c919ac6ea57d05ffc3c73220d0eae36d7640f6441"}
Jul 06 14:23:30.813518 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.813090    2572 scope.go:117] "RemoveContainer" containerID="3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5"
Jul 06 14:23:30.821902 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.821882    2572 scope.go:117] "RemoveContainer" containerID="3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5"
Jul 06 14:23:30.822152 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:23:30.822133    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5\": container with ID starting with 3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5 not found: ID does not exist" containerID="3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5"
Jul 06 14:23:30.822223 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.822166    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5"} err="failed to get container status \"3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5\": rpc error: code = NotFound desc = could not find container \"3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5\": container with ID starting with 3dba8d6f0eb8a3e6fbb682ef0c987d2cd44ae7676910b6e22f77698447a68cf5 not found: ID does not exist"
Jul 06 14:23:30.827940 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.827914    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"]
Jul 06 14:23:30.831679 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:30.831660    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0ba2b8-76654d664-lpkvf"]
Jul 06 14:23:32.761726 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:23:32.761691    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc9ae7b-d358-49be-80b9-de079098a5ed" path="/var/lib/kubelet/pods/1cc9ae7b-d358-49be-80b9-de079098a5ed/volumes"
Jul 06 14:24:11.727947 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:11.727910    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"]
Jul 06 14:24:11.728404 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:11.728235    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy" containerID="cri-o://a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57" gracePeriod=30
Jul 06 14:24:13.035397 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.035359    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"]
Jul 06 14:24:13.035838 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.035605    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" podUID="38b54df7-84cd-4fa1-837a-9c36680a3939" containerName="maas-api" containerID="cri-o://d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0" gracePeriod=30
Jul 06 14:24:13.136956 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.136911    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" podUID="38b54df7-84cd-4fa1-837a-9c36680a3939" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.57:8443/health\": dial tcp 10.133.0.57:8443: connect: connection refused"
Jul 06 14:24:13.486840 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.486819    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:24:13.523184 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.523164    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls\") pod \"38b54df7-84cd-4fa1-837a-9c36680a3939\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") "
Jul 06 14:24:13.523316 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.523204    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mzf9\" (UniqueName: \"kubernetes.io/projected/38b54df7-84cd-4fa1-837a-9c36680a3939-kube-api-access-8mzf9\") pod \"38b54df7-84cd-4fa1-837a-9c36680a3939\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") "
Jul 06 14:24:13.523316 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.523269    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38b54df7-84cd-4fa1-837a-9c36680a3939-openshift-service-ca\") pod \"38b54df7-84cd-4fa1-837a-9c36680a3939\" (UID: \"38b54df7-84cd-4fa1-837a-9c36680a3939\") "
Jul 06 14:24:13.523749 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.523718    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38b54df7-84cd-4fa1-837a-9c36680a3939-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38b54df7-84cd-4fa1-837a-9c36680a3939" (UID: "38b54df7-84cd-4fa1-837a-9c36680a3939"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:13.525277 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.525248    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38b54df7-84cd-4fa1-837a-9c36680a3939" (UID: "38b54df7-84cd-4fa1-837a-9c36680a3939"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:24:13.525377 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.525329    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b54df7-84cd-4fa1-837a-9c36680a3939-kube-api-access-8mzf9" (OuterVolumeSpecName: "kube-api-access-8mzf9") pod "38b54df7-84cd-4fa1-837a-9c36680a3939" (UID: "38b54df7-84cd-4fa1-837a-9c36680a3939"). InnerVolumeSpecName "kube-api-access-8mzf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:13.624510 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.624484    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38b54df7-84cd-4fa1-837a-9c36680a3939-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:13.624510 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.624509    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mzf9\" (UniqueName: \"kubernetes.io/projected/38b54df7-84cd-4fa1-837a-9c36680a3939-kube-api-access-8mzf9\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:13.624673 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.624518    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38b54df7-84cd-4fa1-837a-9c36680a3939-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:13.779662 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.779624    2572 patch_prober.go:28] interesting pod/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:24:13.779817 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:13.779695    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:24:14.021443 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.021356    2572 generic.go:356] "Generic (PLEG): container finished" podID="38b54df7-84cd-4fa1-837a-9c36680a3939" containerID="d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0" exitCode=0
Jul 06 14:24:14.021443 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.021402    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"
Jul 06 14:24:14.021443 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.021433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" event={"ID":"38b54df7-84cd-4fa1-837a-9c36680a3939","Type":"ContainerDied","Data":"d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0"}
Jul 06 14:24:14.021670 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.021484    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs" event={"ID":"38b54df7-84cd-4fa1-837a-9c36680a3939","Type":"ContainerDied","Data":"11bb1b84f7d4699543168ab815d5163ad3ed1333f829c2c8cd53cbc867df14e8"}
Jul 06 14:24:14.021670 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.021506    2572 scope.go:117] "RemoveContainer" containerID="d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0"
Jul 06 14:24:14.030941 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.030924    2572 scope.go:117] "RemoveContainer" containerID="d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0"
Jul 06 14:24:14.031201 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:24:14.031183    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0\": container with ID starting with d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0 not found: ID does not exist" containerID="d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0"
Jul 06 14:24:14.031276 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.031227    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0"} err="failed to get container status \"d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0\": rpc error: code = NotFound desc = could not find container \"d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0\": container with ID starting with d46a644a189c7ebc32f37ab6a1599b1fc51f2181bc2d85be404a00de4b2749f0 not found: ID does not exist"
Jul 06 14:24:14.042329 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.042282    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"]
Jul 06 14:24:14.044099 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.044081    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-74bb89-55d7678956-7xqjs"]
Jul 06 14:24:14.761622 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:14.761586    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38b54df7-84cd-4fa1-837a-9c36680a3939" path="/var/lib/kubelet/pods/38b54df7-84cd-4fa1-837a-9c36680a3939/volumes"
Jul 06 14:24:16.988444 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:16.988383    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:24:17.039644 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.039608    2572 generic.go:356] "Generic (PLEG): container finished" podID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerID="a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57" exitCode=0
Jul 06 14:24:17.039813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.039657    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"
Jul 06 14:24:17.039813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.039693    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" event={"ID":"3b786b9f-f360-4db3-b34e-14826c7daf75","Type":"ContainerDied","Data":"a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57"}
Jul 06 14:24:17.039813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.039748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt" event={"ID":"3b786b9f-f360-4db3-b34e-14826c7daf75","Type":"ContainerDied","Data":"ad8722f5d834dd3190d20076f10a10fb67a805b5750faa71dd653f00220e451d"}
Jul 06 14:24:17.039813 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.039771    2572 scope.go:117] "RemoveContainer" containerID="a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57"
Jul 06 14:24:17.048614 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.048597    2572 scope.go:117] "RemoveContainer" containerID="e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1"
Jul 06 14:24:17.051854 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.051829    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-data\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.051943 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.051920    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-certs\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.051994 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.051953    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-podinfo\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.051994 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.051984    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-token\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.052128 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052103    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-socket\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.052273 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052142    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-credential-socket\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.052273 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052202    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:17.052273 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052244    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b786b9f-f360-4db3-b34e-14826c7daf75-istiod-ca-cert\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.052459 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052287    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22rwc\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-kube-api-access-22rwc\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.052459 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052350    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-envoy\") pod \"3b786b9f-f360-4db3-b34e-14826c7daf75\" (UID: \"3b786b9f-f360-4db3-b34e-14826c7daf75\") "
Jul 06 14:24:17.052459 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052390    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:17.052632 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052461    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:17.052688 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052631    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b786b9f-f360-4db3-b34e-14826c7daf75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:17.052743 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052718    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b786b9f-f360-4db3-b34e-14826c7daf75-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.052743 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052735    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.052854 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052748    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.052854 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052760    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.053011 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.052970    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:17.054513 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.054489    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:24:17.054680 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.054662    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-kube-api-access-22rwc" (OuterVolumeSpecName: "kube-api-access-22rwc") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "kube-api-access-22rwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:17.054836 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.054820    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:17.054908 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.054878    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b786b9f-f360-4db3-b34e-14826c7daf75" (UID: "3b786b9f-f360-4db3-b34e-14826c7daf75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:17.057425 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.057409    2572 scope.go:117] "RemoveContainer" containerID="a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57"
Jul 06 14:24:17.057707 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:24:17.057688    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57\": container with ID starting with a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57 not found: ID does not exist" containerID="a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57"
Jul 06 14:24:17.057787 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.057714    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57"} err="failed to get container status \"a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57\": rpc error: code = NotFound desc = could not find container \"a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57\": container with ID starting with a674ca6f2c35c0a66ddac5568ad58c30d5a228707136d9343479d017fbee1a57 not found: ID does not exist"
Jul 06 14:24:17.057787 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.057732    2572 scope.go:117] "RemoveContainer" containerID="e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1"
Jul 06 14:24:17.058005 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:24:17.057983    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1\": container with ID starting with e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1 not found: ID does not exist" containerID="e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1"
Jul 06 14:24:17.058070 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.058009    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1"} err="failed to get container status \"e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1\": rpc error: code = NotFound desc = could not find container \"e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1\": container with ID starting with e61f20c4eff94b7db5e7b4ef804393b4c51f62e0fbf9bf945e2bcf0f32c74bc1 not found: ID does not exist"
Jul 06 14:24:17.153603 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.153570    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.153603 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.153596    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.153603 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.153605    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.153603 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.153612    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22rwc\" (UniqueName: \"kubernetes.io/projected/3b786b9f-f360-4db3-b34e-14826c7daf75-kube-api-access-22rwc\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.153873 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.153622    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b786b9f-f360-4db3-b34e-14826c7daf75-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:17.370787 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.370749    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"]
Jul 06 14:24:17.375451 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:17.375426    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0ba2b8-openshift-default-7bb97c8c5-cmslt"]
Jul 06 14:24:18.761980 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:18.761945    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" path="/var/lib/kubelet/pods/3b786b9f-f360-4db3-b34e-14826c7daf75/volumes"
Jul 06 14:24:18.807516 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:18.807481    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"]
Jul 06 14:24:18.807740 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:18.807698    2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy" containerID="cri-o://9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b" gracePeriod=30
Jul 06 14:24:23.565816 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:23.565776    2572 patch_prober.go:28] interesting pod/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:24:23.566257 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:23.565838    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:24:24.059269 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.059241    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:24:24.078616 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.078537    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad173e52-0098-463e-b4bd-20f287af0e83" containerID="9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b" exitCode=0
Jul 06 14:24:24.078616 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.078580    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"
Jul 06 14:24:24.078801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.078619    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" event={"ID":"ad173e52-0098-463e-b4bd-20f287af0e83","Type":"ContainerDied","Data":"9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b"}
Jul 06 14:24:24.078801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.078697    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22" event={"ID":"ad173e52-0098-463e-b4bd-20f287af0e83","Type":"ContainerDied","Data":"8d0338156e909d93e9ca830685ad72ee0c4e0e5249b2fe0e80a6417eb81eff31"}
Jul 06 14:24:24.078801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.078729    2572 scope.go:117] "RemoveContainer" containerID="9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b"
Jul 06 14:24:24.087643 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.087617    2572 scope.go:117] "RemoveContainer" containerID="8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903"
Jul 06 14:24:24.095526 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.095506    2572 scope.go:117] "RemoveContainer" containerID="9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b"
Jul 06 14:24:24.095814 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:24:24.095786    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b\": container with ID starting with 9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b not found: ID does not exist" containerID="9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b"
Jul 06 14:24:24.095909 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.095821    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b"} err="failed to get container status \"9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b\": rpc error: code = NotFound desc = could not find container \"9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b\": container with ID starting with 9b1128f7ba2170bb8e5621ce1e7f6e06a10bd53df18d460dcc8d86ff05cfb53b not found: ID does not exist"
Jul 06 14:24:24.095909 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.095839    2572 scope.go:117] "RemoveContainer" containerID="8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903"
Jul 06 14:24:24.096087 ip-10-0-142-56 kubenswrapper[2572]: E0706 14:24:24.096072    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903\": container with ID starting with 8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903 not found: ID does not exist" containerID="8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903"
Jul 06 14:24:24.096134 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.096092    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903"} err="failed to get container status \"8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903\": rpc error: code = NotFound desc = could not find container \"8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903\": container with ID starting with 8d5d8e21dd61c48370baea6ab6eb9850e937b77d4fda661f0e433da7a998c903 not found: ID does not exist"
Jul 06 14:24:24.120735 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.120707    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad173e52-0098-463e-b4bd-20f287af0e83-istio-podinfo\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.120864 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.120751    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-certs\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.120864 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.120810    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-envoy\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.120864 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.120842    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-credential-socket\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.121018 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.120874    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-socket\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.121018 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.120927    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-data\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.121018 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121007    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-istio-token\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.121165 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121042    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5twj6\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-kube-api-access-5twj6\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.121165 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121095    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad173e52-0098-463e-b4bd-20f287af0e83-istiod-ca-cert\") pod \"ad173e52-0098-463e-b4bd-20f287af0e83\" (UID: \"ad173e52-0098-463e-b4bd-20f287af0e83\") "
Jul 06 14:24:24.121165 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121148    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:24.121361 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121255    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:24.121361 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121156    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:24.121528 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121505    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.121528 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121529    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-credential-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.121528 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121544    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-workload-socket\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.121815 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.121723    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad173e52-0098-463e-b4bd-20f287af0e83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:24:24.122121 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.122086    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:24.123093 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.123067    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad173e52-0098-463e-b4bd-20f287af0e83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:24:24.123093 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.123087    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:24:24.123236 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.123185    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:24.123319 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.123301    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-kube-api-access-5twj6" (OuterVolumeSpecName: "kube-api-access-5twj6") pod "ad173e52-0098-463e-b4bd-20f287af0e83" (UID: "ad173e52-0098-463e-b4bd-20f287af0e83"). InnerVolumeSpecName "kube-api-access-5twj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:24:24.222801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.222761    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5twj6\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-kube-api-access-5twj6\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.222801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.222798    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad173e52-0098-463e-b4bd-20f287af0e83-istiod-ca-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.222801 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.222807    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad173e52-0098-463e-b4bd-20f287af0e83-istio-podinfo\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.223034 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.222815    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-envoy\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.223034 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.222823    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad173e52-0098-463e-b4bd-20f287af0e83-istio-data\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.223034 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.222830    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad173e52-0098-463e-b4bd-20f287af0e83-istio-token\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 06 14:24:24.400331 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.400303    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"]
Jul 06 14:24:24.404939 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.404914    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-74bb89-openshift-default-59b5c65b7f-27h22"]
Jul 06 14:24:24.762122 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.762029    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" path="/var/lib/kubelet/pods/ad173e52-0098-463e-b4bd-20f287af0e83/volumes"
Jul 06 14:24:24.785177 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:24.785147    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722455-vv9c5_e6df76a0-4c07-4f8c-8d25-ab5f87ec8463/cleanup/0.log"
Jul 06 14:24:25.453727 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:25.453697    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz_27381896-1a78-47a0-8454-ac90d0d147e3/copy-manifests/0.log"
Jul 06 14:24:25.460437 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:25.460413    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz_27381896-1a78-47a0-8454-ac90d0d147e3/manager/0.log"
Jul 06 14:24:27.406410 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:27.406381    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fgdj8_3a6779c3-2992-413b-ae80-cbddb9bf4e59/manager/0.log"
Jul 06 14:24:27.520318 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:27.520290    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nc2nc_1b22ddb6-259e-4f6e-803c-e3ab603b7f14/kuadrant-console-plugin/0.log"
Jul 06 14:24:28.761978 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:28.761950    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-db7ct_2f8fd633-a81e-4760-ae50-cc6cc651c3ae/kube-auth-proxy/0.log"
Jul 06 14:24:29.287573 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:29.287539    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdd585c59-zvlkt_522fe905-1d95-4dbe-ae5c-10ccf3291968/router/0.log"
Jul 06 14:24:29.782762 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:29.782729    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fhsgg_207042dd-c6e6-498b-87c8-a8e45dec6deb/main/0.log"
Jul 06 14:24:30.028061 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:30.028015    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzgt2x_afe4b32e-9eac-4f1e-95c3-bb62f6d7f6e4/main/0.log"
Jul 06 14:24:30.265464 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:30.265431    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-9w8kq_2f5c0fb2-0bc9-4dbf-8df4-3113f9f2767b/main/0.log"
Jul 06 14:24:34.152251 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152202    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7nz7d/must-gather-bkfls"]
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152557    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b54df7-84cd-4fa1-837a-9c36680a3939" containerName="maas-api"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152567    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b54df7-84cd-4fa1-837a-9c36680a3939" containerName="maas-api"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152579    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3daec47a-f660-403e-8d28-d77432270b55" containerName="main"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152584    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3daec47a-f660-403e-8d28-d77432270b55" containerName="main"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152597    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152604    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152613    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152618    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152629    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152634    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152641    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152646    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152654    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc9ae7b-d358-49be-80b9-de079098a5ed" containerName="maas-api"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152659    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc9ae7b-d358-49be-80b9-de079098a5ed" containerName="maas-api"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152714    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152722    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy"
Jul 06 14:24:34.152721 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152728    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b786b9f-f360-4db3-b34e-14826c7daf75" containerName="istio-proxy"
Jul 06 14:24:34.153255 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152735    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc9ae7b-d358-49be-80b9-de079098a5ed" containerName="maas-api"
Jul 06 14:24:34.153255 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152742    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b54df7-84cd-4fa1-837a-9c36680a3939" containerName="maas-api"
Jul 06 14:24:34.153255 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152747    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3daec47a-f660-403e-8d28-d77432270b55" containerName="main"
Jul 06 14:24:34.153255 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.152847    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad173e52-0098-463e-b4bd-20f287af0e83" containerName="istio-proxy"
Jul 06 14:24:34.157407 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.157384    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.160054 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.160033    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nz7d\"/\"kube-root-ca.crt\""
Jul 06 14:24:34.160676 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.160656    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7nz7d\"/\"default-dockercfg-hxwfj\""
Jul 06 14:24:34.160794 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.160656    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nz7d\"/\"openshift-service-ca.crt\""
Jul 06 14:24:34.166662 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.166639    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/must-gather-bkfls"]
Jul 06 14:24:34.313931 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.313889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a49aec8d-b27a-4c66-ba93-303f4bbbcbfd-must-gather-output\") pod \"must-gather-bkfls\" (UID: \"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd\") " pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.314122 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.313960    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjwbz\" (UniqueName: \"kubernetes.io/projected/a49aec8d-b27a-4c66-ba93-303f4bbbcbfd-kube-api-access-zjwbz\") pod \"must-gather-bkfls\" (UID: \"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd\") " pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.415123 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.415025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a49aec8d-b27a-4c66-ba93-303f4bbbcbfd-must-gather-output\") pod \"must-gather-bkfls\" (UID: \"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd\") " pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.415123 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.415087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjwbz\" (UniqueName: \"kubernetes.io/projected/a49aec8d-b27a-4c66-ba93-303f4bbbcbfd-kube-api-access-zjwbz\") pod \"must-gather-bkfls\" (UID: \"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd\") " pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.415476 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.415453    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a49aec8d-b27a-4c66-ba93-303f4bbbcbfd-must-gather-output\") pod \"must-gather-bkfls\" (UID: \"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd\") " pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.424765 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.424736    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjwbz\" (UniqueName: \"kubernetes.io/projected/a49aec8d-b27a-4c66-ba93-303f4bbbcbfd-kube-api-access-zjwbz\") pod \"must-gather-bkfls\" (UID: \"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd\") " pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.467849 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.467810    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/must-gather-bkfls"
Jul 06 14:24:34.598199 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.598110    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/must-gather-bkfls"]
Jul 06 14:24:34.600979 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:24:34.600956    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda49aec8d_b27a_4c66_ba93_303f4bbbcbfd.slice/crio-fdb6ae415b84bcbbcc9d160f3325c5f3c81c2a42bce4959d228693717c582286 WatchSource:0}: Error finding container fdb6ae415b84bcbbcc9d160f3325c5f3c81c2a42bce4959d228693717c582286: Status 404 returned error can't find the container with id fdb6ae415b84bcbbcc9d160f3325c5f3c81c2a42bce4959d228693717c582286
Jul 06 14:24:34.602703 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:34.602689    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:24:35.133372 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:35.133340    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/must-gather-bkfls" event={"ID":"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd","Type":"ContainerStarted","Data":"fdb6ae415b84bcbbcc9d160f3325c5f3c81c2a42bce4959d228693717c582286"}
Jul 06 14:24:36.142287 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:36.142239    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/must-gather-bkfls" event={"ID":"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd","Type":"ContainerStarted","Data":"3d6370e4abdf11b860a456d9d6a61b9b15a9a00ad9a5e9bef1f533b6a981e88d"}
Jul 06 14:24:36.142766 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:36.142300    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/must-gather-bkfls" event={"ID":"a49aec8d-b27a-4c66-ba93-303f4bbbcbfd","Type":"ContainerStarted","Data":"11540289f5d7f88a186c7dcbff4c864090ad3879e45a3b8c2cdd9769a3e7c42e"}
Jul 06 14:24:36.158041 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:36.157984    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7nz7d/must-gather-bkfls" podStartSLOduration=1.163715876 podStartE2EDuration="2.157964286s" totalImagesPullingTime="994.24841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:36.156718841 +0000 UTC m=+2375.916690763" watchObservedRunningTime="2026-07-06 14:24:36.157964286 +0000 UTC m=+2375.917936210"
Jul 06 14:24:37.187153 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:37.187117    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5dktc_b7ea257d-bd74-4818-8bfd-42784778a617/global-pull-secret-syncer/0.log"
Jul 06 14:24:37.408725 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:37.408696    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tg8s4_c4da1556-1259-4b19-918f-5fbf29dacc74/konnectivity-agent/0.log"
Jul 06 14:24:37.509139 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:37.509061    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-56.ec2.internal_ab9d31aec28a733c64bba49d46efd8ad/haproxy/0.log"
Jul 06 14:24:42.695732 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:42.695693    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fgdj8_3a6779c3-2992-413b-ae80-cbddb9bf4e59/manager/0.log"
Jul 06 14:24:42.727016 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:42.726966    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nc2nc_1b22ddb6-259e-4f6e-803c-e3ab603b7f14/kuadrant-console-plugin/0.log"
Jul 06 14:24:45.223252 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.223190    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-r2mwx_d1f91cca-eb43-4472-8e11-08164f8969b7/monitoring-plugin/0.log"
Jul 06 14:24:45.258737 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.258708    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jj6bz_e70da61f-78e0-45cf-a1bb-00ca7ca53d9c/node-exporter/0.log"
Jul 06 14:24:45.285146 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.285095    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jj6bz_e70da61f-78e0-45cf-a1bb-00ca7ca53d9c/kube-rbac-proxy/0.log"
Jul 06 14:24:45.310790 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.310756    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jj6bz_e70da61f-78e0-45cf-a1bb-00ca7ca53d9c/init-textfile/0.log"
Jul 06 14:24:45.518723 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.518617    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xwtqn_a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5/kube-rbac-proxy-main/0.log"
Jul 06 14:24:45.543516 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.543485    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xwtqn_a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5/kube-rbac-proxy-self/0.log"
Jul 06 14:24:45.567611 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.567577    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xwtqn_a22c8fb3-66a5-426d-ab8e-05f1e6a82dc5/openshift-state-metrics/0.log"
Jul 06 14:24:45.607827 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.607796    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e046101-b5c0-4329-ab2f-9568b2302867/prometheus/0.log"
Jul 06 14:24:45.633771 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.633743    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e046101-b5c0-4329-ab2f-9568b2302867/config-reloader/0.log"
Jul 06 14:24:45.667489 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.667461    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e046101-b5c0-4329-ab2f-9568b2302867/thanos-sidecar/0.log"
Jul 06 14:24:45.693548 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.693511    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e046101-b5c0-4329-ab2f-9568b2302867/kube-rbac-proxy-web/0.log"
Jul 06 14:24:45.718990 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.718958    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e046101-b5c0-4329-ab2f-9568b2302867/kube-rbac-proxy/0.log"
Jul 06 14:24:45.744044 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.744012    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e046101-b5c0-4329-ab2f-9568b2302867/kube-rbac-proxy-thanos/0.log"
Jul 06 14:24:45.769282 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.769177    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e046101-b5c0-4329-ab2f-9568b2302867/init-config-reloader/0.log"
Jul 06 14:24:45.801165 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.801137    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-jkr6g_7281c6e9-0000-4150-b5ae-04c6fd221837/prometheus-operator/0.log"
Jul 06 14:24:45.825074 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.825038    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-jkr6g_7281c6e9-0000-4150-b5ae-04c6fd221837/kube-rbac-proxy/0.log"
Jul 06 14:24:45.854346 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.854319    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-9hvb9_642d0903-f997-4204-9061-d1a2edc6d777/prometheus-operator-admission-webhook/0.log"
Jul 06 14:24:45.969673 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:45.969647    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569c5cddf8-6595n_a942bbe0-8c6e-4c52-898d-0f92821c28c4/thanos-query/0.log"
Jul 06 14:24:46.003926 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:46.003882    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569c5cddf8-6595n_a942bbe0-8c6e-4c52-898d-0f92821c28c4/kube-rbac-proxy-web/0.log"
Jul 06 14:24:46.028033 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:46.027885    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569c5cddf8-6595n_a942bbe0-8c6e-4c52-898d-0f92821c28c4/kube-rbac-proxy/0.log"
Jul 06 14:24:46.074201 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:46.074169    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569c5cddf8-6595n_a942bbe0-8c6e-4c52-898d-0f92821c28c4/prom-label-proxy/0.log"
Jul 06 14:24:46.101776 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:46.101749    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569c5cddf8-6595n_a942bbe0-8c6e-4c52-898d-0f92821c28c4/kube-rbac-proxy-rules/0.log"
Jul 06 14:24:46.125795 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:46.125770    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569c5cddf8-6595n_a942bbe0-8c6e-4c52-898d-0f92821c28c4/kube-rbac-proxy-metrics/0.log"
Jul 06 14:24:47.195489 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.195449    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"]
Jul 06 14:24:47.206350 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.206316    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"]
Jul 06 14:24:47.206534 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.206443    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.256592 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.256551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-podres\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.256933 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.256910    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjksl\" (UniqueName: \"kubernetes.io/projected/97657673-163c-4a78-9855-e60b6fb48376-kube-api-access-xjksl\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.257147 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.257133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-lib-modules\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.257321 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.257305    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-proc\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.257489 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.257476    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-sys\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.287491 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.287458    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-n9w2t_2dd486b4-13eb-4ceb-b8ab-70ee424ea253/networking-console-plugin/0.log"
Jul 06 14:24:47.358416 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.358364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-lib-modules\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.358701 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.358675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-proc\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.358896 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.358860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-sys\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.359023 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.358994    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-lib-modules\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.359169 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.359151    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-podres\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.359251 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.359232    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-sys\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.359319 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.359249    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-proc\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.359319 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.359025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97657673-163c-4a78-9855-e60b6fb48376-podres\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.359429 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.359365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjksl\" (UniqueName: \"kubernetes.io/projected/97657673-163c-4a78-9855-e60b6fb48376-kube-api-access-xjksl\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.367514 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.367488    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjksl\" (UniqueName: \"kubernetes.io/projected/97657673-163c-4a78-9855-e60b6fb48376-kube-api-access-xjksl\") pod \"perf-node-gather-daemonset-56xwz\" (UID: \"97657673-163c-4a78-9855-e60b6fb48376\") " pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.521193 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.521105    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:47.721488 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:47.721304    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"]
Jul 06 14:24:47.727013 ip-10-0-142-56 kubenswrapper[2572]: W0706 14:24:47.726706    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97657673_163c_4a78_9855_e60b6fb48376.slice/crio-b98692bfc1e2c409c5d03cf96d86a18d65d09df9acf160129bcdd9428f0cb514 WatchSource:0}: Error finding container b98692bfc1e2c409c5d03cf96d86a18d65d09df9acf160129bcdd9428f0cb514: Status 404 returned error can't find the container with id b98692bfc1e2c409c5d03cf96d86a18d65d09df9acf160129bcdd9428f0cb514
Jul 06 14:24:48.240955 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:48.240918    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz" event={"ID":"97657673-163c-4a78-9855-e60b6fb48376","Type":"ContainerStarted","Data":"fb41c1a50cc3ee67fdf03aaa9cbdf88ceb7972726a45a19852346e1536e19fc3"}
Jul 06 14:24:48.241443 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:48.240975    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz" event={"ID":"97657673-163c-4a78-9855-e60b6fb48376","Type":"ContainerStarted","Data":"b98692bfc1e2c409c5d03cf96d86a18d65d09df9acf160129bcdd9428f0cb514"}
Jul 06 14:24:48.241443 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:48.241006    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:48.258457 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:48.258391    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz" podStartSLOduration=1.258371888 podStartE2EDuration="1.258371888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:48.255516428 +0000 UTC m=+2388.015488352" watchObservedRunningTime="2026-07-06 14:24:48.258371888 +0000 UTC m=+2388.018343813"
Jul 06 14:24:48.512610 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:48.512512    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-dcbxl_da2dd50c-716f-4118-b215-cdc11fb6b6ed/download-server/0.log"
Jul 06 14:24:50.128517 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:50.128491    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8945l_14b6f5b2-187e-4474-9c7d-6699384d3e74/dns/0.log"
Jul 06 14:24:50.155308 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:50.155280    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8945l_14b6f5b2-187e-4474-9c7d-6699384d3e74/kube-rbac-proxy/0.log"
Jul 06 14:24:50.300247 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:50.300199    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7cs2v_c892e645-514e-4b1f-9900-7f1ad7e03424/dns-node-resolver/0.log"
Jul 06 14:24:50.988840 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:50.988805    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8tb2_85d53bd5-9d3e-470e-9ca7-c8ffd85daba1/node-ca/0.log"
Jul 06 14:24:52.145587 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:52.145558    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-db7ct_2f8fd633-a81e-4760-ae50-cc6cc651c3ae/kube-auth-proxy/0.log"
Jul 06 14:24:52.372374 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:52.372342    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdd585c59-zvlkt_522fe905-1d95-4dbe-ae5c-10ccf3291968/router/0.log"
Jul 06 14:24:53.043683 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:53.043651    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27p5s_1997d704-1b3a-4940-bb79-87e62525a026/serve-healthcheck-canary/0.log"
Jul 06 14:24:53.576196 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:53.576171    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-n5m7t_3b6992ce-ea53-4b36-8e03-c30ad094362d/insights-operator/0.log"
Jul 06 14:24:53.578057 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:53.578036    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-n5m7t_3b6992ce-ea53-4b36-8e03-c30ad094362d/insights-operator/1.log"
Jul 06 14:24:53.692448 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:53.692422    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnwbq_c016f9da-3748-49e5-b9da-1c236b05a83a/kube-rbac-proxy/0.log"
Jul 06 14:24:53.716926 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:53.716894    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnwbq_c016f9da-3748-49e5-b9da-1c236b05a83a/exporter/0.log"
Jul 06 14:24:53.744313 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:53.744285    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnwbq_c016f9da-3748-49e5-b9da-1c236b05a83a/extractor/0.log"
Jul 06 14:24:54.259672 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:54.259648    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7nz7d/perf-node-gather-daemonset-56xwz"
Jul 06 14:24:56.429547 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:56.429513    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722455-vv9c5_e6df76a0-4c07-4f8c-8d25-ab5f87ec8463/cleanup/0.log"
Jul 06 14:24:56.874002 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:56.873971    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz_27381896-1a78-47a0-8454-ac90d0d147e3/manager/0.log"
Jul 06 14:24:56.897166 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:56.897074    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb6cc6d7-hg8fz_27381896-1a78-47a0-8454-ac90d0d147e3/copy-manifests/0.log"
Jul 06 14:24:57.720360 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:57.720332    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-db7ct_2f8fd633-a81e-4760-ae50-cc6cc651c3ae/kube-auth-proxy/0.log"
Jul 06 14:24:57.898607 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:57.898558    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdd585c59-zvlkt_522fe905-1d95-4dbe-ae5c-10ccf3291968/router/0.log"
Jul 06 14:24:58.326077 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:58.326023    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-665d757866-dth7x_377c99f0-2c95-4a0a-96e3-9664db0fd99d/manager/0.log"
Jul 06 14:24:59.185328 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:59.185299    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cf46d7698-db7ct_2f8fd633-a81e-4760-ae50-cc6cc651c3ae/kube-auth-proxy/0.log"
Jul 06 14:24:59.383768 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:24:59.383740    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bdd585c59-zvlkt_522fe905-1d95-4dbe-ae5c-10ccf3291968/router/0.log"
Jul 06 14:25:03.276576 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:25:03.276548    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7dxzf_e9597afb-6dab-4350-9c1f-fe9ba5b6f535/migrator/0.log"
Jul 06 14:25:03.298024 ip-10-0-142-56 kubenswrapper[2572]: I0706 14:25:03.297991    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7dxzf_e9597afb-6dab-4350-9c1f-fe9ba5b6f535/graceful-termination/0.log"