Jul 06 14:26:56.053756 ip-10-0-129-16 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 14:26:56.053770 ip-10-0-129-16 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 14:26:56.053779 ip-10-0-129-16 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 14:26:56.054112 ip-10-0-129-16 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 14:27:06.303028 ip-10-0-129-16 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 14:27:06.303045 ip-10-0-129-16 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d1bddfb7b594416baf9b99c59547df6f --
Jul 06 14:28:57.143745 ip-10-0-129-16 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 14:28:57.592973 ip-10-0-129-16 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:28:57.592973 ip-10-0-129-16 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 14:28:57.592973 ip-10-0-129-16 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:28:57.592973 ip-10-0-129-16 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 14:28:57.592973 ip-10-0-129-16 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:28:57.594002 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:57.593851    2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 14:28:58.931295 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931274    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:28:58.931295 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931292    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:28:58.931295 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931298    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:28:58.931295 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931303    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931309    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931313    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931317    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931321    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931325    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931329    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931334    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931338    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931343    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931347    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931350    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931354    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931358    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931363    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931367    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931371    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931375    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931378    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931382    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:28:58.931543 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931386    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931390    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931406    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931413    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931418    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931423    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931428    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931431    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931436    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931440    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931444    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931449    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931453    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931457    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931463    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931470    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931476    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931481    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931486    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:28:58.932135 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931490    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931495    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931499    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931503    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931507    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931511    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931516    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931520    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931524    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931529    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931533    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931537    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931540    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931544    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931549    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931553    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931557    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931562    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931566    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931570    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:28:58.932601 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931574    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931578    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931582    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931587    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931593    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931597    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931601    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931606    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931610    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931619    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931624    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931629    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931634    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931639    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931644    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931648    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931652    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931656    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931660    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:28:58.933136 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931665    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931669    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931673    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931677    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931681    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931685    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931689    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931694    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931698    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931703    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931707    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931711    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931715    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931719    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931723    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931728    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931732    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:28:58.933622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.931737    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:28:58.935199 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935182    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:28:58.935199 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935197    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:28:58.935199 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935202    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935206    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935214    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935219    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935224    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935228    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935233    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935237    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935241    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935245    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935249    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935253    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935257    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935261    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935265    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935269    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935275    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935281    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:28:58.935391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935285    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935289    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935293    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935296    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935300    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935305    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935311    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935317    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935322    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935326    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935331    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935335    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935339    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935343    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935347    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935351    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935356    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935360    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935364    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935368    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:28:58.936221 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935373    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935377    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935383    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935387    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935391    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935395    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935399    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935403    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935407    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935411    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935417    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935422    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935426    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935430    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935435    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935439    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935443    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935448    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935452    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935455    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:28:58.937139 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935459    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935464    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935468    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935472    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935477    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935480    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935485    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935489    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935494    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935498    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935502    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935506    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935511    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935515    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935520    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935524    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935530    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935534    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935539    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935543    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:28:58.937985 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935547    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935552    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935556    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935560    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935564    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935568    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935572    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935576    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935580    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935584    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935588    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935592    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935597    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935601    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935605    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935609    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935614    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935618    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.935622    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936268    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:28:58.938635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936277    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936282    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936287    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936291    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936298    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936303    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936308    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936313    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936318    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936322    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936327    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936331    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936335    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936340    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936344    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936348    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936352    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936356    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936360    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936364    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:28:58.939184 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936368    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936372    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936377    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936381    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936385    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936390    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936394    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936398    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936403    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936408    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936412    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936416    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936420    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936424    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936428    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936432    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936436    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936440    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936445    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936449    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:28:58.939712 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936454    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936458    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936463    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936467    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936471    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936475    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936480    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936484    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936488    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936492    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936496    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936500    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936505    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936509    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936514    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936519    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936523    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936527    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936531    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936535    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:28:58.940457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936539    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936544    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936548    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936552    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936556    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936560    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936564    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936568    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936572    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936576    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936580    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936584    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936588    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936594    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936598    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936602    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936607    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936611    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936615    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936619    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:28:58.941038 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936623    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936627    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936634    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936640    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936644    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936649    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936655    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936660    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936664    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936669    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936673    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936677    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936681    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936685    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936689    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936694    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936700    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.936705    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936809    2552 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936832    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 14:28:58.941505 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936843    2552 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936850    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936856    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936861    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936867    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936875    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936881    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936886    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936891    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936897    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936902    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936906    2552 flags.go:64] FLAG: --cgroup-root=""
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936911    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936916    2552 flags.go:64] FLAG: --client-ca-file=""
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936921    2552 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936925    2552 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936932    2552 flags.go:64] FLAG: --cluster-domain=""
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936937    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936942    2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936947    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936952    2552 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936958    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936963    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 14:28:58.942062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936969    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936974    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936980    2552 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.936985    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937008    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937014    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937019    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937026    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937031    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937035    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937040    2552 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937045    2552 flags.go:64] FLAG: --enable-server="true"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937050    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937059    2552 flags.go:64] FLAG: --event-burst="100"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937064    2552 flags.go:64] FLAG: --event-qps="50"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937069    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937076    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937081    2552 flags.go:64] FLAG: --eviction-hard=""
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937087    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937092    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937096    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937101    2552 flags.go:64] FLAG: --eviction-soft=""
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937106    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937111    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937116    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 14:28:58.942582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937125    2552 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937130    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937135    2552 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937139    2552 flags.go:64] FLAG: --feature-gates=""
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937145    2552 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937149    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937154    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937159    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937164    2552 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937169    2552 flags.go:64] FLAG: --help="false"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937173    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-129-16.ec2.internal"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937179    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937184    2552 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937188    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937194    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937208    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937213    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937218    2552 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937222    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937227    2552 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937232    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937236    2552 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937241    2552 flags.go:64] FLAG: --kube-reserved=""
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937246    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 14:28:58.943203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937251    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937256    2552 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937261    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937265    2552 flags.go:64] FLAG: --lock-file=""
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937270    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937275    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937282    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937295    2552 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937302    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937306    2552 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937310    2552 flags.go:64] FLAG: --logging-format="text"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937316    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937321    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937326    2552 flags.go:64] FLAG: --manifest-url=""
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937330    2552 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937338    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937342    2552 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937349    2552 flags.go:64] FLAG: --max-pods="110"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937354    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937359    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937364    2552 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937369    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937374    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937378    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937383    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 14:28:58.943774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937394    2552 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937399    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937404    2552 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937409    2552 flags.go:64] FLAG: --pod-cidr=""
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937413    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937421    2552 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937426    2552 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937430    2552 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937438    2552 flags.go:64] FLAG: --port="10250"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937444    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937448    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09721ec22e5d31db0"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937453    2552 flags.go:64] FLAG: --qos-reserved=""
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937458    2552 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937464    2552 flags.go:64] FLAG: --register-node="true"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937469    2552 flags.go:64] FLAG: --register-with-taints=""
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937475    2552 flags.go:64] FLAG: --registry-burst="10"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937482    2552 flags.go:64] FLAG: --registry-qps="5"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937486    2552 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937491    2552 flags.go:64] FLAG: --reserved-memory=""
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937497    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937502    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937507    2552 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937511    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937515    2552 flags.go:64] FLAG: --runonce="false"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937520    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 14:28:58.944385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937526    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937531    2552 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937535    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937540    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937545    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937549    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937554    2552 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937559    2552 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937564    2552 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937568    2552 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937573    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937578    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937582    2552 flags.go:64] FLAG: --system-cgroups=""
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937587    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937596    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937601    2552 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937606    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937612    2552 flags.go:64] FLAG: --tls-min-version=""
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937617    2552 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937621    2552 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937627    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937632    2552 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937637    2552 flags.go:64] FLAG: --v="2"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937645    2552 flags.go:64] FLAG: --version="false"
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937652    2552 flags.go:64] FLAG: --vmodule=""
Jul 06 14:28:58.945102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937658    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.937664    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937858    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937865    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937870    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937875    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937881    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937885    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937890    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937895    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937899    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937904    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937908    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937913    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937917    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937921    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937925    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937930    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937934    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:28:58.945703 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937938    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937942    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937946    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937951    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937956    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937960    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937965    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937969    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937976    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937980    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.937984    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938007    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938011    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938015    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938019    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938023    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938027    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938031    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938035    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938040    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:28:58.946179 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938044    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938048    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938052    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938056    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938060    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938064    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938068    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938073    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938077    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938081    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938086    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938091    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938095    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938099    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938103    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938107    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938111    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938116    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938121    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938125    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:28:58.946655 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938132    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938136    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938140    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938145    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938149    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938153    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938160    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938166    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938171    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938176    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938180    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938184    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938188    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938193    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938197    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938201    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938205    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938209    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938213    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938218    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:28:58.947174 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938222    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938226    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938230    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938234    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938238    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938242    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938246    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938251    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938255    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938259    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938263    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938268    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938274    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938278    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938283    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938287    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938292    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938296    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938301    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:28:58.947649 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938307    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938313    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.938319    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.939029    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.946140    2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.946153    2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.946172    2552 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.946178    2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946232    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946237    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946240    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946243    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946246    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946251    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:28:58.948167 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946255    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946258    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946261    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946264    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946266    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946269    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946271    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946274    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946278    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946280    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946284    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946287    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946290    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946292    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946295    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946298    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946301    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946303    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946306    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946309    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:28:58.948507 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946312    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946314    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946317    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946320    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946322    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946325    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946328    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946330    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946333    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946336    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946339    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946341    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946344    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946346    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946349    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946351    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946354    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946357    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946360    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946363    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:28:58.948983 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946366    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946368    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946370    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946374    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946377    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946379    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946382    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946384    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946392    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946395    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946398    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946400    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946403    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946405    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946408    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946411    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946414    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946416    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946420    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:28:58.949478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946424    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946427    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946430    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946433    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946435    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946438    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946440    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946443    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946445    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946448    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946450    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946453    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946455    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946458    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946461    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946463    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946466    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946469    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946472    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946475    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:28:58.949926 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946477    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946480    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946483    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946486    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946490    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946492    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946495    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946498    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946501    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946504    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946507    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946509    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946512    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946515    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:28:58.950478 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.946520    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946633    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946638    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946641    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946644    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946647    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946649    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946652    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946654    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946657    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946660    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946663    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946666    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946668    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946671    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946674    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946676    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946679    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946682    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946684    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:28:58.950811 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946687    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946689    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946692    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946695    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946698    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946700    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946703    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946705    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946708    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946710    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946713    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946715    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946718    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946720    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946723    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946726    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946728    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946731    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946733    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946736    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:28:58.951309 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946739    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946741    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946744    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946746    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946749    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946751    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946754    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946757    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946759    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946763    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946765    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946768    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946770    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946773    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946775    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946778    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946782    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946785    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946788    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:28:58.951793 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946791    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946794    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946796    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946799    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946802    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946805    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946807    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946810    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946813    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946815    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946818    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946822    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946824    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946827    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946830    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946833    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946835    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946838    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946840    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:28:58.952261 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946844    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946847    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946850    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946853    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946856    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946859    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946861    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946864    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946866    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946869    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946871    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946874    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946876    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946878    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946881    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946883    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946886    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946888    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946890    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946893    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:28:58.952709 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946895    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:28:58.953246 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:28:58.946898    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:28:58.953246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.946902    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:28:58.953246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.947009    2552 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 14:28:58.953246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.949074    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 14:28:58.953246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.950899    2552 server.go:1019] "Starting client certificate rotation"
Jul 06 14:28:58.953246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.951013    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:28:58.953246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.951058    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:28:58.953722 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.953708    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:28:58.956779 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.956757    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:28:58.966206 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.966187    2552 log.go:25] "Validated CRI v1 runtime API"
Jul 06 14:28:58.968274 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.968260    2552 log.go:25] "Validated CRI v1 image API"
Jul 06 14:28:58.969015 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.968987    2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 14:28:58.974768 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.974742    2552 fs.go:135] Filesystem UUIDs: map[3475a28d-f46b-47b1-8bc8-83f4889e7084:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c0587e76-c242-4f78-a825-0c2e1579fd62:/dev/nvme0n1p4]
Jul 06 14:28:58.974834 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.974766    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 14:28:58.979071 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.978952    2552 manager.go:216] Machine: {Timestamp:2026-07-06 14:28:58.978484696 +0000 UTC m=+0.370388858 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100582 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26a019d6a000920d32dec4253e39ea SystemUUID:ec26a019-d6a0-0092-0d32-dec4253e39ea BootID:d1bddfb7-b594-416b-af9b-99c59547df6f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:2c:93:54:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:2c:93:54:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:12:fc:6e:e6:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 14:28:58.979071 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.979064    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 14:28:58.979190 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.979135    2552 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 14:28:58.980967 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.980945    2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 14:28:58.981113 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.980969    2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-16.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 14:28:58.981767 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.981757    2552 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 14:28:58.981804 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.981769    2552 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 14:28:58.981804 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.981777    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:28:58.981804 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.981787    2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:28:58.983203 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.983191    2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 14:28:58.986600 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.986588    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:28:58.986710 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.986701    2552 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 14:28:58.986888 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.986876    2552 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 14:28:58.986927 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.986894    2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 14:28:58.986927 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.986913    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 14:28:58.986927 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.986926    2552 kubelet.go:398] "Adding apiserver pod source"
Jul 06 14:28:58.987028 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.986939    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 14:28:58.987305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.987295    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:28:58.987347 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.987313    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:28:58.989027 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.989009    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:28:58.989819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.989802    2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 14:28:58.991568 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.991553    2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 14:28:58.991624 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.991584    2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 14:28:58.992629 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992616    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992632    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992639    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992644    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992653    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992659    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992666    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992671    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992677    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992683    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 14:28:58.992688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992691    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 14:28:58.992952 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.992697    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 14:28:58.994025 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.994016    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 14:28:58.994025 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.994025    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 14:28:58.997264 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.997169    2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-16.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 14:28:58.998291 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:58.997357    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 14:28:58.998291 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:58.997463    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 14:28:58.998291 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.997881    2552 server.go:1268] "Started kubelet"
Jul 06 14:28:58.998962 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.998900    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 14:28:58.999119 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.999091    2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 14:28:58.999183 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:58.999172    2552 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 14:28:58.999336 ip-10-0-129-16 systemd[1]: Started Kubernetes Kubelet.
Jul 06 14:28:59.000399 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.000372    2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 14:28:59.001324 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.001297    2552 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 14:28:59.004284 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.004262    2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 14:28:59.007187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.007169    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 14:28:59.007187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.007178    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 14:28:59.007314 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.007257    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.007460 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.006160    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-16.ec2.internal.18bfb9af0fd1f515  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-16.ec2.internal,UID:ip-10-0-129-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-16.ec2.internal,},FirstTimestamp:2026-07-06 14:28:58.997839125 +0000 UTC m=+0.389743291,LastTimestamp:2026-07-06 14:28:58.997839125 +0000 UTC m=+0.389743291,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-16.ec2.internal,}"
Jul 06 14:28:59.007854 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.007836    2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 14:28:59.007942 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.007881    2552 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 14:28:59.007942 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.007895    2552 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 14:28:59.008061 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.007961    2552 factory.go:55] Registering systemd factory
Jul 06 14:28:59.008061 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.007976    2552 factory.go:223] Registration of the systemd container factory successfully
Jul 06 14:28:59.008061 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008025    2552 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 14:28:59.008061 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008034    2552 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 14:28:59.008231 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008218    2552 factory.go:153] Registering CRI-O factory
Jul 06 14:28:59.008277 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008236    2552 factory.go:223] Registration of the crio container factory successfully
Jul 06 14:28:59.008308 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008285    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 14:28:59.008350 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008310    2552 factory.go:103] Registering Raw factory
Jul 06 14:28:59.008350 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008325    2552 manager.go:1196] Started watching for new ooms in manager
Jul 06 14:28:59.008697 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.008685    2552 manager.go:349] Starting recovery of all containers
Jul 06 14:28:59.017645 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.017621    2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 14:28:59.017645 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.017629    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 14:28:59.018512 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.018495    2552 manager.go:354] Recovery completed
Jul 06 14:28:59.019718 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.019700    2552 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 06 14:28:59.022491 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.022479    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:28:59.024156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.024043    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:28:59.024156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.024078    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:28:59.024156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.024092    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:28:59.024685 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.024670    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 14:28:59.024685 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.024681    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:28:59.024803 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.024685    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 14:28:59.024803 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.024705    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:28:59.025335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.025319    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:28:59.025408 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.025346    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:28:59.025408 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.025355    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:28:59.025879 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.025866    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngtkp"
Jul 06 14:28:59.026849 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.026838    2552 policy_none.go:49] "None policy: Start"
Jul 06 14:28:59.026881 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.026858    2552 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 14:28:59.026881 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.026869    2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 14:28:59.027828 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.027818    2552 policy_none.go:47] "Start"
Jul 06 14:28:59.034075 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.033858    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-16.ec2.internal.18bfb9af11621f1b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-16.ec2.internal,UID:ip-10-0-129-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-16.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-16.ec2.internal,},FirstTimestamp:2026-07-06 14:28:59.024064283 +0000 UTC m=+0.415968445,LastTimestamp:2026-07-06 14:28:59.024064283 +0000 UTC m=+0.415968445,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-16.ec2.internal,}"
Jul 06 14:28:59.035353 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.035338    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngtkp"
Jul 06 14:28:59.037022 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.036952    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-16.ec2.internal.18bfb9af11626f7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-16.ec2.internal,UID:ip-10-0-129-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-16.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-16.ec2.internal,},FirstTimestamp:2026-07-06 14:28:59.024084861 +0000 UTC m=+0.415989028,LastTimestamp:2026-07-06 14:28:59.024084861 +0000 UTC m=+0.415989028,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-16.ec2.internal,}"
Jul 06 14:28:59.062558 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.062542    2552 manager.go:337] "Starting Device Plugin manager"
Jul 06 14:28:59.062670 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.062581    2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 14:28:59.062670 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.062594    2552 server.go:87] "Starting device plugin registration server"
Jul 06 14:28:59.062874 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.062862    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 14:28:59.062948 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.062878    2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 14:28:59.063022 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.062951    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 14:28:59.063078 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.063047    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 14:28:59.063078 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.063056    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 14:28:59.063611 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.063584    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 14:28:59.063686 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.063649    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.148536 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.148501    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 14:28:59.150481 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.149686    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 14:28:59.150481 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.149735    2552 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 14:28:59.150481 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.149761    2552 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 14:28:59.150481 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.149805    2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 14:28:59.152519 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.152501    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:28:59.163563 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.163551    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:28:59.164403 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.164388    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:28:59.164477 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.164418    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:28:59.164477 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.164433    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:28:59.164477 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.164460    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.173248 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.173235    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.173290 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.173255    2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-16.ec2.internal\": node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.188217 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.188166    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.250236 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.250195    2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal"]
Jul 06 14:28:59.250391 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.250280    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:28:59.251311 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.251293    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:28:59.251394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.251320    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:28:59.251394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.251332    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:28:59.253521 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.253508    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:28:59.253630 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.253616    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.253701 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.253646    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:28:59.254238 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.254222    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:28:59.254303 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.254255    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:28:59.254303 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.254267    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:28:59.254303 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.254225    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:28:59.254389 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.254321    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:28:59.254389 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.254330    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:28:59.256378 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.256364    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.256421 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.256390    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:28:59.257060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.257043    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:28:59.257127 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.257069    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:28:59.257127 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.257097    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:28:59.272532 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.272511    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-16.ec2.internal\" not found" node="ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.276294 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.276270    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-16.ec2.internal\" not found" node="ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.288257 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.288240    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.310216 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.310193    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ad6b3b1a531406c9274ae8145aa903-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal\" (UID: \"06ad6b3b1a531406c9274ae8145aa903\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.310306 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.310219    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ad6b3b1a531406c9274ae8145aa903-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal\" (UID: \"06ad6b3b1a531406c9274ae8145aa903\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.310306 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.310244    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95122f1faf395ac2f8128358b45aeb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-16.ec2.internal\" (UID: \"95122f1faf395ac2f8128358b45aeb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.389028 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.388974    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.410561 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.410536    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ad6b3b1a531406c9274ae8145aa903-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal\" (UID: \"06ad6b3b1a531406c9274ae8145aa903\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.410561 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.410556    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ad6b3b1a531406c9274ae8145aa903-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal\" (UID: \"06ad6b3b1a531406c9274ae8145aa903\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.410683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.410595    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ad6b3b1a531406c9274ae8145aa903-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal\" (UID: \"06ad6b3b1a531406c9274ae8145aa903\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.410683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.410616    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95122f1faf395ac2f8128358b45aeb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-16.ec2.internal\" (UID: \"95122f1faf395ac2f8128358b45aeb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.410683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.410642    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95122f1faf395ac2f8128358b45aeb4e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-16.ec2.internal\" (UID: \"95122f1faf395ac2f8128358b45aeb4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.410768 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.410693    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ad6b3b1a531406c9274ae8145aa903-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal\" (UID: \"06ad6b3b1a531406c9274ae8145aa903\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.489875 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.489816    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.576343 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.576315    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.579646 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.579627    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal"
Jul 06 14:28:59.590313 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.590294    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.690906 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.690862    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.791472 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.791392    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.892092 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.892056    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:28:59.949530 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.949499    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 14:28:59.949984 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.949639    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:28:59.967906 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:28:59.967880    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:28:59.992676 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:28:59.992645    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:29:00.037635 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.037592    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:23:59 +0000 UTC" deadline="2028-04-10 03:26:28.675101428 +0000 UTC"
Jul 06 14:29:00.037635 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.037629    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15444h57m28.637476389s"
Jul 06 14:29:00.092980 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:00.092916    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:29:00.139885 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:00.139850    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ad6b3b1a531406c9274ae8145aa903.slice/crio-d2021b4a67cc8940e9c38b142aa96eb332316a8738222e7257a5d487734e83bd WatchSource:0}: Error finding container d2021b4a67cc8940e9c38b142aa96eb332316a8738222e7257a5d487734e83bd: Status 404 returned error can't find the container with id d2021b4a67cc8940e9c38b142aa96eb332316a8738222e7257a5d487734e83bd
Jul 06 14:29:00.140110 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:00.140090    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95122f1faf395ac2f8128358b45aeb4e.slice/crio-55e82d3c6daa6c3b7a2699006bf21723cc1e7c8482c8137e1dbf5b87f458db25 WatchSource:0}: Error finding container 55e82d3c6daa6c3b7a2699006bf21723cc1e7c8482c8137e1dbf5b87f458db25: Status 404 returned error can't find the container with id 55e82d3c6daa6c3b7a2699006bf21723cc1e7c8482c8137e1dbf5b87f458db25
Jul 06 14:29:00.145300 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.145277    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:29:00.152699 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.152664    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal" event={"ID":"95122f1faf395ac2f8128358b45aeb4e","Type":"ContainerStarted","Data":"55e82d3c6daa6c3b7a2699006bf21723cc1e7c8482c8137e1dbf5b87f458db25"}
Jul 06 14:29:00.153697 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.153681    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal" event={"ID":"06ad6b3b1a531406c9274ae8145aa903","Type":"ContainerStarted","Data":"d2021b4a67cc8940e9c38b142aa96eb332316a8738222e7257a5d487734e83bd"}
Jul 06 14:29:00.180442 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.180410    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:29:00.181703 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.181685    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:29:00.181795 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.181714    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:29:00.181795 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.181723    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:29:00.193689 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:00.193670    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:29:00.294214 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:00.294179    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:29:00.353571 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.353482    2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:29:00.394493 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:00.394464    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:29:00.495319 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:00.495284    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-16.ec2.internal\" not found"
Jul 06 14:29:00.555854 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.555828    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:29:00.607679 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.607599    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal"
Jul 06 14:29:00.618801 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.618771    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:29:00.619915 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.619896    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal"
Jul 06 14:29:00.628960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.628943    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:29:00.987865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.987794    2552 apiserver.go:52] "Watching apiserver"
Jul 06 14:29:00.995187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.995163    2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 14:29:00.996662 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.996637    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-b2p9j","openshift-ovn-kubernetes/ovnkube-node-zgg6w","kube-system/konnectivity-agent-px7r2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v","openshift-dns/node-resolver-9b68v","openshift-image-registry/node-ca-xjr22","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal","openshift-multus/multus-additional-cni-plugins-xqqzj","openshift-multus/multus-m5tgh","openshift-multus/network-metrics-daemon-6chcj","kube-system/global-pull-secret-syncer-8qdkn","kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rp7tj","openshift-network-diagnostics/network-check-target-db26d"]
Jul 06 14:29:00.999128 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:00.999109    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:00.999220 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:00.999180    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:01.001219 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.001185    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.003279 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.003202    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:29:01.003360 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.003272    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 14:29:01.003360 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.003331    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nvf5d\""
Jul 06 14:29:01.004585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.004566    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.006319 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.006301    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 14:29:01.006438 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.006406    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pv8dm\""
Jul 06 14:29:01.006564 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.006546    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 14:29:01.006773 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.006754    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.007931 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.007578    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 14:29:01.009415 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.008817    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 14:29:01.009415 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.008942    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 14:29:01.009415 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.009023    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 14:29:01.009415 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.009128    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hh8bs\""
Jul 06 14:29:01.009930 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.009600    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.011319 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.011302    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 14:29:01.011407 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.011394    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m87tn\""
Jul 06 14:29:01.011518 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.011481    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 14:29:01.011837 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.011820    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.013526 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.013508    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 14:29:01.015334 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.013934    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 14:29:01.015334 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.014506    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75tjn\""
Jul 06 14:29:01.015334 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.014872    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 14:29:01.015334 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.015013    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.016951 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.016930    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q99x9\""
Jul 06 14:29:01.018030 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.017187    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 14:29:01.018030 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.017627    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 14:29:01.018030 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.017807    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 14:29:01.018030 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.017915    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 14:29:01.019251 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.018902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-socket-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.019251 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.018944    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-registration-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.019251 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.018978    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dgv7\" (UniqueName: \"kubernetes.io/projected/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-kube-api-access-2dgv7\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.019251 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019038    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:01.019251 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019072    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysctl-d\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.019251 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019096    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-run\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.019251 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019217    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-etc-selinux\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019281    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-var-lib-kubelet\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019339    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzhl\" (UniqueName: \"kubernetes.io/projected/2aee3c4a-50d5-4030-be38-1a8973d88ffb-kube-api-access-xhzhl\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019361    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-hosts-file\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019379    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29w76\" (UniqueName: \"kubernetes.io/projected/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-kube-api-access-29w76\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019393    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-modprobe-d\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019463    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-sys\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019497    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.019580    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:01.019631 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019496    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-lib-modules\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019643    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-tuned\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019672    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa755821-0449-42ea-a144-fe316765c7ce-agent-certs\") pod \"konnectivity-agent-px7r2\" (UID: \"aa755821-0449-42ea-a144-fe316765c7ce\") " pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019704    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-kubernetes\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019730    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-host\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019759    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346c7c7b-0e4d-480e-bd6d-90b4025f342e-tmp\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019813    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-device-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.019970    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa755821-0449-42ea-a144-fe316765c7ce-konnectivity-ca\") pod \"konnectivity-agent-px7r2\" (UID: \"aa755821-0449-42ea-a144-fe316765c7ce\") " pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.020035    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-sys-fs\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.020065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.020065    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysctl-conf\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.020100    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-tmp-dir\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.020488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.020154    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysconfig\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.020187    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-systemd\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.020218    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9mh\" (UniqueName: \"kubernetes.io/projected/346c7c7b-0e4d-480e-bd6d-90b4025f342e-kube-api-access-rs9mh\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.020488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.020243    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.021133 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.021108    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:29:01.022052 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.022032    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.024055 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024039    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 14:29:01.024151 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024139    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 14:29:01.024306 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024291    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 14:29:01.024614 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024594    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 14:29:01.024686 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024602    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-96jvk\""
Jul 06 14:29:01.024847 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024829    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.024902 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024850    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 14:29:01.024902 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.024853    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 14:29:01.027166 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.027148    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:29:01.027333 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.027313    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7pxb5\""
Jul 06 14:29:01.027399 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.027192    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 14:29:01.027453 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.027199    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.027506 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.027150    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 14:29:01.027661 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.027514    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:01.030589 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.030560    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.032682 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.032669    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 14:29:01.032775 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.032734    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gskn7\""
Jul 06 14:29:01.033034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.033019    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 14:29:01.055482 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.055417    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rr2bp"
Jul 06 14:29:01.065125 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.065104    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rr2bp"
Jul 06 14:29:01.109223 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.109185    2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 14:29:01.120442 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120414    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4222abe0-ba28-4345-97d7-af2a498877de-ovn-node-metrics-cert\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.120591 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120448    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-kubelet\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.120591 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120473    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa755821-0449-42ea-a144-fe316765c7ce-konnectivity-ca\") pod \"konnectivity-agent-px7r2\" (UID: \"aa755821-0449-42ea-a144-fe316765c7ce\") " pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.120591 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120504    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-cni-binary-copy\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.120751 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120622    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysctl-conf\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.120751 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120648    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-tmp-dir\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.120751 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120668    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.120751 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120685    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:01.120751 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120708    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-systemd\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.120751 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120732    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-cni-netd\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120755    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysconfig\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120773    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-systemd\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120797    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-registration-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120803    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysctl-conf\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120822    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dgv7\" (UniqueName: \"kubernetes.io/projected/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-kube-api-access-2dgv7\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120840    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysconfig\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120852    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-systemd\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120844    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-conf-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120876    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-registration-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120893    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-run-netns\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120919    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-run\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120949    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-kubelet\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120963    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-tmp-dir\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.120966    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxg7\" (UniqueName: \"kubernetes.io/projected/464e0bdb-8f27-464d-b30d-cdb8525add4b-kube-api-access-mtxg7\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121028    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-os-release\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121044    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-systemd-units\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.121135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121059    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-var-lib-kubelet\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121065    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-run\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121074    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-hosts-file\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121112    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-var-lib-kubelet\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121118    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-hosts-file\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121136    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-cni-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121138    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa755821-0449-42ea-a144-fe316765c7ce-konnectivity-ca\") pod \"konnectivity-agent-px7r2\" (UID: \"aa755821-0449-42ea-a144-fe316765c7ce\") " pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121164    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-daemon-config\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121190    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121220    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-cnibin\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121245    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121266    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-slash\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121292    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29w76\" (UniqueName: \"kubernetes.io/projected/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-kube-api-access-29w76\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121315    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-lib-modules\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121332    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa755821-0449-42ea-a144-fe316765c7ce-agent-certs\") pod \"konnectivity-agent-px7r2\" (UID: \"aa755821-0449-42ea-a144-fe316765c7ce\") " pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121353    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-system-cni-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121366    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-ovn\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.121956 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121389    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-kubernetes\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121410    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-dbus\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121431    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5810c04-5477-4007-9115-39679b16373e-host\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121451    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5810c04-5477-4007-9115-39679b16373e-serviceca\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121477    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-device-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121499    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-os-release\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121542    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-socket-dir-parent\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121564    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/464e0bdb-8f27-464d-b30d-cdb8525add4b-iptables-alerter-script\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-kubelet-config\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121688    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121699    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-device-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122008    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-lib-modules\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.121690    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-kubernetes\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122347    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-sys-fs\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122372    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122387    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122402    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-node-log\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.122753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122435    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-log-socket\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122457    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-sys-fs\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122467    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l46d\" (UniqueName: \"kubernetes.io/projected/4222abe0-ba28-4345-97d7-af2a498877de-kube-api-access-9l46d\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122493    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-cnibin\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-hostroot\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122543    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9mh\" (UniqueName: \"kubernetes.io/projected/346c7c7b-0e4d-480e-bd6d-90b4025f342e-kube-api-access-rs9mh\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122579    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122622    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122673    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-socket-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122710    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-netns\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122735    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-etc-kubernetes\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122758    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4cb\" (UniqueName: \"kubernetes.io/projected/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-kube-api-access-sk4cb\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122793    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-etc-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122799    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-socket-dir\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122815    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-env-overrides\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122844    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-system-cni-dir\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122879    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:01.123548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.122914    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysctl-d\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.123361    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.123466    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs podName:7621a2f6-79b2-4edc-908a-dbd3bc14ab29 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:01.623430386 +0000 UTC m=+3.015334538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs") pod "network-metrics-daemon-6chcj" (UID: "7621a2f6-79b2-4edc-908a-dbd3bc14ab29") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123575    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-etc-selinux\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123645    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-cni-multus\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123673    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-sysctl-d\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123706    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm766\" (UniqueName: \"kubernetes.io/projected/e5810c04-5477-4007-9115-39679b16373e-kube-api-access-dm766\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123713    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2aee3c4a-50d5-4030-be38-1a8973d88ffb-etc-selinux\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123753    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123806    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-ovnkube-config\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123843    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzhl\" (UniqueName: \"kubernetes.io/projected/2aee3c4a-50d5-4030-be38-1a8973d88ffb-kube-api-access-xhzhl\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123878    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-k8s-cni-cncf-io\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123909    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-cni-bin\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123944    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k85ch\" (UniqueName: \"kubernetes.io/projected/c7a82245-3269-430e-ad62-8e77040c7037-kube-api-access-k85ch\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.123976    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-cni-bin\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124026    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-ovnkube-script-lib\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.124349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124060    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-modprobe-d\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124092    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-sys\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124118    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-tuned\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124153    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124186    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-var-lib-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124216    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124256    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-host\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124283    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346c7c7b-0e4d-480e-bd6d-90b4025f342e-tmp\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124314    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-multus-certs\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.125048 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.124345    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/464e0bdb-8f27-464d-b30d-cdb8525add4b-host-slash\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.125473 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.125069    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-modprobe-d\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.125473 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.125158    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-sys\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.125473 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.125236    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/346c7c7b-0e4d-480e-bd6d-90b4025f342e-host\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.126089 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.126065    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa755821-0449-42ea-a144-fe316765c7ce-agent-certs\") pod \"konnectivity-agent-px7r2\" (UID: \"aa755821-0449-42ea-a144-fe316765c7ce\") " pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.127552 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.127527    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/346c7c7b-0e4d-480e-bd6d-90b4025f342e-tmp\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.127707 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.127678    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/346c7c7b-0e4d-480e-bd6d-90b4025f342e-etc-tuned\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.131063 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.131044    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29w76\" (UniqueName: \"kubernetes.io/projected/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-kube-api-access-29w76\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:01.131274 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.131254    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dgv7\" (UniqueName: \"kubernetes.io/projected/327b6d93-f9b6-4efb-a52b-0ee9eb63b66a-kube-api-access-2dgv7\") pod \"node-resolver-9b68v\" (UID: \"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a\") " pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.134268 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.134241    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9mh\" (UniqueName: \"kubernetes.io/projected/346c7c7b-0e4d-480e-bd6d-90b4025f342e-kube-api-access-rs9mh\") pod \"tuned-rp7tj\" (UID: \"346c7c7b-0e4d-480e-bd6d-90b4025f342e\") " pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.139747 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.139726    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzhl\" (UniqueName: \"kubernetes.io/projected/2aee3c4a-50d5-4030-be38-1a8973d88ffb-kube-api-access-xhzhl\") pod \"aws-ebs-csi-driver-node-hts5v\" (UID: \"2aee3c4a-50d5-4030-be38-1a8973d88ffb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.225574 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225533    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-netns\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225581    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-etc-kubernetes\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225607    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4cb\" (UniqueName: \"kubernetes.io/projected/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-kube-api-access-sk4cb\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225629    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-etc-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225643    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-netns\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225648    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-env-overrides\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225699    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-etc-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225717    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-etc-kubernetes\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225712    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-system-cni-dir\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.225753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225748    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-system-cni-dir\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225769    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-cni-multus\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225795    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm766\" (UniqueName: \"kubernetes.io/projected/e5810c04-5477-4007-9115-39679b16373e-kube-api-access-dm766\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225822    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225847    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-ovnkube-config\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225852    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-cni-multus\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225863    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-k8s-cni-cncf-io\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225877    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-cni-bin\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225882    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225900    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k85ch\" (UniqueName: \"kubernetes.io/projected/c7a82245-3269-430e-ad62-8e77040c7037-kube-api-access-k85ch\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225920    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-cni-bin\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225931    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-k8s-cni-cncf-io\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225960    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-ovnkube-script-lib\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.225977    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226007    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-var-lib-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226026    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226047    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-multus-certs\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.226224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226063    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/464e0bdb-8f27-464d-b30d-cdb8525add4b-host-slash\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226102    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4222abe0-ba28-4345-97d7-af2a498877de-ovn-node-metrics-cert\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226117    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-kubelet\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226153    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-cni-binary-copy\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226178    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226189    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-cni-bin\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226199    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226201    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226233    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-systemd\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226257    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-cni-netd\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226271    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-env-overrides\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226288    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-conf-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226314    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-run-netns\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226317    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-ovnkube-config\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226324    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-cni-netd\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226342    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-kubelet\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226359    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-systemd\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226362    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/464e0bdb-8f27-464d-b30d-cdb8525add4b-host-slash\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226368    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxg7\" (UniqueName: \"kubernetes.io/projected/464e0bdb-8f27-464d-b30d-cdb8525add4b-kube-api-access-mtxg7\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226257    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-cni-bin\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226396    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-os-release\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226401    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226427    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-var-lib-kubelet\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226442    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-host-run-multus-certs\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226475    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-os-release\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226515    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-run-netns\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226553    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-var-lib-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226579    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-systemd-units\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226589    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-conf-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226612    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-cni-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226630    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-systemd-units\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226636    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-daemon-config\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226660    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226682    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-cnibin\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.227732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226705    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226729    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-slash\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226734    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4222abe0-ba28-4345-97d7-af2a498877de-ovnkube-script-lib\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226754    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-system-cni-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226764    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-cni-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226777    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-ovn\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226788    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7a82245-3269-430e-ad62-8e77040c7037-cnibin\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226802    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-dbus\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226829    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-slash\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226830    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5810c04-5477-4007-9115-39679b16373e-host\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.226860    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226869    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5810c04-5477-4007-9115-39679b16373e-serviceca\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226883    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-system-cni-dir\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226897    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-os-release\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226915    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-ovn\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226932    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-socket-dir-parent\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226947    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-os-release\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226953    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5810c04-5477-4007-9115-39679b16373e-host\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.228400 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.226962    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret podName:43ce7d1a-cd99-45d8-afc9-69a798e2ed0a nodeName:}" failed. No retries permitted until 2026-07-06 14:29:01.726945644 +0000 UTC m=+3.118849810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret") pod "global-pull-secret-syncer-8qdkn" (UID: "43ce7d1a-cd99-45d8-afc9-69a798e2ed0a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226983    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/464e0bdb-8f27-464d-b30d-cdb8525add4b-iptables-alerter-script\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227008    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-socket-dir-parent\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227017    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227040    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-kubelet-config\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227046    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-cni-binary-copy\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227064    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-host-kubelet\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227068    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.226886    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-dbus\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227098    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227149    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-node-log\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227175    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-log-socket\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227200    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l46d\" (UniqueName: \"kubernetes.io/projected/4222abe0-ba28-4345-97d7-af2a498877de-kube-api-access-9l46d\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227215    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-run-openvswitch\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227240    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-cnibin\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227263    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-hostroot\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227264    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-log-socket\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227324    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-multus-daemon-config\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.229060 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227332    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-cnibin\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227367    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-hostroot\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227383    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4222abe0-ba28-4345-97d7-af2a498877de-node-log\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227448    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-kubelet-config\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227474    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227487    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5810c04-5477-4007-9115-39679b16373e-serviceca\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227530    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/464e0bdb-8f27-464d-b30d-cdb8525add4b-iptables-alerter-script\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.227567    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7a82245-3269-430e-ad62-8e77040c7037-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.229762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.229542    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4222abe0-ba28-4345-97d7-af2a498877de-ovn-node-metrics-cert\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.236425 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.236386    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:29:01.236425 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.236414    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:29:01.236425 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.236428    2552 projected.go:196] Error preparing data for projected volume kube-api-access-5ngpj for pod openshift-network-diagnostics/network-check-target-db26d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:01.236619 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.236488    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj podName:8a3194ff-19d5-47b6-bea2-491230b2c6ea nodeName:}" failed. No retries permitted until 2026-07-06 14:29:01.736470192 +0000 UTC m=+3.128374360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5ngpj" (UniqueName: "kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj") pod "network-check-target-db26d" (UID: "8a3194ff-19d5-47b6-bea2-491230b2c6ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:01.239165 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.239109    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k85ch\" (UniqueName: \"kubernetes.io/projected/c7a82245-3269-430e-ad62-8e77040c7037-kube-api-access-k85ch\") pod \"multus-additional-cni-plugins-xqqzj\" (UID: \"c7a82245-3269-430e-ad62-8e77040c7037\") " pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.239165 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.239112    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxg7\" (UniqueName: \"kubernetes.io/projected/464e0bdb-8f27-464d-b30d-cdb8525add4b-kube-api-access-mtxg7\") pod \"iptables-alerter-b2p9j\" (UID: \"464e0bdb-8f27-464d-b30d-cdb8525add4b\") " pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.239511 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.239487    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm766\" (UniqueName: \"kubernetes.io/projected/e5810c04-5477-4007-9115-39679b16373e-kube-api-access-dm766\") pod \"node-ca-xjr22\" (UID: \"e5810c04-5477-4007-9115-39679b16373e\") " pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.239708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.239685    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l46d\" (UniqueName: \"kubernetes.io/projected/4222abe0-ba28-4345-97d7-af2a498877de-kube-api-access-9l46d\") pod \"ovnkube-node-zgg6w\" (UID: \"4222abe0-ba28-4345-97d7-af2a498877de\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.239795 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.239742    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4cb\" (UniqueName: \"kubernetes.io/projected/7e0bfcaa-4037-4376-8915-3bb2fd5952f1-kube-api-access-sk4cb\") pod \"multus-m5tgh\" (UID: \"7e0bfcaa-4037-4376-8915-3bb2fd5952f1\") " pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.312350 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.312314    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rp7tj"
Jul 06 14:29:01.322116 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.322091    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:01.333118 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.333093    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v"
Jul 06 14:29:01.337773 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.337752    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9b68v"
Jul 06 14:29:01.345648 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.345621    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xjr22"
Jul 06 14:29:01.353317 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.353296    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m5tgh"
Jul 06 14:29:01.362080 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.362059    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:01.367618 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.367599    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2p9j"
Jul 06 14:29:01.374226 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.374208    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqqzj"
Jul 06 14:29:01.415688 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.415655    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:29:01.630951 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.630868    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:01.631108 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.631047    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:01.631153 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.631143    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs podName:7621a2f6-79b2-4edc-908a-dbd3bc14ab29 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:02.631128171 +0000 UTC m=+4.023032319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs") pod "network-metrics-daemon-6chcj" (UID: "7621a2f6-79b2-4edc-908a-dbd3bc14ab29") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:01.731622 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.731583    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:01.731787 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.731737    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:01.731837 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.731803    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret podName:43ce7d1a-cd99-45d8-afc9-69a798e2ed0a nodeName:}" failed. No retries permitted until 2026-07-06 14:29:02.731788835 +0000 UTC m=+4.123692988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret") pod "global-pull-secret-syncer-8qdkn" (UID: "43ce7d1a-cd99-45d8-afc9-69a798e2ed0a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:01.832455 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:01.832420    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:01.832651 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.832613    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:29:01.832651 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.832639    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:29:01.832651 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.832652    2552 projected.go:196] Error preparing data for projected volume kube-api-access-5ngpj for pod openshift-network-diagnostics/network-check-target-db26d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:01.832805 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:01.832721    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj podName:8a3194ff-19d5-47b6-bea2-491230b2c6ea nodeName:}" failed. No retries permitted until 2026-07-06 14:29:02.832702058 +0000 UTC m=+4.224606230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ngpj" (UniqueName: "kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj") pod "network-check-target-db26d" (UID: "8a3194ff-19d5-47b6-bea2-491230b2c6ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:02.070126 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.070031    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:24:01 +0000 UTC" deadline="2028-01-20 03:24:08.541596077 +0000 UTC"
Jul 06 14:29:02.070126 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.070078    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13500h55m6.471520905s"
Jul 06 14:29:02.138359 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.138315    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464e0bdb_8f27_464d_b30d_cdb8525add4b.slice/crio-b4afbac31fd902f011f15439d8cacc2fd60254d390b08150f4f4be31e7f5a5a6 WatchSource:0}: Error finding container b4afbac31fd902f011f15439d8cacc2fd60254d390b08150f4f4be31e7f5a5a6: Status 404 returned error can't find the container with id b4afbac31fd902f011f15439d8cacc2fd60254d390b08150f4f4be31e7f5a5a6
Jul 06 14:29:02.139335 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.139295    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0bfcaa_4037_4376_8915_3bb2fd5952f1.slice/crio-8016825d651fa0589afb6d615092c88a881dce513b810ce266ba06a9e17f8b12 WatchSource:0}: Error finding container 8016825d651fa0589afb6d615092c88a881dce513b810ce266ba06a9e17f8b12: Status 404 returned error can't find the container with id 8016825d651fa0589afb6d615092c88a881dce513b810ce266ba06a9e17f8b12
Jul 06 14:29:02.145203 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.145172    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346c7c7b_0e4d_480e_bd6d_90b4025f342e.slice/crio-e6dc7296381815cfd70dfd67e7dcd0dec688ab90229992498d76367e4bc522cf WatchSource:0}: Error finding container e6dc7296381815cfd70dfd67e7dcd0dec688ab90229992498d76367e4bc522cf: Status 404 returned error can't find the container with id e6dc7296381815cfd70dfd67e7dcd0dec688ab90229992498d76367e4bc522cf
Jul 06 14:29:02.145842 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.145815    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4222abe0_ba28_4345_97d7_af2a498877de.slice/crio-48daa82e64fdac08123db1b8626259ad2a534f3396919bbf75b614c7fb27291e WatchSource:0}: Error finding container 48daa82e64fdac08123db1b8626259ad2a534f3396919bbf75b614c7fb27291e: Status 404 returned error can't find the container with id 48daa82e64fdac08123db1b8626259ad2a534f3396919bbf75b614c7fb27291e
Jul 06 14:29:02.147234 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.147207    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327b6d93_f9b6_4efb_a52b_0ee9eb63b66a.slice/crio-3d564b55c223accea856b4e4fbf6121a0a21ccb4ddc5be41b02d19ea893ce040 WatchSource:0}: Error finding container 3d564b55c223accea856b4e4fbf6121a0a21ccb4ddc5be41b02d19ea893ce040: Status 404 returned error can't find the container with id 3d564b55c223accea856b4e4fbf6121a0a21ccb4ddc5be41b02d19ea893ce040
Jul 06 14:29:02.148121 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.147938    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5810c04_5477_4007_9115_39679b16373e.slice/crio-d4f6f3047fa5abf60425a0fc1cb43f6b4125c662417bde680948560c1b9fd149 WatchSource:0}: Error finding container d4f6f3047fa5abf60425a0fc1cb43f6b4125c662417bde680948560c1b9fd149: Status 404 returned error can't find the container with id d4f6f3047fa5abf60425a0fc1cb43f6b4125c662417bde680948560c1b9fd149
Jul 06 14:29:02.148384 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.148366    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a82245_3269_430e_ad62_8e77040c7037.slice/crio-1163e236e490c2cf3ec2e7abec00d084918a097718ff312a3b98c3fd38d92dc6 WatchSource:0}: Error finding container 1163e236e490c2cf3ec2e7abec00d084918a097718ff312a3b98c3fd38d92dc6: Status 404 returned error can't find the container with id 1163e236e490c2cf3ec2e7abec00d084918a097718ff312a3b98c3fd38d92dc6
Jul 06 14:29:02.150391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.149871    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa755821_0449_42ea_a144_fe316765c7ce.slice/crio-db29fcf10f3d05b3030dad29997e851566a8947319bace41ae3db4a8742c6429 WatchSource:0}: Error finding container db29fcf10f3d05b3030dad29997e851566a8947319bace41ae3db4a8742c6429: Status 404 returned error can't find the container with id db29fcf10f3d05b3030dad29997e851566a8947319bace41ae3db4a8742c6429
Jul 06 14:29:02.150391 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.149930    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:02.150391 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.150097    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:02.150391 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:02.150284    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aee3c4a_50d5_4030_be38_1a8973d88ffb.slice/crio-0db22220e66033013107e6e607abedcd5aed9c6971edab63efa9b760f7da597f WatchSource:0}: Error finding container 0db22220e66033013107e6e607abedcd5aed9c6971edab63efa9b760f7da597f: Status 404 returned error can't find the container with id 0db22220e66033013107e6e607abedcd5aed9c6971edab63efa9b760f7da597f
Jul 06 14:29:02.157446 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.157416    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-px7r2" event={"ID":"aa755821-0449-42ea-a144-fe316765c7ce","Type":"ContainerStarted","Data":"db29fcf10f3d05b3030dad29997e851566a8947319bace41ae3db4a8742c6429"}
Jul 06 14:29:02.158551 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.158527    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerStarted","Data":"1163e236e490c2cf3ec2e7abec00d084918a097718ff312a3b98c3fd38d92dc6"}
Jul 06 14:29:02.159726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.159699    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"48daa82e64fdac08123db1b8626259ad2a534f3396919bbf75b614c7fb27291e"}
Jul 06 14:29:02.160776 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.160751    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rp7tj" event={"ID":"346c7c7b-0e4d-480e-bd6d-90b4025f342e","Type":"ContainerStarted","Data":"e6dc7296381815cfd70dfd67e7dcd0dec688ab90229992498d76367e4bc522cf"}
Jul 06 14:29:02.162033 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.162012    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2p9j" event={"ID":"464e0bdb-8f27-464d-b30d-cdb8525add4b","Type":"ContainerStarted","Data":"b4afbac31fd902f011f15439d8cacc2fd60254d390b08150f4f4be31e7f5a5a6"}
Jul 06 14:29:02.163256 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.163220    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xjr22" event={"ID":"e5810c04-5477-4007-9115-39679b16373e","Type":"ContainerStarted","Data":"d4f6f3047fa5abf60425a0fc1cb43f6b4125c662417bde680948560c1b9fd149"}
Jul 06 14:29:02.164444 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.164401    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9b68v" event={"ID":"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a","Type":"ContainerStarted","Data":"3d564b55c223accea856b4e4fbf6121a0a21ccb4ddc5be41b02d19ea893ce040"}
Jul 06 14:29:02.165654 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.165635    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m5tgh" event={"ID":"7e0bfcaa-4037-4376-8915-3bb2fd5952f1","Type":"ContainerStarted","Data":"8016825d651fa0589afb6d615092c88a881dce513b810ce266ba06a9e17f8b12"}
Jul 06 14:29:02.166782 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.166762    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v" event={"ID":"2aee3c4a-50d5-4030-be38-1a8973d88ffb","Type":"ContainerStarted","Data":"0db22220e66033013107e6e607abedcd5aed9c6971edab63efa9b760f7da597f"}
Jul 06 14:29:02.639544 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.639247    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:02.639718 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.639474    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:02.639718 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.639607    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs podName:7621a2f6-79b2-4edc-908a-dbd3bc14ab29 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:04.639589535 +0000 UTC m=+6.031493699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs") pod "network-metrics-daemon-6chcj" (UID: "7621a2f6-79b2-4edc-908a-dbd3bc14ab29") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:02.740442 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.740403    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:02.740615 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.740538    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:02.740615 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.740608    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret podName:43ce7d1a-cd99-45d8-afc9-69a798e2ed0a nodeName:}" failed. No retries permitted until 2026-07-06 14:29:04.740582207 +0000 UTC m=+6.132486361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret") pod "global-pull-secret-syncer-8qdkn" (UID: "43ce7d1a-cd99-45d8-afc9-69a798e2ed0a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:02.841029 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:02.840980    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:02.841226 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.841189    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:29:02.841226 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.841217    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:29:02.841329 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.841229    2552 projected.go:196] Error preparing data for projected volume kube-api-access-5ngpj for pod openshift-network-diagnostics/network-check-target-db26d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:02.841329 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:02.841290    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj podName:8a3194ff-19d5-47b6-bea2-491230b2c6ea nodeName:}" failed. No retries permitted until 2026-07-06 14:29:04.841270686 +0000 UTC m=+6.233174855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ngpj" (UniqueName: "kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj") pod "network-check-target-db26d" (UID: "8a3194ff-19d5-47b6-bea2-491230b2c6ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:03.070300 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.070172    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:24:01 +0000 UTC" deadline="2028-02-10 22:14:41.186974997 +0000 UTC"
Jul 06 14:29:03.070300 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.070212    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14023h45m38.116767971s"
Jul 06 14:29:03.153312 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.152563    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:03.153312 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:03.152697    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:03.153312 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.153084    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:03.153312 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:03.153171    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:03.179717 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.179076    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal" event={"ID":"95122f1faf395ac2f8128358b45aeb4e","Type":"ContainerStarted","Data":"73e58a4395cc78576d869914b7bf12bd3c3fb7e002094db7752cae878b4dd4e9"}
Jul 06 14:29:03.193010 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.191588    2552 generic.go:356] "Generic (PLEG): container finished" podID="06ad6b3b1a531406c9274ae8145aa903" containerID="9057359b66cbd819f0266b9df1459dab2ff14738a4edf846cf21a36d881d3d01" exitCode=0
Jul 06 14:29:03.193010 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.191643    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal" event={"ID":"06ad6b3b1a531406c9274ae8145aa903","Type":"ContainerDied","Data":"9057359b66cbd819f0266b9df1459dab2ff14738a4edf846cf21a36d881d3d01"}
Jul 06 14:29:03.199104 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:03.197873    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-16.ec2.internal" podStartSLOduration=3.197856085 podStartE2EDuration="3.197856085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:03.197383155 +0000 UTC m=+4.589287327" watchObservedRunningTime="2026-07-06 14:29:03.197856085 +0000 UTC m=+4.589760259"
Jul 06 14:29:04.150533 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:04.149974    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:04.150533 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.150140    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:04.211086 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:04.211049    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal" event={"ID":"06ad6b3b1a531406c9274ae8145aa903","Type":"ContainerStarted","Data":"10eda5743c54b2f2fde3b26880a4aa91363cefc4c1521a3ef1ed49da78a24d10"}
Jul 06 14:29:04.658361 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:04.658324    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:04.658554 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.658524    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:04.658619 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.658589    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs podName:7621a2f6-79b2-4edc-908a-dbd3bc14ab29 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:08.658569508 +0000 UTC m=+10.050473680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs") pod "network-metrics-daemon-6chcj" (UID: "7621a2f6-79b2-4edc-908a-dbd3bc14ab29") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:04.761031 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:04.759461    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:04.761031 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.759601    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:04.761031 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.759665    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret podName:43ce7d1a-cd99-45d8-afc9-69a798e2ed0a nodeName:}" failed. No retries permitted until 2026-07-06 14:29:08.759646012 +0000 UTC m=+10.151550184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret") pod "global-pull-secret-syncer-8qdkn" (UID: "43ce7d1a-cd99-45d8-afc9-69a798e2ed0a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:04.860119 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:04.860081    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:04.860318 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.860301    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:29:04.860395 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.860326    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:29:04.860395 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.860338    2552 projected.go:196] Error preparing data for projected volume kube-api-access-5ngpj for pod openshift-network-diagnostics/network-check-target-db26d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:04.860510 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:04.860397    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj podName:8a3194ff-19d5-47b6-bea2-491230b2c6ea nodeName:}" failed. No retries permitted until 2026-07-06 14:29:08.860377619 +0000 UTC m=+10.252281783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ngpj" (UniqueName: "kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj") pod "network-check-target-db26d" (UID: "8a3194ff-19d5-47b6-bea2-491230b2c6ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:05.151067 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:05.150382    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:05.151067 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:05.150509    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:05.151067 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:05.150838    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:05.151067 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:05.150929    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:06.150465 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:06.149921    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:06.150465 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:06.150089    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:07.151035 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:07.150939    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:07.151035 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:07.150976    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:07.151552 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:07.151093    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:07.151552 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:07.151495    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:08.150466 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:08.150426    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:08.150635 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.150575    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:08.690087 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:08.690048    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:08.690557 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.690265    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:08.690557 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.690338    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs podName:7621a2f6-79b2-4edc-908a-dbd3bc14ab29 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:16.690317882 +0000 UTC m=+18.082222039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs") pod "network-metrics-daemon-6chcj" (UID: "7621a2f6-79b2-4edc-908a-dbd3bc14ab29") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:08.791461 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:08.791424    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:08.791635 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.791620    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:08.791700 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.791688    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret podName:43ce7d1a-cd99-45d8-afc9-69a798e2ed0a nodeName:}" failed. No retries permitted until 2026-07-06 14:29:16.791667606 +0000 UTC m=+18.183571777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret") pod "global-pull-secret-syncer-8qdkn" (UID: "43ce7d1a-cd99-45d8-afc9-69a798e2ed0a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:08.892092 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:08.892057    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:08.892281 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.892245    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:29:08.892281 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.892271    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:29:08.892378 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.892285    2552 projected.go:196] Error preparing data for projected volume kube-api-access-5ngpj for pod openshift-network-diagnostics/network-check-target-db26d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:08.892378 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:08.892350    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj podName:8a3194ff-19d5-47b6-bea2-491230b2c6ea nodeName:}" failed. No retries permitted until 2026-07-06 14:29:16.892331017 +0000 UTC m=+18.284235191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ngpj" (UniqueName: "kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj") pod "network-check-target-db26d" (UID: "8a3194ff-19d5-47b6-bea2-491230b2c6ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:09.152492 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:09.151841    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:09.152492 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:09.151951    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:09.152492 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:09.152036    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:09.152492 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:09.152108    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:10.150647 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:10.150612    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:10.151149 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:10.150746    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:11.150551 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:11.150485    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:11.150551 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:11.150507    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:11.151117 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:11.150620    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:11.151117 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:11.150753    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:12.150136 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:12.150105    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:12.150330 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:12.150235    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:13.150627 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:13.150514    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:13.151113 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:13.150652    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:13.151113 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:13.150660    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:13.151113 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:13.150749    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:14.150461 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:14.150422    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:14.150638 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:14.150554    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:15.150159 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:15.150120    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:15.150331 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:15.150283    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:15.150331 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:15.150327    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:15.150440 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:15.150420    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:16.150638 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:16.150603    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:16.151190 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.150743    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:16.752052 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:16.752013    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:16.752257 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.752117    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:16.752257 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.752185    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs podName:7621a2f6-79b2-4edc-908a-dbd3bc14ab29 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:32.75216764 +0000 UTC m=+34.144071791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs") pod "network-metrics-daemon-6chcj" (UID: "7621a2f6-79b2-4edc-908a-dbd3bc14ab29") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:16.852763 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:16.852663    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:16.852929 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.852827    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:16.852929 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.852898    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret podName:43ce7d1a-cd99-45d8-afc9-69a798e2ed0a nodeName:}" failed. No retries permitted until 2026-07-06 14:29:32.852881352 +0000 UTC m=+34.244785514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret") pod "global-pull-secret-syncer-8qdkn" (UID: "43ce7d1a-cd99-45d8-afc9-69a798e2ed0a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:16.953612 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:16.953579    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:16.953775 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.953732    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:29:16.953775 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.953752    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:29:16.953775 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.953761    2552 projected.go:196] Error preparing data for projected volume kube-api-access-5ngpj for pod openshift-network-diagnostics/network-check-target-db26d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:16.953922 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:16.953822    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj podName:8a3194ff-19d5-47b6-bea2-491230b2c6ea nodeName:}" failed. No retries permitted until 2026-07-06 14:29:32.953805718 +0000 UTC m=+34.345709890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ngpj" (UniqueName: "kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj") pod "network-check-target-db26d" (UID: "8a3194ff-19d5-47b6-bea2-491230b2c6ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:17.150865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:17.150765    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:17.150865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:17.150819    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:17.151393 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:17.150940    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:17.151393 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:17.151093    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:18.150243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:18.150206    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:18.150436 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:18.150380    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:19.150813 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:19.150777    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:19.151285 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:19.150884    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:19.151285 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:19.150917    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:19.151285 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:19.151040    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:20.150972 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:20.150929    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:20.151438 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:20.151095    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:21.150797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.150488    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:21.150903 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.150488    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:21.150903 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:21.150881    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:21.150970 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:21.150936    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:21.248706 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.248680    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xjr22" event={"ID":"e5810c04-5477-4007-9115-39679b16373e","Type":"ContainerStarted","Data":"ae671583e7260ebd2440adfe38d6f05cb97f096c6de2ed275c3a5a8b1ef1417e"}
Jul 06 14:29:21.250058 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.250031    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9b68v" event={"ID":"327b6d93-f9b6-4efb-a52b-0ee9eb63b66a","Type":"ContainerStarted","Data":"493875904deb95a71b1024b611e5ea8cfe3a360655353f583709d58d0299a5ec"}
Jul 06 14:29:21.251382 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.251360    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m5tgh" event={"ID":"7e0bfcaa-4037-4376-8915-3bb2fd5952f1","Type":"ContainerStarted","Data":"9e51d3b33a64a850c07a8ee38505c677e46e7758d44ffe6a7aa5b7e39a74c005"}
Jul 06 14:29:21.252719 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.252699    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v" event={"ID":"2aee3c4a-50d5-4030-be38-1a8973d88ffb","Type":"ContainerStarted","Data":"cc21f0eb8d7a0fa002de36ec27e273d8ed5ef4a3a2174edb91b4a983abcbc132"}
Jul 06 14:29:21.253903 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.253879    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-px7r2" event={"ID":"aa755821-0449-42ea-a144-fe316765c7ce","Type":"ContainerStarted","Data":"5e2f9ed14f62be7dd30ce772cc86a0bdbf17f341b6b64eac349c44061e41b7db"}
Jul 06 14:29:21.255390 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.255369    2552 generic.go:356] "Generic (PLEG): container finished" podID="c7a82245-3269-430e-ad62-8e77040c7037" containerID="b038b1838c8ae221d5b123327fed2f067b420f1f214a53c33a3d7538109a9a3c" exitCode=0
Jul 06 14:29:21.256247 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.255657    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerDied","Data":"b038b1838c8ae221d5b123327fed2f067b420f1f214a53c33a3d7538109a9a3c"}
Jul 06 14:29:21.259721 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.259701    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"bede8465af5723c764c8eab0a69323764a249cd26ed60c6b4cc760fa7277d4b0"}
Jul 06 14:29:21.259808 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.259759    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"d53dd8eff62c1db7a6ccbd280176fce9a3749b275c18f2bd175788bb7af77074"}
Jul 06 14:29:21.259918 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.259805    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"d8b0c623968fb66134db84104ef4465a87f0db4bc831fffd8cfd3ef04e3d4aef"}
Jul 06 14:29:21.259918 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.259851    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"6002845a2b9d402498d3eb3f1920d61ca2918d2d781d815ded54280d021fe257"}
Jul 06 14:29:21.260958 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.260940    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rp7tj" event={"ID":"346c7c7b-0e4d-480e-bd6d-90b4025f342e","Type":"ContainerStarted","Data":"e231c9809980d22ec8e46dcd33f21da45c3a7c9c8aa3ceec7484612dbf3a3bec"}
Jul 06 14:29:21.273960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.273921    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xjr22" podStartSLOduration=3.731734066 podStartE2EDuration="22.273910027s" totalImagesPullingTime="18.542175961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:21.273436572 +0000 UTC m=+22.665340743" watchObservedRunningTime="2026-07-06 14:29:21.273910027 +0000 UTC m=+22.665814198"
Jul 06 14:29:21.274050 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.273986    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-16.ec2.internal" podStartSLOduration=21.273982055 podStartE2EDuration="21.273982055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:04.229176894 +0000 UTC m=+5.621081065" watchObservedRunningTime="2026-07-06 14:29:21.273982055 +0000 UTC m=+22.665886227"
Jul 06 14:29:21.301903 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.301861    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9b68v" podStartSLOduration=3.76283362 podStartE2EDuration="22.301848151s" totalImagesPullingTime="18.539014531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:21.30176305 +0000 UTC m=+22.693667231" watchObservedRunningTime="2026-07-06 14:29:21.301848151 +0000 UTC m=+22.693752321"
Jul 06 14:29:21.333755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.333713    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m5tgh" podStartSLOduration=3.729379348 podStartE2EDuration="22.333697885s" totalImagesPullingTime="18.604318537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:21.333326158 +0000 UTC m=+22.725230329" watchObservedRunningTime="2026-07-06 14:29:21.333697885 +0000 UTC m=+22.725602056"
Jul 06 14:29:21.466377 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.466328    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rp7tj" podStartSLOduration=3.924156775 podStartE2EDuration="22.466312779s" totalImagesPullingTime="18.542156004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:21.435194055 +0000 UTC m=+22.827098227" watchObservedRunningTime="2026-07-06 14:29:21.466312779 +0000 UTC m=+22.858216950"
Jul 06 14:29:21.466687 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.466659    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-px7r2" podStartSLOduration=3.927227522 podStartE2EDuration="22.466649665s" totalImagesPullingTime="18.539422143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:21.466450413 +0000 UTC m=+22.858354575" watchObservedRunningTime="2026-07-06 14:29:21.466649665 +0000 UTC m=+22.858553839"
Jul 06 14:29:21.522222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.522136    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:21.522681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:21.522662    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:22.150105 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.150073    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:22.150265 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:22.150189    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:22.266073 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.266038    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"371aba3090666d0d0cd9d2644836d7e2d2c8714eb80bb33250ffe502468d7ed2"}
Jul 06 14:29:22.266473 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.266111    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"8ac0890495265e791091678dc501031332b865f023a52d7ce37ed1faff904041"}
Jul 06 14:29:22.267306 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.267282    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2p9j" event={"ID":"464e0bdb-8f27-464d-b30d-cdb8525add4b","Type":"ContainerStarted","Data":"d45401f316ffdd4695ab7674da6381ab9434a710f873d8cd94e383c7632f4ff8"}
Jul 06 14:29:22.268037 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.268020    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:22.268491 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.268478    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-px7r2"
Jul 06 14:29:22.339246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.339151    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b2p9j" podStartSLOduration=4.785152734 podStartE2EDuration="23.3391298s" totalImagesPullingTime="18.553977066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:22.302122002 +0000 UTC m=+23.694026173" watchObservedRunningTime="2026-07-06 14:29:22.3391298 +0000 UTC m=+23.731033972"
Jul 06 14:29:22.530461 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:22.530411    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 14:29:23.076664 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:23.076538    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:29:22.530438962Z","UUID":"df0ae883-da4e-480b-9fdc-cd53f461048d","Handler":null,"Name":"","Endpoint":""}
Jul 06 14:29:23.078366 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:23.078342    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 14:29:23.078498 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:23.078388    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 14:29:23.150130 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:23.150096    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:23.150304 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:23.150141    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:23.150304 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:23.150227    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:23.150552 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:23.150524    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:23.272193 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:23.272138    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v" event={"ID":"2aee3c4a-50d5-4030-be38-1a8973d88ffb","Type":"ContainerStarted","Data":"8529fe2cdaddc17d51d7bc00c8c999a9af7818cddf85a1d0e5485694b08a6f05"}
Jul 06 14:29:24.150307 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:24.150077    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:24.150566 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:24.150362    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:24.276172 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:24.276136    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v" event={"ID":"2aee3c4a-50d5-4030-be38-1a8973d88ffb","Type":"ContainerStarted","Data":"6297105ef4a515fa3a920d6797dfdacf2165196f0750e04d5288f8219314efcb"}
Jul 06 14:29:24.279305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:24.279280    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"39c0df0cc17194a68d6146d1fc20b0019f383334ebcb1562c13bf7f4a77ee5fc"}
Jul 06 14:29:25.150315 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:25.150279    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:25.150548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:25.150337    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:25.150548 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:25.150433    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:25.150548 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:25.150531    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:26.150573 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:26.150512    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:26.151116 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:26.150623    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:26.288827 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:26.288798    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" event={"ID":"4222abe0-ba28-4345-97d7-af2a498877de","Type":"ContainerStarted","Data":"4f9cb4bb5b0a65c7bb6cf5b9f57e9cbb3239fcd3819c58e3f55906e57079a615"}
Jul 06 14:29:26.289181 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:26.289016    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:26.305804 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:26.305660    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:26.344725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:26.344428    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hts5v" podStartSLOduration=6.1511761289999995 podStartE2EDuration="27.344407255s" totalImagesPullingTime="21.193231126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:24.308217543 +0000 UTC m=+25.700121716" watchObservedRunningTime="2026-07-06 14:29:26.344407255 +0000 UTC m=+27.736311428"
Jul 06 14:29:26.345675 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:26.345631    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" podStartSLOduration=8.733924524 podStartE2EDuration="27.345618168s" totalImagesPullingTime="18.611693644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:26.344817293 +0000 UTC m=+27.736721447" watchObservedRunningTime="2026-07-06 14:29:26.345618168 +0000 UTC m=+27.737522348"
Jul 06 14:29:27.150572 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:27.150537    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:27.151193 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:27.150541    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:27.151193 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:27.150640    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:27.151193 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:27.150712    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:27.292257 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:27.292219    2552 generic.go:356] "Generic (PLEG): container finished" podID="c7a82245-3269-430e-ad62-8e77040c7037" containerID="3277f03c316628aaf10a3259fdb1b1f023ba85ca41ef54627d138df50a33d65a" exitCode=0
Jul 06 14:29:27.292445 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:27.292306    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerDied","Data":"3277f03c316628aaf10a3259fdb1b1f023ba85ca41ef54627d138df50a33d65a"}
Jul 06 14:29:27.292445 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:27.292408    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 14:29:27.292803 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:27.292781    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:27.308651 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:27.308627    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:28.150459 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.150429    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:28.150606 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:28.150581    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:28.296861 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.296816    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerStarted","Data":"915cb3ca61dc7423055d0f1101ccdbe437cbd9a400bfca36547ac8384492e759"}
Jul 06 14:29:28.296983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.296832    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 14:29:28.552891 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.552608    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qdkn"]
Jul 06 14:29:28.553064 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.553046    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:28.553199 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:28.553175    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:28.559282 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.559252    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6chcj"]
Jul 06 14:29:28.559423 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.559363    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:28.559501 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:28.559466    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:28.560039 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.560017    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-db26d"]
Jul 06 14:29:28.560126 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:28.560106    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:28.560187 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:28.560170    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:29.300559 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:29.300520    2552 generic.go:356] "Generic (PLEG): container finished" podID="c7a82245-3269-430e-ad62-8e77040c7037" containerID="915cb3ca61dc7423055d0f1101ccdbe437cbd9a400bfca36547ac8384492e759" exitCode=0
Jul 06 14:29:29.300941 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:29.300610    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerDied","Data":"915cb3ca61dc7423055d0f1101ccdbe437cbd9a400bfca36547ac8384492e759"}
Jul 06 14:29:29.300941 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:29.300811    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 14:29:30.150314 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:30.150286    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:30.150314 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:30.150305    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:30.150540 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:30.150316    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:30.150540 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:30.150373    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:30.150540 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:30.150481    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:30.150671 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:30.150571    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:31.013666 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:31.013626    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:29:31.014530 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:31.013823    2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 14:29:31.030034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:31.029978    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" podUID="4222abe0-ba28-4345-97d7-af2a498877de" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 06 14:29:31.038467 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:31.038435    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w" podUID="4222abe0-ba28-4345-97d7-af2a498877de" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 06 14:29:31.307213 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:31.307130    2552 generic.go:356] "Generic (PLEG): container finished" podID="c7a82245-3269-430e-ad62-8e77040c7037" containerID="dda865ab7d709192aba4d9b74493e52f2ff25bdff3ebac4a1a0d2b385b4664a3" exitCode=0
Jul 06 14:29:31.307213 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:31.307188    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerDied","Data":"dda865ab7d709192aba4d9b74493e52f2ff25bdff3ebac4a1a0d2b385b4664a3"}
Jul 06 14:29:32.150667 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:32.150627    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:32.151249 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.150742    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:32.151249 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:32.150627    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:32.151249 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.150818    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:32.151249 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:32.150639    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:32.151249 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.150893    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:32.770387 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:32.770297    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:32.770553 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.770404    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:32.770553 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.770477    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs podName:7621a2f6-79b2-4edc-908a-dbd3bc14ab29 nodeName:}" failed. No retries permitted until 2026-07-06 14:30:04.770458462 +0000 UTC m=+66.162362612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs") pod "network-metrics-daemon-6chcj" (UID: "7621a2f6-79b2-4edc-908a-dbd3bc14ab29") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:29:32.870643 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:32.870610    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:32.870826 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.870783    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:32.870874 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.870853    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret podName:43ce7d1a-cd99-45d8-afc9-69a798e2ed0a nodeName:}" failed. No retries permitted until 2026-07-06 14:30:04.87083407 +0000 UTC m=+66.262738221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret") pod "global-pull-secret-syncer-8qdkn" (UID: "43ce7d1a-cd99-45d8-afc9-69a798e2ed0a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:29:32.971669 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:32.971636    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:32.971917 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.971896    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:29:32.972014 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.971924    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:29:32.972014 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.971938    2552 projected.go:196] Error preparing data for projected volume kube-api-access-5ngpj for pod openshift-network-diagnostics/network-check-target-db26d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:32.972141 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:32.972021    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj podName:8a3194ff-19d5-47b6-bea2-491230b2c6ea nodeName:}" failed. No retries permitted until 2026-07-06 14:30:04.9719832 +0000 UTC m=+66.363887366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ngpj" (UniqueName: "kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj") pod "network-check-target-db26d" (UID: "8a3194ff-19d5-47b6-bea2-491230b2c6ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:29:34.150561 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.150522    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:34.151086 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.150522    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:34.151086 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:34.150655    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-db26d" podUID="8a3194ff-19d5-47b6-bea2-491230b2c6ea"
Jul 06 14:29:34.151086 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.150524    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:34.151086 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:34.150726    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qdkn" podUID="43ce7d1a-cd99-45d8-afc9-69a798e2ed0a"
Jul 06 14:29:34.151086 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:34.150845    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6chcj" podUID="7621a2f6-79b2-4edc-908a-dbd3bc14ab29"
Jul 06 14:29:34.405961 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.405886    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-16.ec2.internal" event="NodeReady"
Jul 06 14:29:34.406146 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.406046    2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 14:29:34.456435 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.456404    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v988b"]
Jul 06 14:29:34.459088 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.459062    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.459607 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.459570    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mzk4z"]
Jul 06 14:29:34.461206 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.461181    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 14:29:34.461314 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.461207    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:34.461314 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.461195    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rs6zp\""
Jul 06 14:29:34.461416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.461342    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 14:29:34.463353 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.463143    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 14:29:34.463353 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.463226    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 14:29:34.463353 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.463268    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 14:29:34.463578 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.463408    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tspsl\""
Jul 06 14:29:34.470164 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.470137    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v988b"]
Jul 06 14:29:34.477954 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.476955    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzk4z"]
Jul 06 14:29:34.583009 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.582965    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvrwj\" (UniqueName: \"kubernetes.io/projected/b0078455-d25b-4421-ad36-8b60697475bc-kube-api-access-cvrwj\") pod \"ingress-canary-mzk4z\" (UID: \"b0078455-d25b-4421-ad36-8b60697475bc\") " pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:34.583198 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.583084    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.583198 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.583137    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqvdx\" (UniqueName: \"kubernetes.io/projected/868f2401-21e0-4ee8-bd66-fa7561b414c3-kube-api-access-jqvdx\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.583198 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.583170    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868f2401-21e0-4ee8-bd66-fa7561b414c3-tmp-dir\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.583341 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.583275    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/868f2401-21e0-4ee8-bd66-fa7561b414c3-config-volume\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.583341 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.583317    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0078455-d25b-4421-ad36-8b60697475bc-cert\") pod \"ingress-canary-mzk4z\" (UID: \"b0078455-d25b-4421-ad36-8b60697475bc\") " pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:34.684435 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.684347    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868f2401-21e0-4ee8-bd66-fa7561b414c3-tmp-dir\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.684435 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.684423    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/868f2401-21e0-4ee8-bd66-fa7561b414c3-config-volume\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.684667 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.684458    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0078455-d25b-4421-ad36-8b60697475bc-cert\") pod \"ingress-canary-mzk4z\" (UID: \"b0078455-d25b-4421-ad36-8b60697475bc\") " pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:34.684667 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.684514    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvrwj\" (UniqueName: \"kubernetes.io/projected/b0078455-d25b-4421-ad36-8b60697475bc-kube-api-access-cvrwj\") pod \"ingress-canary-mzk4z\" (UID: \"b0078455-d25b-4421-ad36-8b60697475bc\") " pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:34.684769 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.684691    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.684769 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.684744    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqvdx\" (UniqueName: \"kubernetes.io/projected/868f2401-21e0-4ee8-bd66-fa7561b414c3-kube-api-access-jqvdx\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.684869 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.684766    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868f2401-21e0-4ee8-bd66-fa7561b414c3-tmp-dir\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.684917 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:34.684877    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:29:34.684960 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:34.684929    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls podName:868f2401-21e0-4ee8-bd66-fa7561b414c3 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:35.184911887 +0000 UTC m=+36.576816041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls") pod "dns-default-v988b" (UID: "868f2401-21e0-4ee8-bd66-fa7561b414c3") : secret "dns-default-metrics-tls" not found
Jul 06 14:29:34.685154 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.685131    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/868f2401-21e0-4ee8-bd66-fa7561b414c3-config-volume\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.689034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.688875    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0078455-d25b-4421-ad36-8b60697475bc-cert\") pod \"ingress-canary-mzk4z\" (UID: \"b0078455-d25b-4421-ad36-8b60697475bc\") " pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:34.694206 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.694145    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqvdx\" (UniqueName: \"kubernetes.io/projected/868f2401-21e0-4ee8-bd66-fa7561b414c3-kube-api-access-jqvdx\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:34.694344 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.694331    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvrwj\" (UniqueName: \"kubernetes.io/projected/b0078455-d25b-4421-ad36-8b60697475bc-kube-api-access-cvrwj\") pod \"ingress-canary-mzk4z\" (UID: \"b0078455-d25b-4421-ad36-8b60697475bc\") " pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:34.782302 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:34.782262    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzk4z"
Jul 06 14:29:35.188525 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:35.188492    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:35.188829 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:35.188661    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:29:35.188829 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:35.188755    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls podName:868f2401-21e0-4ee8-bd66-fa7561b414c3 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:36.188731846 +0000 UTC m=+37.580636009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls") pod "dns-default-v988b" (UID: "868f2401-21e0-4ee8-bd66-fa7561b414c3") : secret "dns-default-metrics-tls" not found
Jul 06 14:29:35.296617 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:35.296569    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzk4z"]
Jul 06 14:29:35.300163 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:35.300135    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0078455_d25b_4421_ad36_8b60697475bc.slice/crio-abc10b99c108285bb8e6ea7efd0a3d959cd81fc7527bde8f99808f988906f865 WatchSource:0}: Error finding container abc10b99c108285bb8e6ea7efd0a3d959cd81fc7527bde8f99808f988906f865: Status 404 returned error can't find the container with id abc10b99c108285bb8e6ea7efd0a3d959cd81fc7527bde8f99808f988906f865
Jul 06 14:29:35.319735 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:35.319697    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerStarted","Data":"c2e1f17ea1e47db09e8620ed0abd75f9e8bd855ba2d21a25ee903d7e50944347"}
Jul 06 14:29:35.320847 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:35.320820    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzk4z" event={"ID":"b0078455-d25b-4421-ad36-8b60697475bc","Type":"ContainerStarted","Data":"abc10b99c108285bb8e6ea7efd0a3d959cd81fc7527bde8f99808f988906f865"}
Jul 06 14:29:36.150460 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.150423    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:29:36.150627 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.150546    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:29:36.150627 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.150559    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:29:36.153762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.153581    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:29:36.153762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.153607    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:29:36.153762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.153616    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s774m\""
Jul 06 14:29:36.153762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.153628    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:29:36.153762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.153607    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwxdr\""
Jul 06 14:29:36.153762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.153637    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:29:36.196137 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.196095    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:36.196516 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:36.196249    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:29:36.196516 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:36.196344    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls podName:868f2401-21e0-4ee8-bd66-fa7561b414c3 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:38.19632829 +0000 UTC m=+39.588232439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls") pod "dns-default-v988b" (UID: "868f2401-21e0-4ee8-bd66-fa7561b414c3") : secret "dns-default-metrics-tls" not found
Jul 06 14:29:36.327666 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.327627    2552 generic.go:356] "Generic (PLEG): container finished" podID="c7a82245-3269-430e-ad62-8e77040c7037" containerID="c2e1f17ea1e47db09e8620ed0abd75f9e8bd855ba2d21a25ee903d7e50944347" exitCode=0
Jul 06 14:29:36.327666 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:36.327676    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerDied","Data":"c2e1f17ea1e47db09e8620ed0abd75f9e8bd855ba2d21a25ee903d7e50944347"}
Jul 06 14:29:37.334429 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:37.334164    2552 generic.go:356] "Generic (PLEG): container finished" podID="c7a82245-3269-430e-ad62-8e77040c7037" containerID="e756bd63f09751d6224092983f9d38e072a1f1dfc73c476f7c128c9401a93baf" exitCode=0
Jul 06 14:29:37.334429 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:37.334221    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerDied","Data":"e756bd63f09751d6224092983f9d38e072a1f1dfc73c476f7c128c9401a93baf"}
Jul 06 14:29:38.211710 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:38.211667    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:38.211915 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:38.211821    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:29:38.211915 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:38.211885    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls podName:868f2401-21e0-4ee8-bd66-fa7561b414c3 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:42.211868601 +0000 UTC m=+43.603772749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls") pod "dns-default-v988b" (UID: "868f2401-21e0-4ee8-bd66-fa7561b414c3") : secret "dns-default-metrics-tls" not found
Jul 06 14:29:38.340597 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:38.340565    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" event={"ID":"c7a82245-3269-430e-ad62-8e77040c7037","Type":"ContainerStarted","Data":"5283a27d275f23c2a680786f3c102236adbd0b40bbbabb19b132119d00155b5e"}
Jul 06 14:29:38.341937 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:38.341915    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzk4z" event={"ID":"b0078455-d25b-4421-ad36-8b60697475bc","Type":"ContainerStarted","Data":"acfe85deed6dcaa67b25e4ab5960ee34e3f055a994ba3c405875e99cfb0dc14a"}
Jul 06 14:29:38.407354 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:38.407306    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xqqzj" podStartSLOduration=10.286915485 podStartE2EDuration="39.4072889s" totalImagesPullingTime="29.120373415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:38.381373817 +0000 UTC m=+39.773277988" watchObservedRunningTime="2026-07-06 14:29:38.4072889 +0000 UTC m=+39.799193080"
Jul 06 14:29:39.781752 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.781695    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mzk4z" podStartSLOduration=3.264539359 podStartE2EDuration="5.781678897s" totalImagesPullingTime="2.517139538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:38.406973656 +0000 UTC m=+39.798877842" watchObservedRunningTime="2026-07-06 14:29:39.781678897 +0000 UTC m=+41.173583164"
Jul 06 14:29:39.782142 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.781809    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qh4zv"]
Jul 06 14:29:39.810668 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.810638    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qh4zv"]
Jul 06 14:29:39.810805 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.810754    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:39.812904 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.812879    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 14:29:39.813042 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.812982    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 14:29:39.813042 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.813006    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 14:29:39.813042 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.813035    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 14:29:39.813240 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.813058    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rzjwm\""
Jul 06 14:29:39.923303 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.923271    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-data-volume\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:39.923455 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.923308    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:39.923455 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.923343    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-crio-socket\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:39.923455 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.923423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg52c\" (UniqueName: \"kubernetes.io/projected/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-api-access-zg52c\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:39.923555 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:39.923492    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.023773 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.023741    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-crio-socket\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.023940 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.023787    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg52c\" (UniqueName: \"kubernetes.io/projected/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-api-access-zg52c\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.023940 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.023833    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.023940 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.023851    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-data-volume\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.023940 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.023868    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.023940 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.023933    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:29:40.024191 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.023953    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-crio-socket\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.024191 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.023981    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:40.024191 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.024025    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:40.524009174 +0000 UTC m=+41.915913341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : configmap "kube-rbac-proxy" not found
Jul 06 14:29:40.024191 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.024073    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:40.524054788 +0000 UTC m=+41.915958939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:40.024315 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.024221    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-data-volume\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.033715 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.033652    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg52c\" (UniqueName: \"kubernetes.io/projected/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-api-access-zg52c\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.526674 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.526636    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.526862 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:40.526729    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:40.526862 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.526758    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:29:40.526862 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.526812    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:40.526862 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.526823    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:41.526808026 +0000 UTC m=+42.918712175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : configmap "kube-rbac-proxy" not found
Jul 06 14:29:40.526862 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:40.526859    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:41.526848706 +0000 UTC m=+42.918752855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:41.187497 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.187462    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7889cf85c9-796t6"]
Jul 06 14:29:41.212077 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.212050    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7889cf85c9-796t6"]
Jul 06 14:29:41.212222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.212144    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.214484 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.214460    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 14:29:41.214690 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.214668    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 14:29:41.214794 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.214703    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vnmkm\""
Jul 06 14:29:41.214845 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.214791    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 14:29:41.218679 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.218663    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 14:29:41.332363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332320    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-image-registry-private-configuration\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.332363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332364    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.332585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332389    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7h94\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-kube-api-access-d7h94\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.332585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332421    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-trusted-ca\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.332585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332460    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-ca-trust-extracted\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.332585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332482    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-certificates\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.332585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332521    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-bound-sa-token\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.332753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.332588    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-installation-pull-secrets\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433295 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433255    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-image-registry-private-configuration\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433295 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433303    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433556 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7h94\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-kube-api-access-d7h94\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433556 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433365    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-trusted-ca\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433556 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433408    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-ca-trust-extracted\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433556 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433430    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-certificates\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433556 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.433436    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:29:41.433556 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.433462    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7889cf85c9-796t6: secret "image-registry-tls" not found
Jul 06 14:29:41.433556 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.433524    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls podName:dfc624a4-ea13-441e-bbfa-9b207d3f3a76 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:41.933505411 +0000 UTC m=+43.325409570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls") pod "image-registry-7889cf85c9-796t6" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76") : secret "image-registry-tls" not found
Jul 06 14:29:41.433834 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433597    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-bound-sa-token\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.433834 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.433645    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-installation-pull-secrets\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.434441 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.434211    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-ca-trust-extracted\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.437851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.434609    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-certificates\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.437851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.434795    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-trusted-ca\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.437851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.436844    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-installation-pull-secrets\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.437851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.436844    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-image-registry-private-configuration\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.443863 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.443837    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-bound-sa-token\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.443951 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.443912    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7h94\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-kube-api-access-d7h94\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.534476 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.534434    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:41.534614 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.534488    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:41.534614 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.534593    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:29:41.534614 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.534597    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:41.534731 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.534645    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:43.534631542 +0000 UTC m=+44.926535690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : configmap "kube-rbac-proxy" not found
Jul 06 14:29:41.534731 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.534658    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:43.534652779 +0000 UTC m=+44.926556928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:41.937814 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:41.937772    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:41.937976 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.937909    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:29:41.937976 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.937924    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7889cf85c9-796t6: secret "image-registry-tls" not found
Jul 06 14:29:41.938072 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:41.937979    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls podName:dfc624a4-ea13-441e-bbfa-9b207d3f3a76 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:42.937962699 +0000 UTC m=+44.329866847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls") pod "image-registry-7889cf85c9-796t6" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76") : secret "image-registry-tls" not found
Jul 06 14:29:42.239716 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:42.239620    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:42.240128 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:42.239754    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:29:42.240128 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:42.239808    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls podName:868f2401-21e0-4ee8-bd66-fa7561b414c3 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:50.239794624 +0000 UTC m=+51.631698778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls") pod "dns-default-v988b" (UID: "868f2401-21e0-4ee8-bd66-fa7561b414c3") : secret "dns-default-metrics-tls" not found
Jul 06 14:29:42.374726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:42.374700    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9b68v_327b6d93-f9b6-4efb-a52b-0ee9eb63b66a/dns-node-resolver/0.log"
Jul 06 14:29:42.944348 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:42.944303    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:42.944509 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:42.944452    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:29:42.944509 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:42.944468    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7889cf85c9-796t6: secret "image-registry-tls" not found
Jul 06 14:29:42.944610 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:42.944519    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls podName:dfc624a4-ea13-441e-bbfa-9b207d3f3a76 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:44.94450532 +0000 UTC m=+46.336409472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls") pod "image-registry-7889cf85c9-796t6" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76") : secret "image-registry-tls" not found
Jul 06 14:29:43.547832 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:43.547793    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:43.548240 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:43.547844    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:43.548240 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:43.547918    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:29:43.548240 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:43.547942    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:43.548240 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:43.547976    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:47.547960918 +0000 UTC m=+48.939865081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : configmap "kube-rbac-proxy" not found
Jul 06 14:29:43.548240 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:43.548008    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:47.547983399 +0000 UTC m=+48.939887548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:43.570093 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:43.570068    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xjr22_e5810c04-5477-4007-9115-39679b16373e/node-ca/0.log"
Jul 06 14:29:44.168705 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:44.168673    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzk4z_b0078455-d25b-4421-ad36-8b60697475bc/serve-healthcheck-canary/0.log"
Jul 06 14:29:44.958434 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:44.958396    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:44.958807 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:44.958559    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:29:44.958807 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:44.958578    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7889cf85c9-796t6: secret "image-registry-tls" not found
Jul 06 14:29:44.958807 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:44.958640    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls podName:dfc624a4-ea13-441e-bbfa-9b207d3f3a76 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:48.958623098 +0000 UTC m=+50.350527286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls") pod "image-registry-7889cf85c9-796t6" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76") : secret "image-registry-tls" not found
Jul 06 14:29:47.577091 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:47.577053    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:47.577479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:47.577102    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:47.577479 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:47.577198    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:47.577479 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:47.577209    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:29:47.577479 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:47.577264    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:55.577247324 +0000 UTC m=+56.969151473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:47.577479 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:47.577278    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:29:55.57727137 +0000 UTC m=+56.969175519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : configmap "kube-rbac-proxy" not found
Jul 06 14:29:48.987392 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:48.987354    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:48.987792 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:48.987516    2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 14:29:48.987792 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:48.987534    2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7889cf85c9-796t6: secret "image-registry-tls" not found
Jul 06 14:29:48.987792 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:48.987591    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls podName:dfc624a4-ea13-441e-bbfa-9b207d3f3a76 nodeName:}" failed. No retries permitted until 2026-07-06 14:29:56.987574454 +0000 UTC m=+58.379478629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls") pod "image-registry-7889cf85c9-796t6" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76") : secret "image-registry-tls" not found
Jul 06 14:29:50.297866 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:50.297827    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:50.300096 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:50.300079    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/868f2401-21e0-4ee8-bd66-fa7561b414c3-metrics-tls\") pod \"dns-default-v988b\" (UID: \"868f2401-21e0-4ee8-bd66-fa7561b414c3\") " pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:50.371882 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:50.371852    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:50.539342 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:50.539312    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v988b"]
Jul 06 14:29:50.542457 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:50.542427    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868f2401_21e0_4ee8_bd66_fa7561b414c3.slice/crio-680b9e1a02ad394c15970c47f2646c5d3a09efc6ac6bd330878175b152ad83a8 WatchSource:0}: Error finding container 680b9e1a02ad394c15970c47f2646c5d3a09efc6ac6bd330878175b152ad83a8: Status 404 returned error can't find the container with id 680b9e1a02ad394c15970c47f2646c5d3a09efc6ac6bd330878175b152ad83a8
Jul 06 14:29:51.372594 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:51.372558    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v988b" event={"ID":"868f2401-21e0-4ee8-bd66-fa7561b414c3","Type":"ContainerStarted","Data":"680b9e1a02ad394c15970c47f2646c5d3a09efc6ac6bd330878175b152ad83a8"}
Jul 06 14:29:53.379382 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:53.379345    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v988b" event={"ID":"868f2401-21e0-4ee8-bd66-fa7561b414c3","Type":"ContainerStarted","Data":"e03ac0d49430fb041c48d641b4b4404448833b7218b8bdb49d4a876870d2f0e3"}
Jul 06 14:29:54.383464 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:54.383423    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v988b" event={"ID":"868f2401-21e0-4ee8-bd66-fa7561b414c3","Type":"ContainerStarted","Data":"8763f2fc3fa8cddc6633eb4102029b1613ee4efe37553cecef6b3df13cab5e33"}
Jul 06 14:29:54.383944 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:54.383556    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v988b"
Jul 06 14:29:54.410851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:54.410798    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v988b" podStartSLOduration=17.790447428 podStartE2EDuration="20.410784172s" totalImagesPullingTime="2.620336744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:54.409888981 +0000 UTC m=+55.801793151" watchObservedRunningTime="2026-07-06 14:29:54.410784172 +0000 UTC m=+55.802688342"
Jul 06 14:29:55.637294 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:55.637253    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:55.637783 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:55.637344    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:55.637783 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:55.637393    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:55.637783 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:29:55.637456    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls podName:8e93ea80-81cd-4b78-b9f2-4960fa75bbda nodeName:}" failed. No retries permitted until 2026-07-06 14:30:11.637440891 +0000 UTC m=+73.029345039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh4zv" (UID: "8e93ea80-81cd-4b78-b9f2-4960fa75bbda") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:29:55.637891 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:55.637839    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:29:57.046536 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.046498    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:57.048801 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.048779    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"image-registry-7889cf85c9-796t6\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") " pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:57.122066 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.122025    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:57.250069 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.250027    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7889cf85c9-796t6"]
Jul 06 14:29:57.254372 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:29:57.254345    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc624a4_ea13_441e_bbfa_9b207d3f3a76.slice/crio-f1671350281d977b5d0068e0d1b8499bffbcecf41d0671b5ca28eff04fb35169 WatchSource:0}: Error finding container f1671350281d977b5d0068e0d1b8499bffbcecf41d0671b5ca28eff04fb35169: Status 404 returned error can't find the container with id f1671350281d977b5d0068e0d1b8499bffbcecf41d0671b5ca28eff04fb35169
Jul 06 14:29:57.392258 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.392215    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7889cf85c9-796t6" event={"ID":"dfc624a4-ea13-441e-bbfa-9b207d3f3a76","Type":"ContainerStarted","Data":"3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7"}
Jul 06 14:29:57.392434 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.392276    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7889cf85c9-796t6" event={"ID":"dfc624a4-ea13-441e-bbfa-9b207d3f3a76","Type":"ContainerStarted","Data":"f1671350281d977b5d0068e0d1b8499bffbcecf41d0671b5ca28eff04fb35169"}
Jul 06 14:29:57.392434 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.392345    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:29:57.415602 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:29:57.415551    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7889cf85c9-796t6" podStartSLOduration=16.415534631 podStartE2EDuration="16.415534631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:57.414861315 +0000 UTC m=+58.806765488" watchObservedRunningTime="2026-07-06 14:29:57.415534631 +0000 UTC m=+58.807438801"
Jul 06 14:30:01.039949 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.039922    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgg6w"
Jul 06 14:30:01.707479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.707447    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-944dh"]
Jul 06 14:30:01.710764 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.710748    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:01.714597 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.714578    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-72zqs\""
Jul 06 14:30:01.714725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.714596    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 14:30:01.714725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.714616    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 14:30:01.723026 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.722985    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"]
Jul 06 14:30:01.724926 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.724907    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"]
Jul 06 14:30:01.725105 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.725077    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:01.726620 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.726604    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-944dh"]
Jul 06 14:30:01.726697 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.726679    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.727488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.727469    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 14:30:01.728041 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.728019    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 14:30:01.728135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.728076    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 14:30:01.728196 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.728132    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 14:30:01.728297 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.728281    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t4dqn\""
Jul 06 14:30:01.735528 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.735514    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 14:30:01.735981 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.735968    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 14:30:01.736231 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.736218    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 14:30:01.736572 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.736560    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 14:30:01.740858 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.740817    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"]
Jul 06 14:30:01.753911 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.753889    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"]
Jul 06 14:30:01.778537 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778503    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4m8\" (UniqueName: \"kubernetes.io/projected/ddceb273-96f8-4a49-9a9f-82209e686b7f-kube-api-access-xx4m8\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.778681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778550    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7cf1e93-64da-439c-ae08-6fa95a400593-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-944dh\" (UID: \"c7cf1e93-64da-439c-ae08-6fa95a400593\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:01.778681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778570    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v86xn\" (UniqueName: \"kubernetes.io/projected/b3196254-7f79-444e-847b-8117bdde0ccd-kube-api-access-v86xn\") pod \"managed-serviceaccount-addon-agent-777d8bdfb-gl97l\" (UID: \"b3196254-7f79-444e-847b-8117bdde0ccd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:01.778681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.778797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778680    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.778797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778722    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-hub\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.778797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778738    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddceb273-96f8-4a49-9a9f-82209e686b7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.778797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778764    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3196254-7f79-444e-847b-8117bdde0ccd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-777d8bdfb-gl97l\" (UID: \"b3196254-7f79-444e-847b-8117bdde0ccd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:01.778797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778780    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-ca\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.778960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.778796    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7cf1e93-64da-439c-ae08-6fa95a400593-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-944dh\" (UID: \"c7cf1e93-64da-439c-ae08-6fa95a400593\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:01.857314 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.857277    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7889cf85c9-796t6"]
Jul 06 14:30:01.879065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879035    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.879208 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879086    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-hub\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.879208 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879106    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddceb273-96f8-4a49-9a9f-82209e686b7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.879208 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879130    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3196254-7f79-444e-847b-8117bdde0ccd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-777d8bdfb-gl97l\" (UID: \"b3196254-7f79-444e-847b-8117bdde0ccd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:01.879318 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879238    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-ca\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.879318 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879282    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7cf1e93-64da-439c-ae08-6fa95a400593-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-944dh\" (UID: \"c7cf1e93-64da-439c-ae08-6fa95a400593\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:01.879394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879316    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4m8\" (UniqueName: \"kubernetes.io/projected/ddceb273-96f8-4a49-9a9f-82209e686b7f-kube-api-access-xx4m8\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.879394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879366    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7cf1e93-64da-439c-ae08-6fa95a400593-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-944dh\" (UID: \"c7cf1e93-64da-439c-ae08-6fa95a400593\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:01.879498 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879393    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v86xn\" (UniqueName: \"kubernetes.io/projected/b3196254-7f79-444e-847b-8117bdde0ccd-kube-api-access-v86xn\") pod \"managed-serviceaccount-addon-agent-777d8bdfb-gl97l\" (UID: \"b3196254-7f79-444e-847b-8117bdde0ccd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:01.879498 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.879428    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.880055 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.880030    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddceb273-96f8-4a49-9a9f-82209e686b7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.880412 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.880381    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7cf1e93-64da-439c-ae08-6fa95a400593-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-944dh\" (UID: \"c7cf1e93-64da-439c-ae08-6fa95a400593\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:01.881826 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.881790    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-hub\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.882037 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.882019    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.882194 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.882171    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.882376 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.882352    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3196254-7f79-444e-847b-8117bdde0ccd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-777d8bdfb-gl97l\" (UID: \"b3196254-7f79-444e-847b-8117bdde0ccd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:01.882456 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.882354    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7cf1e93-64da-439c-ae08-6fa95a400593-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-944dh\" (UID: \"c7cf1e93-64da-439c-ae08-6fa95a400593\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:01.882509 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.882495    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddceb273-96f8-4a49-9a9f-82209e686b7f-ca\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.907235 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.907207    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4m8\" (UniqueName: \"kubernetes.io/projected/ddceb273-96f8-4a49-9a9f-82209e686b7f-kube-api-access-xx4m8\") pod \"cluster-proxy-proxy-agent-5bfb76d5b8-p54bp\" (UID: \"ddceb273-96f8-4a49-9a9f-82209e686b7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:01.907582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:01.907563    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v86xn\" (UniqueName: \"kubernetes.io/projected/b3196254-7f79-444e-847b-8117bdde0ccd-kube-api-access-v86xn\") pod \"managed-serviceaccount-addon-agent-777d8bdfb-gl97l\" (UID: \"b3196254-7f79-444e-847b-8117bdde0ccd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:02.019360 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.019274    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh"
Jul 06 14:30:02.047296 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.047262    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"
Jul 06 14:30:02.052393 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.052372    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"
Jul 06 14:30:02.188444 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.188413    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-944dh"]
Jul 06 14:30:02.191937 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:02.191907    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cf1e93_64da_439c_ae08_6fa95a400593.slice/crio-f3e5ab39557d0c20d27b63240069841d22391cb9253ee8a90ee98f4bc1335199 WatchSource:0}: Error finding container f3e5ab39557d0c20d27b63240069841d22391cb9253ee8a90ee98f4bc1335199: Status 404 returned error can't find the container with id f3e5ab39557d0c20d27b63240069841d22391cb9253ee8a90ee98f4bc1335199
Jul 06 14:30:02.193108 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.193083    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l"]
Jul 06 14:30:02.196357 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:02.196334    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3196254_7f79_444e_847b_8117bdde0ccd.slice/crio-84b7018d115fb495c30a36024833494cb61a972fc9563c89484026bb1e258f82 WatchSource:0}: Error finding container 84b7018d115fb495c30a36024833494cb61a972fc9563c89484026bb1e258f82: Status 404 returned error can't find the container with id 84b7018d115fb495c30a36024833494cb61a972fc9563c89484026bb1e258f82
Jul 06 14:30:02.211094 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.211072    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp"]
Jul 06 14:30:02.215071 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:02.215050    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddceb273_96f8_4a49_9a9f_82209e686b7f.slice/crio-ff6954568bc9a3e8d187e56484116dcab526fd6b7923464a221c44f71d328956 WatchSource:0}: Error finding container ff6954568bc9a3e8d187e56484116dcab526fd6b7923464a221c44f71d328956: Status 404 returned error can't find the container with id ff6954568bc9a3e8d187e56484116dcab526fd6b7923464a221c44f71d328956
Jul 06 14:30:02.405421 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.405386    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp" event={"ID":"ddceb273-96f8-4a49-9a9f-82209e686b7f","Type":"ContainerStarted","Data":"ff6954568bc9a3e8d187e56484116dcab526fd6b7923464a221c44f71d328956"}
Jul 06 14:30:02.406406 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.406376    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l" event={"ID":"b3196254-7f79-444e-847b-8117bdde0ccd","Type":"ContainerStarted","Data":"84b7018d115fb495c30a36024833494cb61a972fc9563c89484026bb1e258f82"}
Jul 06 14:30:02.407351 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:02.407327    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh" event={"ID":"c7cf1e93-64da-439c-ae08-6fa95a400593","Type":"ContainerStarted","Data":"f3e5ab39557d0c20d27b63240069841d22391cb9253ee8a90ee98f4bc1335199"}
Jul 06 14:30:04.388096 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.388068    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v988b"
Jul 06 14:30:04.413946 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.413907    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh" event={"ID":"c7cf1e93-64da-439c-ae08-6fa95a400593","Type":"ContainerStarted","Data":"55e15d241eb40eeb2277ff786b50e0ecee607855bad9c00cb2187222f55c00cf"}
Jul 06 14:30:04.432957 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.432894    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-944dh" podStartSLOduration=1.947520179 podStartE2EDuration="3.432873373s" totalImagesPullingTime="1.485353194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:04.431137922 +0000 UTC m=+65.823042093" watchObservedRunningTime="2026-07-06 14:30:04.432873373 +0000 UTC m=+65.824777545"
Jul 06 14:30:04.804156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.804060    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:30:04.806311 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.806291    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:30:04.817135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.817117    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7621a2f6-79b2-4edc-908a-dbd3bc14ab29-metrics-certs\") pod \"network-metrics-daemon-6chcj\" (UID: \"7621a2f6-79b2-4edc-908a-dbd3bc14ab29\") " pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:30:04.904617 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.904579    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:30:04.906728 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.906709    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:30:04.917495 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.917467    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43ce7d1a-cd99-45d8-afc9-69a798e2ed0a-original-pull-secret\") pod \"global-pull-secret-syncer-8qdkn\" (UID: \"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a\") " pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:30:04.969878 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.969849    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qdkn"
Jul 06 14:30:04.977501 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.977476    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s774m\""
Jul 06 14:30:04.986168 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:04.986148    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6chcj"
Jul 06 14:30:05.005678 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.005653    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:30:05.007882 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.007855    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:30:05.019256 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.019232    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:30:05.030009 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.029894    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ngpj\" (UniqueName: \"kubernetes.io/projected/8a3194ff-19d5-47b6-bea2-491230b2c6ea-kube-api-access-5ngpj\") pod \"network-check-target-db26d\" (UID: \"8a3194ff-19d5-47b6-bea2-491230b2c6ea\") " pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:30:05.105355 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.105325    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qdkn"]
Jul 06 14:30:05.108149 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:05.108128    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ce7d1a_cd99_45d8_afc9_69a798e2ed0a.slice/crio-5494b7312cf4fab038ec1be3582ce444aca525a97089fab035e0a9c5800b139f WatchSource:0}: Error finding container 5494b7312cf4fab038ec1be3582ce444aca525a97089fab035e0a9c5800b139f: Status 404 returned error can't find the container with id 5494b7312cf4fab038ec1be3582ce444aca525a97089fab035e0a9c5800b139f
Jul 06 14:30:05.126680 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.126658    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6chcj"]
Jul 06 14:30:05.129266 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:05.129243    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7621a2f6_79b2_4edc_908a_dbd3bc14ab29.slice/crio-a3a7afa838bd8f0f0894f8712d14d38ca006af6b7da4cd187e87ea3806d62dbc WatchSource:0}: Error finding container a3a7afa838bd8f0f0894f8712d14d38ca006af6b7da4cd187e87ea3806d62dbc: Status 404 returned error can't find the container with id a3a7afa838bd8f0f0894f8712d14d38ca006af6b7da4cd187e87ea3806d62dbc
Jul 06 14:30:05.264413 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.264382    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kwxdr\""
Jul 06 14:30:05.273092 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.273061    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:30:05.419132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.419047    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qdkn" event={"ID":"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a","Type":"ContainerStarted","Data":"5494b7312cf4fab038ec1be3582ce444aca525a97089fab035e0a9c5800b139f"}
Jul 06 14:30:05.421072 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.421047    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-db26d"]
Jul 06 14:30:05.422182 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:05.422122    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6chcj" event={"ID":"7621a2f6-79b2-4edc-908a-dbd3bc14ab29","Type":"ContainerStarted","Data":"a3a7afa838bd8f0f0894f8712d14d38ca006af6b7da4cd187e87ea3806d62dbc"}
Jul 06 14:30:05.424004 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:05.423951    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3194ff_19d5_47b6_bea2_491230b2c6ea.slice/crio-12928d348e717a41a5f6e82c0237d0d10467aa06c0a0c44a6c758684b938f5df WatchSource:0}: Error finding container 12928d348e717a41a5f6e82c0237d0d10467aa06c0a0c44a6c758684b938f5df: Status 404 returned error can't find the container with id 12928d348e717a41a5f6e82c0237d0d10467aa06c0a0c44a6c758684b938f5df
Jul 06 14:30:06.431821 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:06.431746    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6chcj" event={"ID":"7621a2f6-79b2-4edc-908a-dbd3bc14ab29","Type":"ContainerStarted","Data":"ba2e221d4a82325e69ecc5c2ed6f516af2afe3d6dd6cdb7081ce86f2eb73ede2"}
Jul 06 14:30:06.434085 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:06.434046    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-db26d" event={"ID":"8a3194ff-19d5-47b6-bea2-491230b2c6ea","Type":"ContainerStarted","Data":"12928d348e717a41a5f6e82c0237d0d10467aa06c0a0c44a6c758684b938f5df"}
Jul 06 14:30:08.448019 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:08.447369    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6chcj" event={"ID":"7621a2f6-79b2-4edc-908a-dbd3bc14ab29","Type":"ContainerStarted","Data":"4844950f5a167bfc1e1140da67cc6848680f97780f1acd3641f78ec5ccd9c100"}
Jul 06 14:30:08.471683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:08.471501    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6chcj" podStartSLOduration=68.338345372 podStartE2EDuration="1m9.471477436s" totalImagesPullingTime="1.133132064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:08.46997249 +0000 UTC m=+69.861876662" watchObservedRunningTime="2026-07-06 14:30:08.471477436 +0000 UTC m=+69.863381608"
Jul 06 14:30:11.664693 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:11.664643    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:30:11.667327 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:11.667299    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e93ea80-81cd-4b78-b9f2-4960fa75bbda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh4zv\" (UID: \"8e93ea80-81cd-4b78-b9f2-4960fa75bbda\") " pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:30:11.922158 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:11.922072    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rzjwm\""
Jul 06 14:30:11.930885 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:11.930848    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qh4zv"
Jul 06 14:30:12.237793 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.237761    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qh4zv"]
Jul 06 14:30:12.240638 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:12.240609    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e93ea80_81cd_4b78_b9f2_4960fa75bbda.slice/crio-db6718967adc7f30b5256b6b205c68d240e7b836de3883f1fa83a9c68d0043a3 WatchSource:0}: Error finding container db6718967adc7f30b5256b6b205c68d240e7b836de3883f1fa83a9c68d0043a3: Status 404 returned error can't find the container with id db6718967adc7f30b5256b6b205c68d240e7b836de3883f1fa83a9c68d0043a3
Jul 06 14:30:12.462112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.461978    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-db26d" event={"ID":"8a3194ff-19d5-47b6-bea2-491230b2c6ea","Type":"ContainerStarted","Data":"2cf08d8be01a67358187796924f93c3b19d3956d867cdd136e127ce395957120"}
Jul 06 14:30:12.462112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.462100    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:30:12.463485 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.463445    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l" event={"ID":"b3196254-7f79-444e-847b-8117bdde0ccd","Type":"ContainerStarted","Data":"8b8b84391156fbf670e2bf58f68f7bc008c3d5be5a22761d1adb1385c44ab27d"}
Jul 06 14:30:12.464866 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.464844    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qdkn" event={"ID":"43ce7d1a-cd99-45d8-afc9-69a798e2ed0a","Type":"ContainerStarted","Data":"162427a1d9aaa279f0083e39ffc8395da590f6b2d6e9b811575603c5131db4a8"}
Jul 06 14:30:12.465920 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.465901    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh4zv" event={"ID":"8e93ea80-81cd-4b78-b9f2-4960fa75bbda","Type":"ContainerStarted","Data":"db6718967adc7f30b5256b6b205c68d240e7b836de3883f1fa83a9c68d0043a3"}
Jul 06 14:30:12.467651 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.467633    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp" event={"ID":"ddceb273-96f8-4a49-9a9f-82209e686b7f","Type":"ContainerStarted","Data":"c2cdc56b4d4fc734ccabba94bd7c36e6c549289a9b348be9d4e5e285723ff5ee"}
Jul 06 14:30:12.467739 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.467661    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp" event={"ID":"ddceb273-96f8-4a49-9a9f-82209e686b7f","Type":"ContainerStarted","Data":"ff8fda334caf325564505dfb0449edb6aabc69efe78a91d49ea8abae6c22fd59"}
Jul 06 14:30:12.467739 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.467674    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp" event={"ID":"ddceb273-96f8-4a49-9a9f-82209e686b7f","Type":"ContainerStarted","Data":"c1f54ee16fe65149bfd7d958e7170a00ec8d4b8c3fa2ba7ccb0919ea7d443f8b"}
Jul 06 14:30:12.490413 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.490351    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-db26d" podStartSLOduration=66.837317423 podStartE2EDuration="1m13.490332318s" totalImagesPullingTime="6.653014895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:12.490070765 +0000 UTC m=+73.881974948" watchObservedRunningTime="2026-07-06 14:30:12.490332318 +0000 UTC m=+73.882236490"
Jul 06 14:30:12.517422 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.517369    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8qdkn" podStartSLOduration=66.540320203 podStartE2EDuration="1m13.517355354s" totalImagesPullingTime="6.977035151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:12.516702445 +0000 UTC m=+73.908606640" watchObservedRunningTime="2026-07-06 14:30:12.517355354 +0000 UTC m=+73.909259503"
Jul 06 14:30:12.602422 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.602358    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bfb76d5b8-p54bp" podStartSLOduration=1.729546058 podStartE2EDuration="11.602336303s" totalImagesPullingTime="9.872790245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:12.599347094 +0000 UTC m=+73.991251264" watchObservedRunningTime="2026-07-06 14:30:12.602336303 +0000 UTC m=+73.994240477"
Jul 06 14:30:12.602828 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:12.602796    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-777d8bdfb-gl97l" podStartSLOduration=1.726757179 podStartE2EDuration="11.60278544s" totalImagesPullingTime="9.876028261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:12.558418423 +0000 UTC m=+73.950322594" watchObservedRunningTime="2026-07-06 14:30:12.60278544 +0000 UTC m=+73.994689610"
Jul 06 14:30:16.485024 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:16.484921    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh4zv" event={"ID":"8e93ea80-81cd-4b78-b9f2-4960fa75bbda","Type":"ContainerStarted","Data":"bca51aa0e5b5cf3e9a17e5f98620dff1e9ff9cd3ca7fa65730ab18548b3b739b"}
Jul 06 14:30:17.490972 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:17.490937    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh4zv" event={"ID":"8e93ea80-81cd-4b78-b9f2-4960fa75bbda","Type":"ContainerStarted","Data":"aee7e7525d4ae05bc7bf8d32705d38bd3a609ee43dedb36e2cd35912d08caa27"}
Jul 06 14:30:19.081875 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.081825    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2g7pn"]
Jul 06 14:30:19.087763 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.087738    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.094907 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.094879    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 14:30:19.095174 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.095155    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 14:30:19.096034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.095668    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 14:30:19.096034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.095709    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-949sp\""
Jul 06 14:30:19.096034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.095872    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 14:30:19.096034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.096023    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 14:30:19.096338 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.096093    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 14:30:19.120237 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120206    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-textfile\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120376 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120252    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d4c379a-b880-4993-989a-68d218366d6b-metrics-client-ca\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120376 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120289    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-sys\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120376 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-root\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120533 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120387    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnt28\" (UniqueName: \"kubernetes.io/projected/9d4c379a-b880-4993-989a-68d218366d6b-kube-api-access-gnt28\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120533 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120424    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-tls\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120533 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120457    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120533 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120491    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.120739 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.120573    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-wtmp\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221181    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221227    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-wtmp\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221255    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-textfile\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221272    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d4c379a-b880-4993-989a-68d218366d6b-metrics-client-ca\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221298    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-sys\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221332    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-root\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221363    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnt28\" (UniqueName: \"kubernetes.io/projected/9d4c379a-b880-4993-989a-68d218366d6b-kube-api-access-gnt28\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221385    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-tls\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221411    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-wtmp\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221432    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-sys\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221440    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d4c379a-b880-4993-989a-68d218366d6b-root\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221418    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221562    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-textfile\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.221982 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.221964    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.222069 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.222025    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d4c379a-b880-4993-989a-68d218366d6b-metrics-client-ca\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.223661 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.223639    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-tls\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.223869 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.223852    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d4c379a-b880-4993-989a-68d218366d6b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.235767 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.235744    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnt28\" (UniqueName: \"kubernetes.io/projected/9d4c379a-b880-4993-989a-68d218366d6b-kube-api-access-gnt28\") pod \"node-exporter-2g7pn\" (UID: \"9d4c379a-b880-4993-989a-68d218366d6b\") " pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.399630 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.399588    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2g7pn"
Jul 06 14:30:19.409592 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:19.409564    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4c379a_b880_4993_989a_68d218366d6b.slice/crio-c29fa84c93f8b8a02f86c98a6987d03e764112ef29d294f0945f938206d48483 WatchSource:0}: Error finding container c29fa84c93f8b8a02f86c98a6987d03e764112ef29d294f0945f938206d48483: Status 404 returned error can't find the container with id c29fa84c93f8b8a02f86c98a6987d03e764112ef29d294f0945f938206d48483
Jul 06 14:30:19.499918 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.499878    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g7pn" event={"ID":"9d4c379a-b880-4993-989a-68d218366d6b","Type":"ContainerStarted","Data":"c29fa84c93f8b8a02f86c98a6987d03e764112ef29d294f0945f938206d48483"}
Jul 06 14:30:19.501849 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.501824    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh4zv" event={"ID":"8e93ea80-81cd-4b78-b9f2-4960fa75bbda","Type":"ContainerStarted","Data":"af626d84f0d48e2c72691ba154a1b9eec025ee93f676f8bdc5aef2d63a14fbd6"}
Jul 06 14:30:19.535540 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:19.535491    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qh4zv" podStartSLOduration=33.641872206 podStartE2EDuration="40.535476139s" totalImagesPullingTime="6.893603933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:29:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:19.534275871 +0000 UTC m=+80.926180043" watchObservedRunningTime="2026-07-06 14:30:19.535476139 +0000 UTC m=+80.927380309"
Jul 06 14:30:21.509952 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:21.509918    2552 generic.go:356] "Generic (PLEG): container finished" podID="9d4c379a-b880-4993-989a-68d218366d6b" containerID="23d72d099493133320164a56a28caff39e2690fea5c3d4757e11c934576c1fc9" exitCode=0
Jul 06 14:30:21.510320 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:21.509986    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g7pn" event={"ID":"9d4c379a-b880-4993-989a-68d218366d6b","Type":"ContainerDied","Data":"23d72d099493133320164a56a28caff39e2690fea5c3d4757e11c934576c1fc9"}
Jul 06 14:30:21.863091 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:21.863017    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:30:22.515938 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:22.515903    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g7pn" event={"ID":"9d4c379a-b880-4993-989a-68d218366d6b","Type":"ContainerStarted","Data":"2a8b1b7d4f6ebf2b65ca27147a9e0dc069e558eaf407ff8dad223d0b16c62193"}
Jul 06 14:30:22.516326 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:22.515962    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2g7pn" event={"ID":"9d4c379a-b880-4993-989a-68d218366d6b","Type":"ContainerStarted","Data":"3d38417dee975557f5934a4699ba81d66f35464e428871e3cf14cf6d6d0a7d59"}
Jul 06 14:30:22.537558 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:22.537499    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2g7pn" podStartSLOduration=2.295527513 podStartE2EDuration="3.53747967s" totalImagesPullingTime="1.17985464s" totalInitContainerRuntime="62.097517ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:22.536775561 +0000 UTC m=+83.928679733" watchObservedRunningTime="2026-07-06 14:30:22.53747967 +0000 UTC m=+83.929383842"
Jul 06 14:30:26.876455 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:26.876387    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7889cf85c9-796t6" podUID="dfc624a4-ea13-441e-bbfa-9b207d3f3a76" containerName="registry" containerID="cri-o://3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7" gracePeriod=30
Jul 06 14:30:27.119081 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.119056    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:30:27.181245 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181143    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-certificates\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181245 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181200    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-bound-sa-token\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181245 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181239    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181516 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181266    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-ca-trust-extracted\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181516 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181286    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-image-registry-private-configuration\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181516 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181307    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-installation-pull-secrets\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181516 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181331    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-trusted-ca\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181516 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181361    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7h94\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-kube-api-access-d7h94\") pod \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\" (UID: \"dfc624a4-ea13-441e-bbfa-9b207d3f3a76\") "
Jul 06 14:30:27.181763 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.181715    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:30:27.182407 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.182373    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:30:27.183793 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.183763    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:30:27.183899 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.183870    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:30:27.183976 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.183884    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:30:27.183976 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.183955    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:30:27.184090 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.184009    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-kube-api-access-d7h94" (OuterVolumeSpecName: "kube-api-access-d7h94") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "kube-api-access-d7h94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:30:27.189895 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.189863    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dfc624a4-ea13-441e-bbfa-9b207d3f3a76" (UID: "dfc624a4-ea13-441e-bbfa-9b207d3f3a76"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:30:27.282456 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282413    2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-bound-sa-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.282456 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282448    2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-tls\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.282456 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282457    2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-ca-trust-extracted\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.282756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282469    2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-image-registry-private-configuration\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.282756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282480    2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-installation-pull-secrets\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.282756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282490    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-trusted-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.282756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282499    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7h94\" (UniqueName: \"kubernetes.io/projected/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-kube-api-access-d7h94\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.282756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.282507    2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfc624a4-ea13-441e-bbfa-9b207d3f3a76-registry-certificates\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:30:27.537026 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.536921    2552 generic.go:356] "Generic (PLEG): container finished" podID="dfc624a4-ea13-441e-bbfa-9b207d3f3a76" containerID="3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7" exitCode=0
Jul 06 14:30:27.537026 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.536985    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7889cf85c9-796t6"
Jul 06 14:30:27.537204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.537024    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7889cf85c9-796t6" event={"ID":"dfc624a4-ea13-441e-bbfa-9b207d3f3a76","Type":"ContainerDied","Data":"3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7"}
Jul 06 14:30:27.537204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.537107    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7889cf85c9-796t6" event={"ID":"dfc624a4-ea13-441e-bbfa-9b207d3f3a76","Type":"ContainerDied","Data":"f1671350281d977b5d0068e0d1b8499bffbcecf41d0671b5ca28eff04fb35169"}
Jul 06 14:30:27.537204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.537143    2552 scope.go:117] "RemoveContainer" containerID="3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7"
Jul 06 14:30:27.545418 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.545395    2552 scope.go:117] "RemoveContainer" containerID="3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7"
Jul 06 14:30:27.545697 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:30:27.545675    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7\": container with ID starting with 3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7 not found: ID does not exist" containerID="3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7"
Jul 06 14:30:27.545762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.545705    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7"} err="failed to get container status \"3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7\": rpc error: code = NotFound desc = could not find container \"3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7\": container with ID starting with 3e657a01c938e30e8f74b668d59d3990b0397dff269a810eaaf822ae7fd8e9f7 not found: ID does not exist"
Jul 06 14:30:27.565468 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.565434    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7889cf85c9-796t6"]
Jul 06 14:30:27.576455 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:27.576424    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7889cf85c9-796t6"]
Jul 06 14:30:29.154490 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:29.154458    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc624a4-ea13-441e-bbfa-9b207d3f3a76" path="/var/lib/kubelet/pods/dfc624a4-ea13-441e-bbfa-9b207d3f3a76/volumes"
Jul 06 14:30:36.286166 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.286130    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b95f7869f-4jv8t"]
Jul 06 14:30:36.286548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.286347    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc624a4-ea13-441e-bbfa-9b207d3f3a76" containerName="registry"
Jul 06 14:30:36.286548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.286359    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc624a4-ea13-441e-bbfa-9b207d3f3a76" containerName="registry"
Jul 06 14:30:36.286548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.286403    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc624a4-ea13-441e-bbfa-9b207d3f3a76" containerName="registry"
Jul 06 14:30:36.291354 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.291334    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.293964 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.293945    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 14:30:36.294684 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.294663    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 14:30:36.294780 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.294687    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 14:30:36.294848 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.294831    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 14:30:36.294955 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.294939    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jvpvc\""
Jul 06 14:30:36.295043 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.294952    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 14:30:36.295100 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.295078    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 14:30:36.295152 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.295118    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 14:30:36.321262 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.321226    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b95f7869f-4jv8t"]
Jul 06 14:30:36.346812 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.346767    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-serving-cert\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.346812 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.346822    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkvr2\" (UniqueName: \"kubernetes.io/projected/b0b65f42-a084-404a-8f6e-1bea695ea26f-kube-api-access-gkvr2\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.347034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.346843    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-oauth-config\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.347034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.346861    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-oauth-serving-cert\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.347034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.346876    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-config\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.347034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.346902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-service-ca\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.447731 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.447701    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-serving-cert\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.447855 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.447743    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkvr2\" (UniqueName: \"kubernetes.io/projected/b0b65f42-a084-404a-8f6e-1bea695ea26f-kube-api-access-gkvr2\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.447855 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.447776    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-oauth-config\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.447954 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.447894    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-oauth-serving-cert\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.447954 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.447928    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-config\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.448082 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.447961    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-service-ca\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.448635 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.448613    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-service-ca\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.448746 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.448725    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-config\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.448788 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.448734    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-oauth-serving-cert\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.450339 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.450310    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-oauth-config\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.450417 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.450320    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-serving-cert\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.460357 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.460334    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkvr2\" (UniqueName: \"kubernetes.io/projected/b0b65f42-a084-404a-8f6e-1bea695ea26f-kube-api-access-gkvr2\") pod \"console-b95f7869f-4jv8t\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") " pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.600948 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.600861    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:36.731266 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:36.731240    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b95f7869f-4jv8t"]
Jul 06 14:30:36.732098 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:36.732064    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b65f42_a084_404a_8f6e_1bea695ea26f.slice/crio-f4afd4391d00a0f568b925a9efb5d2a4a7f0d0253eb0d3bca7ecc100d6f2129b WatchSource:0}: Error finding container f4afd4391d00a0f568b925a9efb5d2a4a7f0d0253eb0d3bca7ecc100d6f2129b: Status 404 returned error can't find the container with id f4afd4391d00a0f568b925a9efb5d2a4a7f0d0253eb0d3bca7ecc100d6f2129b
Jul 06 14:30:37.571036 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:37.571001    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95f7869f-4jv8t" event={"ID":"b0b65f42-a084-404a-8f6e-1bea695ea26f","Type":"ContainerStarted","Data":"f4afd4391d00a0f568b925a9efb5d2a4a7f0d0253eb0d3bca7ecc100d6f2129b"}
Jul 06 14:30:40.584086 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:40.584005    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95f7869f-4jv8t" event={"ID":"b0b65f42-a084-404a-8f6e-1bea695ea26f","Type":"ContainerStarted","Data":"9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb"}
Jul 06 14:30:40.624015 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:40.623945    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b95f7869f-4jv8t" podStartSLOduration=1.241217054 podStartE2EDuration="4.623930349s" totalImagesPullingTime="3.382713295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:40.623697522 +0000 UTC m=+102.015601693" watchObservedRunningTime="2026-07-06 14:30:40.623930349 +0000 UTC m=+102.015834518"
Jul 06 14:30:43.475787 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:43.475750    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-db26d"
Jul 06 14:30:44.973908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:44.973872    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7bc4fd58-8gnmx"]
Jul 06 14:30:45.019276 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.019236    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7bc4fd58-8gnmx"]
Jul 06 14:30:45.019450 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.019337    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.026960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.026932    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 14:30:45.112931 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.112894    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-console-config\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.112931 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.112932    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-oauth-serving-cert\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.113190 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.112956    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-service-ca\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.113190 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.113014    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-trusted-ca-bundle\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.113190 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.113088    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-serving-cert\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.113190 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.113116    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-oauth-config\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.113190 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.113151    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2v7\" (UniqueName: \"kubernetes.io/projected/c2542876-626d-42cc-a550-ff18b239505e-kube-api-access-wt2v7\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.213694 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.213652    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-trusted-ca-bundle\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.213895 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.213708    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-serving-cert\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.213895 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.213734    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-oauth-config\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.213895 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.213769    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2v7\" (UniqueName: \"kubernetes.io/projected/c2542876-626d-42cc-a550-ff18b239505e-kube-api-access-wt2v7\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.213895 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.213807    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-console-config\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.213895 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.213835    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-oauth-serving-cert\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.213895 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.213866    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-service-ca\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.214737 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.214710    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-oauth-serving-cert\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.214834 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.214766    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-service-ca\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.214834 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.214808    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-console-config\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.215221 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.215202    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-trusted-ca-bundle\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.216378 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.216357    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-oauth-config\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.216433 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.216398    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-serving-cert\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.222763 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.222742    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2v7\" (UniqueName: \"kubernetes.io/projected/c2542876-626d-42cc-a550-ff18b239505e-kube-api-access-wt2v7\") pod \"console-5c7bc4fd58-8gnmx\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") " pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.328007 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.327911    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:45.484893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.484863    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7bc4fd58-8gnmx"]
Jul 06 14:30:45.488370 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:30:45.488343    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2542876_626d_42cc_a550_ff18b239505e.slice/crio-e6f5f2e5f3b2dadd437f385aac70dccb2d7020e14bda69462b114e1e5add88e5 WatchSource:0}: Error finding container e6f5f2e5f3b2dadd437f385aac70dccb2d7020e14bda69462b114e1e5add88e5: Status 404 returned error can't find the container with id e6f5f2e5f3b2dadd437f385aac70dccb2d7020e14bda69462b114e1e5add88e5
Jul 06 14:30:45.602424 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:45.602401    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bc4fd58-8gnmx" event={"ID":"c2542876-626d-42cc-a550-ff18b239505e","Type":"ContainerStarted","Data":"e6f5f2e5f3b2dadd437f385aac70dccb2d7020e14bda69462b114e1e5add88e5"}
Jul 06 14:30:46.601793 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:46.601746    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:46.602243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:46.601821    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:46.607102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:46.607078    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:46.608212 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:46.608184    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bc4fd58-8gnmx" event={"ID":"c2542876-626d-42cc-a550-ff18b239505e","Type":"ContainerStarted","Data":"0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618"}
Jul 06 14:30:46.611943 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:46.611923    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:30:46.666572 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:46.666517    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7bc4fd58-8gnmx" podStartSLOduration=2.666500816 podStartE2EDuration="2.666500816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:30:46.665309264 +0000 UTC m=+108.057213438" watchObservedRunningTime="2026-07-06 14:30:46.666500816 +0000 UTC m=+108.058405046"
Jul 06 14:30:55.328336 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:55.328304    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:55.328859 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:55.328365    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:55.333157 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:55.333135    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:55.644217 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:55.644191    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:30:55.717882 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:30:55.717850    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b95f7869f-4jv8t"]
Jul 06 14:31:20.741170 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:20.741109    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b95f7869f-4jv8t" podUID="b0b65f42-a084-404a-8f6e-1bea695ea26f" containerName="console" containerID="cri-o://9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb" gracePeriod=15
Jul 06 14:31:20.978898 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:20.978866    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:31:21.077479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077388    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-serving-cert\") pod \"b0b65f42-a084-404a-8f6e-1bea695ea26f\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") "
Jul 06 14:31:21.077479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077422    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-oauth-config\") pod \"b0b65f42-a084-404a-8f6e-1bea695ea26f\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") "
Jul 06 14:31:21.077479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077459    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-oauth-serving-cert\") pod \"b0b65f42-a084-404a-8f6e-1bea695ea26f\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") "
Jul 06 14:31:21.077750 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077485    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-service-ca\") pod \"b0b65f42-a084-404a-8f6e-1bea695ea26f\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") "
Jul 06 14:31:21.077750 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077621    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkvr2\" (UniqueName: \"kubernetes.io/projected/b0b65f42-a084-404a-8f6e-1bea695ea26f-kube-api-access-gkvr2\") pod \"b0b65f42-a084-404a-8f6e-1bea695ea26f\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") "
Jul 06 14:31:21.077750 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077680    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-config\") pod \"b0b65f42-a084-404a-8f6e-1bea695ea26f\" (UID: \"b0b65f42-a084-404a-8f6e-1bea695ea26f\") "
Jul 06 14:31:21.077934 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077910    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0b65f42-a084-404a-8f6e-1bea695ea26f" (UID: "b0b65f42-a084-404a-8f6e-1bea695ea26f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:31:21.078022 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.077925    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0b65f42-a084-404a-8f6e-1bea695ea26f" (UID: "b0b65f42-a084-404a-8f6e-1bea695ea26f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:31:21.078118 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.078092    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-config" (OuterVolumeSpecName: "console-config") pod "b0b65f42-a084-404a-8f6e-1bea695ea26f" (UID: "b0b65f42-a084-404a-8f6e-1bea695ea26f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:31:21.079828 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.079806    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0b65f42-a084-404a-8f6e-1bea695ea26f" (UID: "b0b65f42-a084-404a-8f6e-1bea695ea26f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:31:21.079891 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.079838    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0b65f42-a084-404a-8f6e-1bea695ea26f" (UID: "b0b65f42-a084-404a-8f6e-1bea695ea26f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:31:21.079930 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.079917    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b65f42-a084-404a-8f6e-1bea695ea26f-kube-api-access-gkvr2" (OuterVolumeSpecName: "kube-api-access-gkvr2") pod "b0b65f42-a084-404a-8f6e-1bea695ea26f" (UID: "b0b65f42-a084-404a-8f6e-1bea695ea26f"). InnerVolumeSpecName "kube-api-access-gkvr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:31:21.178911 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.178879    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkvr2\" (UniqueName: \"kubernetes.io/projected/b0b65f42-a084-404a-8f6e-1bea695ea26f-kube-api-access-gkvr2\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:31:21.178911 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.178911    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:31:21.179112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.178925    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:31:21.179112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.178935    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0b65f42-a084-404a-8f6e-1bea695ea26f-console-oauth-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:31:21.179112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.178944    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-oauth-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:31:21.179112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.178952    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b65f42-a084-404a-8f6e-1bea695ea26f-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:31:21.726501 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.726467    2552 generic.go:356] "Generic (PLEG): container finished" podID="b0b65f42-a084-404a-8f6e-1bea695ea26f" containerID="9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb" exitCode=0
Jul 06 14:31:21.726665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.726521    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95f7869f-4jv8t"
Jul 06 14:31:21.726665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.726546    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95f7869f-4jv8t" event={"ID":"b0b65f42-a084-404a-8f6e-1bea695ea26f","Type":"ContainerDied","Data":"9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb"}
Jul 06 14:31:21.726665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.726601    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95f7869f-4jv8t" event={"ID":"b0b65f42-a084-404a-8f6e-1bea695ea26f","Type":"ContainerDied","Data":"f4afd4391d00a0f568b925a9efb5d2a4a7f0d0253eb0d3bca7ecc100d6f2129b"}
Jul 06 14:31:21.726665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.726624    2552 scope.go:117] "RemoveContainer" containerID="9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb"
Jul 06 14:31:21.734350 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.734334    2552 scope.go:117] "RemoveContainer" containerID="9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb"
Jul 06 14:31:21.734653 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:31:21.734630    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb\": container with ID starting with 9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb not found: ID does not exist" containerID="9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb"
Jul 06 14:31:21.734705 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.734665    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb"} err="failed to get container status \"9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb\": rpc error: code = NotFound desc = could not find container \"9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb\": container with ID starting with 9a1297059773f369a86b833f8b85d2401f8960e07d947a5fb82f812774f9beeb not found: ID does not exist"
Jul 06 14:31:21.745931 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.745904    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b95f7869f-4jv8t"]
Jul 06 14:31:21.751589 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:21.751568    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b95f7869f-4jv8t"]
Jul 06 14:31:23.154964 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:23.154931    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b65f42-a084-404a-8f6e-1bea695ea26f" path="/var/lib/kubelet/pods/b0b65f42-a084-404a-8f6e-1bea695ea26f/volumes"
Jul 06 14:31:43.787021 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.786973    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69f5699db6-ggnrs"]
Jul 06 14:31:43.787478 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.787296    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b65f42-a084-404a-8f6e-1bea695ea26f" containerName="console"
Jul 06 14:31:43.787478 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.787311    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b65f42-a084-404a-8f6e-1bea695ea26f" containerName="console"
Jul 06 14:31:43.787478 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.787361    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b65f42-a084-404a-8f6e-1bea695ea26f" containerName="console"
Jul 06 14:31:43.790439 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.790421    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.793425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.793404    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 14:31:43.793425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.793418    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 14:31:43.793581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.793406    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 14:31:43.793581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.793562    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 14:31:43.793683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.793630    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 14:31:43.793847 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.793833    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wsfd9\""
Jul 06 14:31:43.800275 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.800253    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 14:31:43.810299 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.810272    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69f5699db6-ggnrs"]
Jul 06 14:31:43.834498 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834464    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-secret-telemeter-client\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.834498 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834510    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-telemeter-client-tls\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.834766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834553    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-federate-client-tls\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.834766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834576    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-metrics-client-ca\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.834766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834610    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.834766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834741    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-serving-certs-ca-bundle\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.834943 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834792    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.834943 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.834820    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn2sd\" (UniqueName: \"kubernetes.io/projected/6b5be752-9ed5-4b00-9e36-e36303dd188b-kube-api-access-vn2sd\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.935702 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935668    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-serving-certs-ca-bundle\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.935896 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935710    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.935896 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935730    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn2sd\" (UniqueName: \"kubernetes.io/projected/6b5be752-9ed5-4b00-9e36-e36303dd188b-kube-api-access-vn2sd\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.935896 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935811    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-secret-telemeter-client\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.935896 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935854    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-telemeter-client-tls\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.936116 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935913    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-federate-client-tls\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.936116 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935947    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-metrics-client-ca\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.936116 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.935983    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.936752 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.936724    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-serving-certs-ca-bundle\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.936866 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.936731    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-metrics-client-ca\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.936927 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.936901    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b5be752-9ed5-4b00-9e36-e36303dd188b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.938590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.938565    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-federate-client-tls\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.938667 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.938617    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.938815 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.938799    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-telemeter-client-tls\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.938851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.938829    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b5be752-9ed5-4b00-9e36-e36303dd188b-secret-telemeter-client\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:43.945236 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:43.945218    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn2sd\" (UniqueName: \"kubernetes.io/projected/6b5be752-9ed5-4b00-9e36-e36303dd188b-kube-api-access-vn2sd\") pod \"telemeter-client-69f5699db6-ggnrs\" (UID: \"6b5be752-9ed5-4b00-9e36-e36303dd188b\") " pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:44.099764 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:44.099672    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs"
Jul 06 14:31:44.248606 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:44.248568    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69f5699db6-ggnrs"]
Jul 06 14:31:44.254236 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:31:44.254196    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5be752_9ed5_4b00_9e36_e36303dd188b.slice/crio-df077962750747139d27f764379280250a254d098bdec66ef73084f2ed15d260 WatchSource:0}: Error finding container df077962750747139d27f764379280250a254d098bdec66ef73084f2ed15d260: Status 404 returned error can't find the container with id df077962750747139d27f764379280250a254d098bdec66ef73084f2ed15d260
Jul 06 14:31:44.801833 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:44.801795    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs" event={"ID":"6b5be752-9ed5-4b00-9e36-e36303dd188b","Type":"ContainerStarted","Data":"df077962750747139d27f764379280250a254d098bdec66ef73084f2ed15d260"}
Jul 06 14:31:46.810617 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:46.810526    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs" event={"ID":"6b5be752-9ed5-4b00-9e36-e36303dd188b","Type":"ContainerStarted","Data":"8d65231ba19f52032cbd099a2ee1da18e48df069ae421200cdee2ebdaaa15774"}
Jul 06 14:31:48.819866 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:48.819829    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs" event={"ID":"6b5be752-9ed5-4b00-9e36-e36303dd188b","Type":"ContainerStarted","Data":"3e63f6ce43d8c39f851c17c53156265a1cc4b0d9c65dd589b2f14ecb72f90bea"}
Jul 06 14:31:48.820370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:48.819884    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs" event={"ID":"6b5be752-9ed5-4b00-9e36-e36303dd188b","Type":"ContainerStarted","Data":"49e28f5db8e879f62270948b52d22935b8e10f33522f21704dac9c4c95511a7c"}
Jul 06 14:31:48.849782 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:48.849732    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69f5699db6-ggnrs" podStartSLOduration=2.129464142 podStartE2EDuration="5.849716747s" totalImagesPullingTime="3.720252605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:48.849293883 +0000 UTC m=+170.241198067" watchObservedRunningTime="2026-07-06 14:31:48.849716747 +0000 UTC m=+170.241620951"
Jul 06 14:31:49.595006 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.594965    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9f6db494-4g8g6"]
Jul 06 14:31:49.597214 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.597197    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.615270 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.615239    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9f6db494-4g8g6"]
Jul 06 14:31:49.678363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.678328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-service-ca\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.678363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.678366    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-oauth-config\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.678595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.678382    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-trusted-ca-bundle\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.678595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.678403    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-serving-cert\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.678595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.678495    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klnc7\" (UniqueName: \"kubernetes.io/projected/a5d94c3f-e673-4aee-92c8-82f4df68c7be-kube-api-access-klnc7\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.678595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.678557    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-config\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.678732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.678602    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-oauth-serving-cert\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.779678 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.779635    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-service-ca\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.779678 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.779677    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-oauth-config\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.779928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.779694    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-trusted-ca-bundle\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.779928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.779831    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-serving-cert\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.779928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.779891    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klnc7\" (UniqueName: \"kubernetes.io/projected/a5d94c3f-e673-4aee-92c8-82f4df68c7be-kube-api-access-klnc7\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.780122 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.779964    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-config\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.780122 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.780027    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-oauth-serving-cert\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.780585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.780563    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-trusted-ca-bundle\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.780711 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.780559    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-service-ca\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.780777 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.780756    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-oauth-serving-cert\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.780835 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.780753    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-config\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.782262 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.782242    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-oauth-config\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.782440 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.782422    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-serving-cert\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.790757 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.790733    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klnc7\" (UniqueName: \"kubernetes.io/projected/a5d94c3f-e673-4aee-92c8-82f4df68c7be-kube-api-access-klnc7\") pod \"console-5d9f6db494-4g8g6\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") " pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:49.906397 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:49.906354    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:50.107576 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:31:50.107537    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d94c3f_e673_4aee_92c8_82f4df68c7be.slice/crio-c61f961e2cd9f196c221414b5cba4ab64694950b113b8703f06bbafb987d3d8f WatchSource:0}: Error finding container c61f961e2cd9f196c221414b5cba4ab64694950b113b8703f06bbafb987d3d8f: Status 404 returned error can't find the container with id c61f961e2cd9f196c221414b5cba4ab64694950b113b8703f06bbafb987d3d8f
Jul 06 14:31:50.113009 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:50.112969    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9f6db494-4g8g6"]
Jul 06 14:31:50.827419 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:50.827328    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9f6db494-4g8g6" event={"ID":"a5d94c3f-e673-4aee-92c8-82f4df68c7be","Type":"ContainerStarted","Data":"dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e"}
Jul 06 14:31:50.827419 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:50.827390    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9f6db494-4g8g6" event={"ID":"a5d94c3f-e673-4aee-92c8-82f4df68c7be","Type":"ContainerStarted","Data":"c61f961e2cd9f196c221414b5cba4ab64694950b113b8703f06bbafb987d3d8f"}
Jul 06 14:31:50.860987 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:50.860917    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9f6db494-4g8g6" podStartSLOduration=1.860899002 podStartE2EDuration="1.860899002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:50.860115101 +0000 UTC m=+172.252019274" watchObservedRunningTime="2026-07-06 14:31:50.860899002 +0000 UTC m=+172.252803173"
Jul 06 14:31:59.906496 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:59.906453    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:59.906935 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:59.906530    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:31:59.911359 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:31:59.911333    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:32:00.864250 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:00.864223    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:32:00.913422 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:00.913388    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7bc4fd58-8gnmx"]
Jul 06 14:32:25.933907 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:25.933841    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c7bc4fd58-8gnmx" podUID="c2542876-626d-42cc-a550-ff18b239505e" containerName="console" containerID="cri-o://0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618" gracePeriod=15
Jul 06 14:32:26.175466 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.175443    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:32:26.266987 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.266887    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-console-config\") pod \"c2542876-626d-42cc-a550-ff18b239505e\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") "
Jul 06 14:32:26.266987 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.266939    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-service-ca\") pod \"c2542876-626d-42cc-a550-ff18b239505e\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") "
Jul 06 14:32:26.266987 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.266965    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-serving-cert\") pod \"c2542876-626d-42cc-a550-ff18b239505e\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") "
Jul 06 14:32:26.267284 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267012    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-oauth-config\") pod \"c2542876-626d-42cc-a550-ff18b239505e\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") "
Jul 06 14:32:26.267284 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267049    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-oauth-serving-cert\") pod \"c2542876-626d-42cc-a550-ff18b239505e\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") "
Jul 06 14:32:26.267284 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267070    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt2v7\" (UniqueName: \"kubernetes.io/projected/c2542876-626d-42cc-a550-ff18b239505e-kube-api-access-wt2v7\") pod \"c2542876-626d-42cc-a550-ff18b239505e\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") "
Jul 06 14:32:26.267284 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267117    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-trusted-ca-bundle\") pod \"c2542876-626d-42cc-a550-ff18b239505e\" (UID: \"c2542876-626d-42cc-a550-ff18b239505e\") "
Jul 06 14:32:26.267487 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267332    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-console-config" (OuterVolumeSpecName: "console-config") pod "c2542876-626d-42cc-a550-ff18b239505e" (UID: "c2542876-626d-42cc-a550-ff18b239505e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:32:26.267550 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267518    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2542876-626d-42cc-a550-ff18b239505e" (UID: "c2542876-626d-42cc-a550-ff18b239505e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:32:26.267604 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267541    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2542876-626d-42cc-a550-ff18b239505e" (UID: "c2542876-626d-42cc-a550-ff18b239505e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:32:26.267676 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.267637    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c2542876-626d-42cc-a550-ff18b239505e" (UID: "c2542876-626d-42cc-a550-ff18b239505e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:32:26.269160 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.269137    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2542876-626d-42cc-a550-ff18b239505e" (UID: "c2542876-626d-42cc-a550-ff18b239505e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:32:26.269299 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.269276    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2542876-626d-42cc-a550-ff18b239505e" (UID: "c2542876-626d-42cc-a550-ff18b239505e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:32:26.269299 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.269285    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2542876-626d-42cc-a550-ff18b239505e-kube-api-access-wt2v7" (OuterVolumeSpecName: "kube-api-access-wt2v7") pod "c2542876-626d-42cc-a550-ff18b239505e" (UID: "c2542876-626d-42cc-a550-ff18b239505e"). InnerVolumeSpecName "kube-api-access-wt2v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:32:26.368593 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.368548    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-console-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:32:26.368593 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.368582    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:32:26.368593 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.368591    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:32:26.368593 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.368600    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2542876-626d-42cc-a550-ff18b239505e-console-oauth-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:32:26.368860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.368609    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-oauth-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:32:26.368860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.368617    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt2v7\" (UniqueName: \"kubernetes.io/projected/c2542876-626d-42cc-a550-ff18b239505e-kube-api-access-wt2v7\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:32:26.368860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.368627    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2542876-626d-42cc-a550-ff18b239505e-trusted-ca-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:32:26.945677 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.945641    2552 generic.go:356] "Generic (PLEG): container finished" podID="c2542876-626d-42cc-a550-ff18b239505e" containerID="0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618" exitCode=0
Jul 06 14:32:26.946141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.945687    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bc4fd58-8gnmx"
Jul 06 14:32:26.946141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.945719    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bc4fd58-8gnmx" event={"ID":"c2542876-626d-42cc-a550-ff18b239505e","Type":"ContainerDied","Data":"0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618"}
Jul 06 14:32:26.946141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.945758    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bc4fd58-8gnmx" event={"ID":"c2542876-626d-42cc-a550-ff18b239505e","Type":"ContainerDied","Data":"e6f5f2e5f3b2dadd437f385aac70dccb2d7020e14bda69462b114e1e5add88e5"}
Jul 06 14:32:26.946141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.945777    2552 scope.go:117] "RemoveContainer" containerID="0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618"
Jul 06 14:32:26.953983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.953964    2552 scope.go:117] "RemoveContainer" containerID="0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618"
Jul 06 14:32:26.954250 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:32:26.954230    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618\": container with ID starting with 0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618 not found: ID does not exist" containerID="0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618"
Jul 06 14:32:26.954294 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.954259    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618"} err="failed to get container status \"0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618\": rpc error: code = NotFound desc = could not find container \"0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618\": container with ID starting with 0b8b68d483bd2709f2e3773e9a9049b13996a68acd6ed06c77823da89d267618 not found: ID does not exist"
Jul 06 14:32:26.968530 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.968506    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7bc4fd58-8gnmx"]
Jul 06 14:32:26.974756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:26.974733    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7bc4fd58-8gnmx"]
Jul 06 14:32:27.154568 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:32:27.154537    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2542876-626d-42cc-a550-ff18b239505e" path="/var/lib/kubelet/pods/c2542876-626d-42cc-a550-ff18b239505e/volumes"
Jul 06 14:33:14.607196 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.607161    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-87cf5bbcd-kbxdv"]
Jul 06 14:33:14.607648 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.607393    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2542876-626d-42cc-a550-ff18b239505e" containerName="console"
Jul 06 14:33:14.607648 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.607404    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2542876-626d-42cc-a550-ff18b239505e" containerName="console"
Jul 06 14:33:14.607648 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.607457    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2542876-626d-42cc-a550-ff18b239505e" containerName="console"
Jul 06 14:33:14.611422 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.611405    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.621700 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.621673    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87cf5bbcd-kbxdv"]
Jul 06 14:33:14.707349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.707308    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-oauth-config\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.707349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.707357    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-oauth-serving-cert\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.707554 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.707385    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-trusted-ca-bundle\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.707554 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.707435    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-service-ca\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.707554 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.707471    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-config\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.707554 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.707498    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-serving-cert\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.707554 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.707543    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7bdb\" (UniqueName: \"kubernetes.io/projected/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-kube-api-access-x7bdb\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.808633 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.808592    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-serving-cert\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.808809 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.808646    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7bdb\" (UniqueName: \"kubernetes.io/projected/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-kube-api-access-x7bdb\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.808809 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.808667    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-oauth-config\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.808809 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.808687    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-oauth-serving-cert\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.808809 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.808710    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-trusted-ca-bundle\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.808809 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.808730    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-service-ca\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.808809 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.808751    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-config\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.809575 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.809548    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-oauth-serving-cert\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.809575 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.809567    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-service-ca\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.809704 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.809567    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-config\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.809704 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.809625    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-trusted-ca-bundle\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.811529 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.811511    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-oauth-config\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.811623 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.811608    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-serving-cert\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.819725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.819696    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7bdb\" (UniqueName: \"kubernetes.io/projected/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-kube-api-access-x7bdb\") pod \"console-87cf5bbcd-kbxdv\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") " pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:14.920132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:14.920098    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:15.052963 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:15.052925    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87cf5bbcd-kbxdv"]
Jul 06 14:33:15.055876 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:33:15.055846    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda689d5ae_0e37_4e85_b1df_65bb967f8aaf.slice/crio-aab7692b7693b340a8d1c4b03666629708ea231a46c53eaa6facafdfc9cf64cc WatchSource:0}: Error finding container aab7692b7693b340a8d1c4b03666629708ea231a46c53eaa6facafdfc9cf64cc: Status 404 returned error can't find the container with id aab7692b7693b340a8d1c4b03666629708ea231a46c53eaa6facafdfc9cf64cc
Jul 06 14:33:15.105325 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:15.105299    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87cf5bbcd-kbxdv" event={"ID":"a689d5ae-0e37-4e85-b1df-65bb967f8aaf","Type":"ContainerStarted","Data":"aab7692b7693b340a8d1c4b03666629708ea231a46c53eaa6facafdfc9cf64cc"}
Jul 06 14:33:16.110460 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:16.110427    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87cf5bbcd-kbxdv" event={"ID":"a689d5ae-0e37-4e85-b1df-65bb967f8aaf","Type":"ContainerStarted","Data":"69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0"}
Jul 06 14:33:16.143609 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:16.143555    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-87cf5bbcd-kbxdv" podStartSLOduration=2.143539906 podStartE2EDuration="2.143539906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:33:16.141444253 +0000 UTC m=+257.533348423" watchObservedRunningTime="2026-07-06 14:33:16.143539906 +0000 UTC m=+257.535444077"
Jul 06 14:33:24.920673 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:24.920577    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:24.920673 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:24.920641    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:24.925121 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:24.925098    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:25.143625 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:25.143596    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:33:25.192671 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:25.192582    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9f6db494-4g8g6"]
Jul 06 14:33:50.212144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.212079    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d9f6db494-4g8g6" podUID="a5d94c3f-e673-4aee-92c8-82f4df68c7be" containerName="console" containerID="cri-o://dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e" gracePeriod=15
Jul 06 14:33:50.444879 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.444854    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:33:50.583333 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583240    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-config\") pod \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") "
Jul 06 14:33:50.583333 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583287    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-oauth-serving-cert\") pod \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") "
Jul 06 14:33:50.583333 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583311    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klnc7\" (UniqueName: \"kubernetes.io/projected/a5d94c3f-e673-4aee-92c8-82f4df68c7be-kube-api-access-klnc7\") pod \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") "
Jul 06 14:33:50.583544 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583353    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-trusted-ca-bundle\") pod \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") "
Jul 06 14:33:50.583544 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583397    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-service-ca\") pod \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") "
Jul 06 14:33:50.583544 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583444    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-oauth-config\") pod \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") "
Jul 06 14:33:50.583544 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583468    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-serving-cert\") pod \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\" (UID: \"a5d94c3f-e673-4aee-92c8-82f4df68c7be\") "
Jul 06 14:33:50.583793 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583760    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-config" (OuterVolumeSpecName: "console-config") pod "a5d94c3f-e673-4aee-92c8-82f4df68c7be" (UID: "a5d94c3f-e673-4aee-92c8-82f4df68c7be"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:33:50.583920 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583815    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5d94c3f-e673-4aee-92c8-82f4df68c7be" (UID: "a5d94c3f-e673-4aee-92c8-82f4df68c7be"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:33:50.583920 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583825    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5d94c3f-e673-4aee-92c8-82f4df68c7be" (UID: "a5d94c3f-e673-4aee-92c8-82f4df68c7be"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:33:50.583920 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.583859    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5d94c3f-e673-4aee-92c8-82f4df68c7be" (UID: "a5d94c3f-e673-4aee-92c8-82f4df68c7be"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:33:50.585609 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.585577    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5d94c3f-e673-4aee-92c8-82f4df68c7be" (UID: "a5d94c3f-e673-4aee-92c8-82f4df68c7be"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:33:50.585708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.585611    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5d94c3f-e673-4aee-92c8-82f4df68c7be" (UID: "a5d94c3f-e673-4aee-92c8-82f4df68c7be"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:33:50.585708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.585613    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d94c3f-e673-4aee-92c8-82f4df68c7be-kube-api-access-klnc7" (OuterVolumeSpecName: "kube-api-access-klnc7") pod "a5d94c3f-e673-4aee-92c8-82f4df68c7be" (UID: "a5d94c3f-e673-4aee-92c8-82f4df68c7be"). InnerVolumeSpecName "kube-api-access-klnc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:33:50.684223 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.684188    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-oauth-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:33:50.684223 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.684217    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klnc7\" (UniqueName: \"kubernetes.io/projected/a5d94c3f-e673-4aee-92c8-82f4df68c7be-kube-api-access-klnc7\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:33:50.684223 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.684226    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-trusted-ca-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:33:50.684223 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.684236    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:33:50.684477 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.684244    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-oauth-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:33:50.684477 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.684252    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:33:50.684477 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:50.684260    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5d94c3f-e673-4aee-92c8-82f4df68c7be-console-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:33:51.228765 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.228734    2552 generic.go:356] "Generic (PLEG): container finished" podID="a5d94c3f-e673-4aee-92c8-82f4df68c7be" containerID="dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e" exitCode=0
Jul 06 14:33:51.229228 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.228778    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9f6db494-4g8g6"
Jul 06 14:33:51.229228 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.228788    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9f6db494-4g8g6" event={"ID":"a5d94c3f-e673-4aee-92c8-82f4df68c7be","Type":"ContainerDied","Data":"dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e"}
Jul 06 14:33:51.229228 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.228829    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9f6db494-4g8g6" event={"ID":"a5d94c3f-e673-4aee-92c8-82f4df68c7be","Type":"ContainerDied","Data":"c61f961e2cd9f196c221414b5cba4ab64694950b113b8703f06bbafb987d3d8f"}
Jul 06 14:33:51.229228 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.228849    2552 scope.go:117] "RemoveContainer" containerID="dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e"
Jul 06 14:33:51.236143 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.236124    2552 scope.go:117] "RemoveContainer" containerID="dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e"
Jul 06 14:33:51.236371 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:33:51.236351    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e\": container with ID starting with dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e not found: ID does not exist" containerID="dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e"
Jul 06 14:33:51.236416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.236379    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e"} err="failed to get container status \"dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e\": rpc error: code = NotFound desc = could not find container \"dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e\": container with ID starting with dc5b406cad6c0a19299d2d021465c09b8c6ab17411c9993905720de466e57f1e not found: ID does not exist"
Jul 06 14:33:51.255017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.254975    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9f6db494-4g8g6"]
Jul 06 14:33:51.264132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:51.264108    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d9f6db494-4g8g6"]
Jul 06 14:33:53.154457 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:53.154425    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5d94c3f-e673-4aee-92c8-82f4df68c7be" path="/var/lib/kubelet/pods/a5d94c3f-e673-4aee-92c8-82f4df68c7be/volumes"
Jul 06 14:33:59.023090 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:33:59.023063    2552 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 14:34:47.956828 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.956789    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"]
Jul 06 14:34:47.957423 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.957148    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5d94c3f-e673-4aee-92c8-82f4df68c7be" containerName="console"
Jul 06 14:34:47.957423 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.957166    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5d94c3f-e673-4aee-92c8-82f4df68c7be" containerName="console"
Jul 06 14:34:47.957423 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.957239    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5d94c3f-e673-4aee-92c8-82f4df68c7be" containerName="console"
Jul 06 14:34:47.960212 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.960192    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:47.962364 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.962337    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 14:34:47.962492 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.962340    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n4mpl\""
Jul 06 14:34:47.963093 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.963076    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 14:34:47.969861 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.969841    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"]
Jul 06 14:34:47.983728 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.983697    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:47.983851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.983742    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:47.983851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:47.983791    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/65fcc065-4779-43f6-9998-5e53715afea8-kube-api-access-kp89p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.085109 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.085064    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/65fcc065-4779-43f6-9998-5e53715afea8-kube-api-access-kp89p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.085109 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.085111    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.085380 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.085148    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.085570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.085549    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.085617 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.085565    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.095243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.095213    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/65fcc065-4779-43f6-9998-5e53715afea8-kube-api-access-kp89p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.269267 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.269177    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:34:48.412081 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.412048    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"]
Jul 06 14:34:48.415349 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:34:48.415319    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fcc065_4779_43f6_9998_5e53715afea8.slice/crio-c0b4dbcf0bb2a8e24817c6f2d7f0af087a21744b5cd52be5853278537a7cf29a WatchSource:0}: Error finding container c0b4dbcf0bb2a8e24817c6f2d7f0af087a21744b5cd52be5853278537a7cf29a: Status 404 returned error can't find the container with id c0b4dbcf0bb2a8e24817c6f2d7f0af087a21744b5cd52be5853278537a7cf29a
Jul 06 14:34:48.417461 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:48.417444    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:34:49.422155 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:49.422113    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m" event={"ID":"65fcc065-4779-43f6-9998-5e53715afea8","Type":"ContainerStarted","Data":"c0b4dbcf0bb2a8e24817c6f2d7f0af087a21744b5cd52be5853278537a7cf29a"}
Jul 06 14:34:54.442141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:54.442101    2552 generic.go:356] "Generic (PLEG): container finished" podID="65fcc065-4779-43f6-9998-5e53715afea8" containerID="ee53d4918541e1d6c870a22bd11215426d0d02bf9055f91276e00f08b6ef5877" exitCode=0
Jul 06 14:34:54.442616 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:54.442188    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m" event={"ID":"65fcc065-4779-43f6-9998-5e53715afea8","Type":"ContainerDied","Data":"ee53d4918541e1d6c870a22bd11215426d0d02bf9055f91276e00f08b6ef5877"}
Jul 06 14:34:57.455505 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:57.455467    2552 generic.go:356] "Generic (PLEG): container finished" podID="65fcc065-4779-43f6-9998-5e53715afea8" containerID="d976a2dfc7022f0300fd3d5d097cebed79d4a9cd36380e6de66a03284c6daebc" exitCode=0
Jul 06 14:34:57.455897 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:57.455554    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m" event={"ID":"65fcc065-4779-43f6-9998-5e53715afea8","Type":"ContainerDied","Data":"d976a2dfc7022f0300fd3d5d097cebed79d4a9cd36380e6de66a03284c6daebc"}
Jul 06 14:34:59.319519 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.319463    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bfvt4"]
Jul 06 14:34:59.323099 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.323079    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.325441 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.325420    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 14:34:59.326079 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.326060    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5n7wd\""
Jul 06 14:34:59.326079 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.326074    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 14:34:59.332125 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.332104    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bfvt4"]
Jul 06 14:34:59.371132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.371077    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/630f3950-027e-42c6-8e57-637439008fc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-bfvt4\" (UID: \"630f3950-027e-42c6-8e57-637439008fc9\") " pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.371306 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.371168    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktlvb\" (UniqueName: \"kubernetes.io/projected/630f3950-027e-42c6-8e57-637439008fc9-kube-api-access-ktlvb\") pod \"cert-manager-55b4d954d5-bfvt4\" (UID: \"630f3950-027e-42c6-8e57-637439008fc9\") " pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.471548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.471517    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/630f3950-027e-42c6-8e57-637439008fc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-bfvt4\" (UID: \"630f3950-027e-42c6-8e57-637439008fc9\") " pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.471733 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.471576    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktlvb\" (UniqueName: \"kubernetes.io/projected/630f3950-027e-42c6-8e57-637439008fc9-kube-api-access-ktlvb\") pod \"cert-manager-55b4d954d5-bfvt4\" (UID: \"630f3950-027e-42c6-8e57-637439008fc9\") " pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.482102 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.482071    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/630f3950-027e-42c6-8e57-637439008fc9-bound-sa-token\") pod \"cert-manager-55b4d954d5-bfvt4\" (UID: \"630f3950-027e-42c6-8e57-637439008fc9\") " pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.482290 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.482263    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktlvb\" (UniqueName: \"kubernetes.io/projected/630f3950-027e-42c6-8e57-637439008fc9-kube-api-access-ktlvb\") pod \"cert-manager-55b4d954d5-bfvt4\" (UID: \"630f3950-027e-42c6-8e57-637439008fc9\") " pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.633118 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.633080    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bfvt4"
Jul 06 14:34:59.774943 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:34:59.774908    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bfvt4"]
Jul 06 14:34:59.778302 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:34:59.778268    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod630f3950_027e_42c6_8e57_637439008fc9.slice/crio-3e32d6f47f5686e0a842afe9ad7a5cb15f2aa7536ec45c5ebd06e7a81ace2553 WatchSource:0}: Error finding container 3e32d6f47f5686e0a842afe9ad7a5cb15f2aa7536ec45c5ebd06e7a81ace2553: Status 404 returned error can't find the container with id 3e32d6f47f5686e0a842afe9ad7a5cb15f2aa7536ec45c5ebd06e7a81ace2553
Jul 06 14:35:00.467842 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:00.467797    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bfvt4" event={"ID":"630f3950-027e-42c6-8e57-637439008fc9","Type":"ContainerStarted","Data":"3e32d6f47f5686e0a842afe9ad7a5cb15f2aa7536ec45c5ebd06e7a81ace2553"}
Jul 06 14:35:03.485168 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:03.485107    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bfvt4" event={"ID":"630f3950-027e-42c6-8e57-637439008fc9","Type":"ContainerStarted","Data":"3d17eda9840ded2d8a0b5ac4f818623b6d33441272a377af115ff4faebaefdd6"}
Jul 06 14:35:03.506970 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:03.506905    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bfvt4" podStartSLOduration=1.495287556 podStartE2EDuration="4.506882578s" totalImagesPullingTime="3.011595022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:35:03.506317246 +0000 UTC m=+364.898221419" watchObservedRunningTime="2026-07-06 14:35:03.506882578 +0000 UTC m=+364.898786750"
Jul 06 14:35:07.502219 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:07.502178    2552 generic.go:356] "Generic (PLEG): container finished" podID="65fcc065-4779-43f6-9998-5e53715afea8" containerID="31dca534fc59ce29cb48d2671d4e2014a5868c1901559be1cf8d8176ceca0f6f" exitCode=0
Jul 06 14:35:07.502612 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:07.502224    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m" event={"ID":"65fcc065-4779-43f6-9998-5e53715afea8","Type":"ContainerDied","Data":"31dca534fc59ce29cb48d2671d4e2014a5868c1901559be1cf8d8176ceca0f6f"}
Jul 06 14:35:08.631177 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.631153    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:35:08.750764 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.750708    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-util\") pod \"65fcc065-4779-43f6-9998-5e53715afea8\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") "
Jul 06 14:35:08.750764 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.750773    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/65fcc065-4779-43f6-9998-5e53715afea8-kube-api-access-kp89p\") pod \"65fcc065-4779-43f6-9998-5e53715afea8\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") "
Jul 06 14:35:08.750972 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.750842    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-bundle\") pod \"65fcc065-4779-43f6-9998-5e53715afea8\" (UID: \"65fcc065-4779-43f6-9998-5e53715afea8\") "
Jul 06 14:35:08.751229 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.751200    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-bundle" (OuterVolumeSpecName: "bundle") pod "65fcc065-4779-43f6-9998-5e53715afea8" (UID: "65fcc065-4779-43f6-9998-5e53715afea8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:35:08.752911 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.752886    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65fcc065-4779-43f6-9998-5e53715afea8-kube-api-access-kp89p" (OuterVolumeSpecName: "kube-api-access-kp89p") pod "65fcc065-4779-43f6-9998-5e53715afea8" (UID: "65fcc065-4779-43f6-9998-5e53715afea8"). InnerVolumeSpecName "kube-api-access-kp89p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:35:08.754636 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.754617    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-util" (OuterVolumeSpecName: "util") pod "65fcc065-4779-43f6-9998-5e53715afea8" (UID: "65fcc065-4779-43f6-9998-5e53715afea8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:35:08.851399 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.851357    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:35:08.851399 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.851390    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fcc065-4779-43f6-9998-5e53715afea8-util\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:35:08.851399 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:08.851399    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp89p\" (UniqueName: \"kubernetes.io/projected/65fcc065-4779-43f6-9998-5e53715afea8-kube-api-access-kp89p\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:35:09.510826 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:09.510747    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m" event={"ID":"65fcc065-4779-43f6-9998-5e53715afea8","Type":"ContainerDied","Data":"c0b4dbcf0bb2a8e24817c6f2d7f0af087a21744b5cd52be5853278537a7cf29a"}
Jul 06 14:35:09.510826 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:09.510824    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0b4dbcf0bb2a8e24817c6f2d7f0af087a21744b5cd52be5853278537a7cf29a"
Jul 06 14:35:09.511018 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:09.510759    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvqf9m"
Jul 06 14:35:15.292569 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292534    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"]
Jul 06 14:35:15.293056 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292770    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fcc065-4779-43f6-9998-5e53715afea8" containerName="util"
Jul 06 14:35:15.293056 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292780    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fcc065-4779-43f6-9998-5e53715afea8" containerName="util"
Jul 06 14:35:15.293056 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292787    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fcc065-4779-43f6-9998-5e53715afea8" containerName="pull"
Jul 06 14:35:15.293056 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292793    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fcc065-4779-43f6-9998-5e53715afea8" containerName="pull"
Jul 06 14:35:15.293056 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292799    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fcc065-4779-43f6-9998-5e53715afea8" containerName="extract"
Jul 06 14:35:15.293056 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292804    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fcc065-4779-43f6-9998-5e53715afea8" containerName="extract"
Jul 06 14:35:15.293056 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.292850    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="65fcc065-4779-43f6-9998-5e53715afea8" containerName="extract"
Jul 06 14:35:15.298818 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.298797    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.301317 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.301293    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 14:35:15.301451 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.301335    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:35:15.302101 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.302081    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-c98qs\""
Jul 06 14:35:15.304538 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.304517    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"]
Jul 06 14:35:15.400171 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.400132    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e42a6e4-cd23-467a-948b-5441161a756c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c8srg\" (UID: \"7e42a6e4-cd23-467a-948b-5441161a756c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.400368 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.400190    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85fc9\" (UniqueName: \"kubernetes.io/projected/7e42a6e4-cd23-467a-948b-5441161a756c-kube-api-access-85fc9\") pod \"openshift-lws-operator-fd8ccff4c-c8srg\" (UID: \"7e42a6e4-cd23-467a-948b-5441161a756c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.500766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.500726    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85fc9\" (UniqueName: \"kubernetes.io/projected/7e42a6e4-cd23-467a-948b-5441161a756c-kube-api-access-85fc9\") pod \"openshift-lws-operator-fd8ccff4c-c8srg\" (UID: \"7e42a6e4-cd23-467a-948b-5441161a756c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.500967 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.500815    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e42a6e4-cd23-467a-948b-5441161a756c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c8srg\" (UID: \"7e42a6e4-cd23-467a-948b-5441161a756c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.501244 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.501224    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e42a6e4-cd23-467a-948b-5441161a756c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-c8srg\" (UID: \"7e42a6e4-cd23-467a-948b-5441161a756c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.510225 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.510201    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85fc9\" (UniqueName: \"kubernetes.io/projected/7e42a6e4-cd23-467a-948b-5441161a756c-kube-api-access-85fc9\") pod \"openshift-lws-operator-fd8ccff4c-c8srg\" (UID: \"7e42a6e4-cd23-467a-948b-5441161a756c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.608366 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.608267    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"
Jul 06 14:35:15.740855 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:15.740705    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg"]
Jul 06 14:35:15.743623 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:35:15.743595    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e42a6e4_cd23_467a_948b_5441161a756c.slice/crio-d1d29f76e9203634e2528f5bd5e3cbc623a9e359bf55dc9f977451f1efd2f80e WatchSource:0}: Error finding container d1d29f76e9203634e2528f5bd5e3cbc623a9e359bf55dc9f977451f1efd2f80e: Status 404 returned error can't find the container with id d1d29f76e9203634e2528f5bd5e3cbc623a9e359bf55dc9f977451f1efd2f80e
Jul 06 14:35:16.534490 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:16.534451    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg" event={"ID":"7e42a6e4-cd23-467a-948b-5441161a756c","Type":"ContainerStarted","Data":"d1d29f76e9203634e2528f5bd5e3cbc623a9e359bf55dc9f977451f1efd2f80e"}
Jul 06 14:35:20.550036 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:20.549986    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg" event={"ID":"7e42a6e4-cd23-467a-948b-5441161a756c","Type":"ContainerStarted","Data":"e5698b6ba6ffc4b807240922414ef9525be07258e1afe1644a0e2ec72927ac37"}
Jul 06 14:35:20.571058 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:20.571006    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-c8srg" podStartSLOduration=0.945377272 podStartE2EDuration="5.570974498s" totalImagesPullingTime="4.625597226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:35:20.569728331 +0000 UTC m=+381.961632538" watchObservedRunningTime="2026-07-06 14:35:20.570974498 +0000 UTC m=+381.962878669"
Jul 06 14:35:41.192765 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.192733    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"]
Jul 06 14:35:41.195002 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.194968    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.199583 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.199557    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 14:35:41.199712 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.199561    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 14:35:41.199712 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.199564    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 14:35:41.199821 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.199620    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r5xql\""
Jul 06 14:35:41.199949 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.199934    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 14:35:41.231305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.231270    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"]
Jul 06 14:35:41.289479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.289441    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b52e350-87d6-4e0d-a61f-da90e1da9218-webhook-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.289479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.289481    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b52e350-87d6-4e0d-a61f-da90e1da9218-tmp\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.289696 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.289500    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b52e350-87d6-4e0d-a61f-da90e1da9218-manifests\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.289696 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.289562    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b52e350-87d6-4e0d-a61f-da90e1da9218-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.289696 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.289589    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rhx\" (UniqueName: \"kubernetes.io/projected/6b52e350-87d6-4e0d-a61f-da90e1da9218-kube-api-access-89rhx\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.390341 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.390295    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b52e350-87d6-4e0d-a61f-da90e1da9218-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.390341 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.390344    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rhx\" (UniqueName: \"kubernetes.io/projected/6b52e350-87d6-4e0d-a61f-da90e1da9218-kube-api-access-89rhx\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.390560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.390372    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b52e350-87d6-4e0d-a61f-da90e1da9218-webhook-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.390560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.390402    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b52e350-87d6-4e0d-a61f-da90e1da9218-tmp\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.390560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.390427    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b52e350-87d6-4e0d-a61f-da90e1da9218-manifests\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.390856 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.390835    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b52e350-87d6-4e0d-a61f-da90e1da9218-manifests\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.392552 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.392532    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b52e350-87d6-4e0d-a61f-da90e1da9218-tmp\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.392774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.392757    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b52e350-87d6-4e0d-a61f-da90e1da9218-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.392836 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.392813    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b52e350-87d6-4e0d-a61f-da90e1da9218-webhook-cert\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.400818 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.400786    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rhx\" (UniqueName: \"kubernetes.io/projected/6b52e350-87d6-4e0d-a61f-da90e1da9218-kube-api-access-89rhx\") pod \"opendatahub-operator-controller-manager-75545b5d88-4fk6z\" (UID: \"6b52e350-87d6-4e0d-a61f-da90e1da9218\") " pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.504726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.504630    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:41.639893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:41.639855    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"]
Jul 06 14:35:41.644325 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:35:41.644300    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b52e350_87d6_4e0d_a61f_da90e1da9218.slice/crio-6cce3132dacde256a12c49af39b31972d8d876a8bc5053fdec1905ab8061b597 WatchSource:0}: Error finding container 6cce3132dacde256a12c49af39b31972d8d876a8bc5053fdec1905ab8061b597: Status 404 returned error can't find the container with id 6cce3132dacde256a12c49af39b31972d8d876a8bc5053fdec1905ab8061b597
Jul 06 14:35:42.632788 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:42.632751    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z" event={"ID":"6b52e350-87d6-4e0d-a61f-da90e1da9218","Type":"ContainerStarted","Data":"6cce3132dacde256a12c49af39b31972d8d876a8bc5053fdec1905ab8061b597"}
Jul 06 14:35:45.646385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:45.646347    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z" event={"ID":"6b52e350-87d6-4e0d-a61f-da90e1da9218","Type":"ContainerStarted","Data":"de04eda6a0afe1285730d582f65a2d29c5a9958735def3b168791a7f54d28657"}
Jul 06 14:35:46.651699 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:46.651664    2552 generic.go:356] "Generic (PLEG): container finished" podID="6b52e350-87d6-4e0d-a61f-da90e1da9218" containerID="de04eda6a0afe1285730d582f65a2d29c5a9958735def3b168791a7f54d28657" exitCode=0
Jul 06 14:35:46.652140 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:46.651728    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z" event={"ID":"6b52e350-87d6-4e0d-a61f-da90e1da9218","Type":"ContainerDied","Data":"de04eda6a0afe1285730d582f65a2d29c5a9958735def3b168791a7f54d28657"}
Jul 06 14:35:47.657192 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:47.657156    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z" event={"ID":"6b52e350-87d6-4e0d-a61f-da90e1da9218","Type":"ContainerStarted","Data":"24b312c018d9cf3a0770c387bf9caedcca0b648d2e1b12f293cabf2a0983861d"}
Jul 06 14:35:47.657623 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:47.657313    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:35:47.680390 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:47.680331    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z" podStartSLOduration=2.202772985 podStartE2EDuration="6.680310384s" totalImagesPullingTime="3.403374181s" totalInitContainerRuntime="1.074163218s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:35:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:35:47.678508572 +0000 UTC m=+409.070412744" watchObservedRunningTime="2026-07-06 14:35:47.680310384 +0000 UTC m=+409.072214555"
Jul 06 14:35:58.664370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:35:58.664335    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75545b5d88-4fk6z"
Jul 06 14:36:04.788284 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.788250    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-855f944d48-btbv5"]
Jul 06 14:36:04.793223 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.793201    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.800639 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.800617    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 14:36:04.800807 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.800789    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 14:36:04.801499 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.801479    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 14:36:04.801588 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.801482    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 14:36:04.814893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.814865    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855f944d48-btbv5"]
Jul 06 14:36:04.872811 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.872773    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-tmp\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.872969 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.872821    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-tls-certs\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.872969 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.872840    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pkp5\" (UniqueName: \"kubernetes.io/projected/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-kube-api-access-4pkp5\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.973423 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.973378    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-tmp\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.973581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.973434    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-tls-certs\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.973581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.973452    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pkp5\" (UniqueName: \"kubernetes.io/projected/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-kube-api-access-4pkp5\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.975620 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.975592    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-tmp\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:04.975841 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:04.975822    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-tls-certs\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:05.003172 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.003140    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pkp5\" (UniqueName: \"kubernetes.io/projected/a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4-kube-api-access-4pkp5\") pod \"kube-auth-proxy-855f944d48-btbv5\" (UID: \"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4\") " pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:05.081607 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.081517    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bzzzn"]
Jul 06 14:36:05.084907 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.084886    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.087766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.087748    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 14:36:05.087950 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.087937    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mpcls\""
Jul 06 14:36:05.101719 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.101691    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5"
Jul 06 14:36:05.102114 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.102093    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bzzzn"]
Jul 06 14:36:05.175226 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.175197    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-cert\") pod \"odh-model-controller-7998c67dc4-bzzzn\" (UID: \"dd9f07f0-2cbf-4f66-bba7-7a0df2269193\") " pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.175374 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.175255    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px95f\" (UniqueName: \"kubernetes.io/projected/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-kube-api-access-px95f\") pod \"odh-model-controller-7998c67dc4-bzzzn\" (UID: \"dd9f07f0-2cbf-4f66-bba7-7a0df2269193\") " pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.245830 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.245798    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855f944d48-btbv5"]
Jul 06 14:36:05.248944 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:36:05.248919    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a3e8a7_3d9a_4792_a89e_75ec83b8baf4.slice/crio-4b1aa12c1169284be327b546feed73ac13a6a92070937a8a7252439238942d88 WatchSource:0}: Error finding container 4b1aa12c1169284be327b546feed73ac13a6a92070937a8a7252439238942d88: Status 404 returned error can't find the container with id 4b1aa12c1169284be327b546feed73ac13a6a92070937a8a7252439238942d88
Jul 06 14:36:05.276653 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.276620    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-cert\") pod \"odh-model-controller-7998c67dc4-bzzzn\" (UID: \"dd9f07f0-2cbf-4f66-bba7-7a0df2269193\") " pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.276817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.276680    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px95f\" (UniqueName: \"kubernetes.io/projected/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-kube-api-access-px95f\") pod \"odh-model-controller-7998c67dc4-bzzzn\" (UID: \"dd9f07f0-2cbf-4f66-bba7-7a0df2269193\") " pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.276817 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:36:05.276768    2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 14:36:05.276892 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:36:05.276832    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-cert podName:dd9f07f0-2cbf-4f66-bba7-7a0df2269193 nodeName:}" failed. No retries permitted until 2026-07-06 14:36:05.776816811 +0000 UTC m=+427.168720963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-cert") pod "odh-model-controller-7998c67dc4-bzzzn" (UID: "dd9f07f0-2cbf-4f66-bba7-7a0df2269193") : secret "odh-model-controller-webhook-cert" not found
Jul 06 14:36:05.296936 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.296909    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px95f\" (UniqueName: \"kubernetes.io/projected/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-kube-api-access-px95f\") pod \"odh-model-controller-7998c67dc4-bzzzn\" (UID: \"dd9f07f0-2cbf-4f66-bba7-7a0df2269193\") " pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.726735 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.726690    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5" event={"ID":"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4","Type":"ContainerStarted","Data":"4b1aa12c1169284be327b546feed73ac13a6a92070937a8a7252439238942d88"}
Jul 06 14:36:05.780324 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.780287    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-cert\") pod \"odh-model-controller-7998c67dc4-bzzzn\" (UID: \"dd9f07f0-2cbf-4f66-bba7-7a0df2269193\") " pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.782652 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.782622    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd9f07f0-2cbf-4f66-bba7-7a0df2269193-cert\") pod \"odh-model-controller-7998c67dc4-bzzzn\" (UID: \"dd9f07f0-2cbf-4f66-bba7-7a0df2269193\") " pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:05.994891 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:05.994801    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:06.160394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.160289    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bzzzn"]
Jul 06 14:36:06.162702 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:36:06.162670    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9f07f0_2cbf_4f66_bba7_7a0df2269193.slice/crio-25e277dc7e1212b92e025feaf79d4e08fc39221a821db037b9952533a0123efa WatchSource:0}: Error finding container 25e277dc7e1212b92e025feaf79d4e08fc39221a821db037b9952533a0123efa: Status 404 returned error can't find the container with id 25e277dc7e1212b92e025feaf79d4e08fc39221a821db037b9952533a0123efa
Jul 06 14:36:06.265028 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.264937    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6xr5x"]
Jul 06 14:36:06.269362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.269337    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.273618 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.273596    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 14:36:06.273768 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.273670    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tfmzl\""
Jul 06 14:36:06.293344 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.293314    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6xr5x"]
Jul 06 14:36:06.385711 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.385680    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c92373a-29fa-42e2-9985-b189d2b94e98-tls-certs\") pod \"model-serving-api-54d89bd5fc-6xr5x\" (UID: \"3c92373a-29fa-42e2-9985-b189d2b94e98\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.385891 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.385737    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwxsz\" (UniqueName: \"kubernetes.io/projected/3c92373a-29fa-42e2-9985-b189d2b94e98-kube-api-access-rwxsz\") pod \"model-serving-api-54d89bd5fc-6xr5x\" (UID: \"3c92373a-29fa-42e2-9985-b189d2b94e98\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.486315 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.486279    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwxsz\" (UniqueName: \"kubernetes.io/projected/3c92373a-29fa-42e2-9985-b189d2b94e98-kube-api-access-rwxsz\") pod \"model-serving-api-54d89bd5fc-6xr5x\" (UID: \"3c92373a-29fa-42e2-9985-b189d2b94e98\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.486502 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.486342    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c92373a-29fa-42e2-9985-b189d2b94e98-tls-certs\") pod \"model-serving-api-54d89bd5fc-6xr5x\" (UID: \"3c92373a-29fa-42e2-9985-b189d2b94e98\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.488782 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.488756    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c92373a-29fa-42e2-9985-b189d2b94e98-tls-certs\") pod \"model-serving-api-54d89bd5fc-6xr5x\" (UID: \"3c92373a-29fa-42e2-9985-b189d2b94e98\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.508181 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.508156    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwxsz\" (UniqueName: \"kubernetes.io/projected/3c92373a-29fa-42e2-9985-b189d2b94e98-kube-api-access-rwxsz\") pod \"model-serving-api-54d89bd5fc-6xr5x\" (UID: \"3c92373a-29fa-42e2-9985-b189d2b94e98\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.581939 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.581844    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:06.732045 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.732009    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn" event={"ID":"dd9f07f0-2cbf-4f66-bba7-7a0df2269193","Type":"ContainerStarted","Data":"25e277dc7e1212b92e025feaf79d4e08fc39221a821db037b9952533a0123efa"}
Jul 06 14:36:06.744637 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:06.744497    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6xr5x"]
Jul 06 14:36:06.746667 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:36:06.746641    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c92373a_29fa_42e2_9985_b189d2b94e98.slice/crio-f245ba0cdef91326a1562554f1af94a5e0cdde6f5cbd915a407b26fdd5080045 WatchSource:0}: Error finding container f245ba0cdef91326a1562554f1af94a5e0cdde6f5cbd915a407b26fdd5080045: Status 404 returned error can't find the container with id f245ba0cdef91326a1562554f1af94a5e0cdde6f5cbd915a407b26fdd5080045
Jul 06 14:36:07.739307 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.739224    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x" event={"ID":"3c92373a-29fa-42e2-9985-b189d2b94e98","Type":"ContainerStarted","Data":"f245ba0cdef91326a1562554f1af94a5e0cdde6f5cbd915a407b26fdd5080045"}
Jul 06 14:36:07.913666 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.912307    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"]
Jul 06 14:36:07.916188 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.916146    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:07.923592 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.923565    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 14:36:07.924519 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.924493    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 14:36:07.924923 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.924901    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 14:36:07.925197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.925179    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rs6qh\""
Jul 06 14:36:07.930819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.930796    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 14:36:07.954663 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.954615    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"]
Jul 06 14:36:07.999518 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.999426    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-cacerts\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:07.999518 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.999473    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:07.999708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.999575    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:07.999708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.999634    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:07.999708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.999679    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c440491-b875-4d1c-b879-38a94f12212c-local-certs\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:07.999832 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.999731    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-istio-token\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:07.999832 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:07.999756    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6hj\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-kube-api-access-vk6hj\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.100373 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.100325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.100536 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.100401    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.100536 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.100442    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c440491-b875-4d1c-b879-38a94f12212c-local-certs\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.100536 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.100476    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-istio-token\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.100536 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.100520    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6hj\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-kube-api-access-vk6hj\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.100755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.100580    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-cacerts\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.100755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.100601    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.101621 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.101546    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.103470 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.103406    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c440491-b875-4d1c-b879-38a94f12212c-local-certs\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.103595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.103567    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.103887 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.103866    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.104017 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.103957    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-cacerts\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.124867 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.124819    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-istio-token\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.130265 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.130236    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6hj\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-kube-api-access-vk6hj\") pod \"istiod-openshift-gateway-7574459656-l5frd\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:08.229181 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:08.229118    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:10.151059 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.151027    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"]
Jul 06 14:36:10.154161 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:36:10.154129    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c440491_b875_4d1c_b879_38a94f12212c.slice/crio-3fcb3749e3d612f3e695442cc38a5358bc0f31631f876e0e5056070097c822d9 WatchSource:0}: Error finding container 3fcb3749e3d612f3e695442cc38a5358bc0f31631f876e0e5056070097c822d9: Status 404 returned error can't find the container with id 3fcb3749e3d612f3e695442cc38a5358bc0f31631f876e0e5056070097c822d9
Jul 06 14:36:10.753868 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.753827    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn" event={"ID":"dd9f07f0-2cbf-4f66-bba7-7a0df2269193","Type":"ContainerStarted","Data":"eef1b656aaf8f53bd640918e6c350af69a9c92cc181fd8ebaa67127560e2c8a8"}
Jul 06 14:36:10.754175 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.753923    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:10.755443 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.755414    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x" event={"ID":"3c92373a-29fa-42e2-9985-b189d2b94e98","Type":"ContainerStarted","Data":"ad6031c95634554a9138f01c214a7a258be01ce3dbcb09d799b9912207e04d59"}
Jul 06 14:36:10.755560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.755514    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:10.756738 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.756710    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" event={"ID":"0c440491-b875-4d1c-b879-38a94f12212c","Type":"ContainerStarted","Data":"3fcb3749e3d612f3e695442cc38a5358bc0f31631f876e0e5056070097c822d9"}
Jul 06 14:36:10.758258 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.758233    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5" event={"ID":"a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4","Type":"ContainerStarted","Data":"77bb9d933c222c40046a8b7c806b64abfecbb0fc53d8af38c9d8b6997974a7ad"}
Jul 06 14:36:10.778899 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.778840    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn" podStartSLOduration=1.934092224 podStartE2EDuration="5.778821s" totalImagesPullingTime="3.844728776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:10.77873559 +0000 UTC m=+432.170639762" watchObservedRunningTime="2026-07-06 14:36:10.778821 +0000 UTC m=+432.170725176"
Jul 06 14:36:10.802794 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.802742    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-855f944d48-btbv5" podStartSLOduration=2.056877385 podStartE2EDuration="6.802725361s" totalImagesPullingTime="4.745847976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:10.801412017 +0000 UTC m=+432.193316190" watchObservedRunningTime="2026-07-06 14:36:10.802725361 +0000 UTC m=+432.194629510"
Jul 06 14:36:10.821887 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:10.821835    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x" podStartSLOduration=1.573475836 podStartE2EDuration="4.821818213s" totalImagesPullingTime="3.248342377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:10.820253228 +0000 UTC m=+432.212157401" watchObservedRunningTime="2026-07-06 14:36:10.821818213 +0000 UTC m=+432.213722385"
Jul 06 14:36:13.924480 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:13.924439    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:36:13.924755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:13.924514    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:36:14.779421 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:14.779382    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" event={"ID":"0c440491-b875-4d1c-b879-38a94f12212c","Type":"ContainerStarted","Data":"51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f"}
Jul 06 14:36:14.779620 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:14.779550    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:14.781161 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:14.781136    2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-l5frd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:36:14.781283 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:14.781188    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" podUID="0c440491-b875-4d1c-b879-38a94f12212c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:36:14.890167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:14.890100    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" podStartSLOduration=4.122136019 podStartE2EDuration="7.890083475s" totalImagesPullingTime="3.767947456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:14.889596951 +0000 UTC m=+436.281501122" watchObservedRunningTime="2026-07-06 14:36:14.890083475 +0000 UTC m=+436.281987645"
Jul 06 14:36:15.785139 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:15.785095    2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-l5frd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 14:36:15.785519 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:15.785170    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" podUID="0c440491-b875-4d1c-b879-38a94f12212c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 14:36:16.803690 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.803646    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"]
Jul 06 14:36:16.811503 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.811476    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.814611 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.814585    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s772m\""
Jul 06 14:36:16.839718 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.839684    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"]
Jul 06 14:36:16.878765 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878733    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878765 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878767    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878790    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl9gc\" (UniqueName: \"kubernetes.io/projected/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-kube-api-access-wl9gc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878814    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878840    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878898    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878927    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878953    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.878983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.878973    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979383    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979419    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979441    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl9gc\" (UniqueName: \"kubernetes.io/projected/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-kube-api-access-wl9gc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979473    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979502    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979558    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979584    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979625    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.979665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979661    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.980038 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.979859    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.980100 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.980039    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.980100 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.980049    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.980324 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.980303    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.980395 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.980374    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.982098 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.982075    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:16.982205 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:16.982171    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:17.023438 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.023407    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl9gc\" (UniqueName: \"kubernetes.io/projected/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-kube-api-access-wl9gc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:17.037696 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.037660    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46g7z5\" (UID: \"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:17.121689 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.121651    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:17.327310 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.327273    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"]
Jul 06 14:36:17.331316 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:36:17.331287    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc29c286_cc07_4fe7_b54c_a6cb2bbeaf55.slice/crio-e0cb711312e626c3b0496461c9f6d0878d90e468841cac8836ed0244ade221cf WatchSource:0}: Error finding container e0cb711312e626c3b0496461c9f6d0878d90e468841cac8836ed0244ade221cf: Status 404 returned error can't find the container with id e0cb711312e626c3b0496461c9f6d0878d90e468841cac8836ed0244ade221cf
Jul 06 14:36:17.551083 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.551001    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"]
Jul 06 14:36:17.553940 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.553923    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.576092 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.576064    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kjjg7\""
Jul 06 14:36:17.576279 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.576126    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 14:36:17.612341 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.612309    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"]
Jul 06 14:36:17.614316 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.614300    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:17.622942 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.622912    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 14:36:17.623124 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.623103    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nk54w\""
Jul 06 14:36:17.623448 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.623423    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"]
Jul 06 14:36:17.672084 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.672039    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"]
Jul 06 14:36:17.687692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.687657    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ff7c272-9326-4af9-93a7-dc9134cd0eb8-cert\") pod \"kserve-controller-manager-d6f4b65b8-6kzmq\" (UID: \"1ff7c272-9326-4af9-93a7-dc9134cd0eb8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.687880 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.687699    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqgs9\" (UniqueName: \"kubernetes.io/projected/1ff7c272-9326-4af9-93a7-dc9134cd0eb8-kube-api-access-lqgs9\") pod \"kserve-controller-manager-d6f4b65b8-6kzmq\" (UID: \"1ff7c272-9326-4af9-93a7-dc9134cd0eb8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.687880 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.687736    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq6jx\" (UniqueName: \"kubernetes.io/projected/e7bd10b1-15aa-4ec7-81ad-b671dfaa7834-kube-api-access-sq6jx\") pod \"llmisvc-controller-manager-777c6bd7d5-gtbpt\" (UID: \"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:17.687880 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.687834    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7bd10b1-15aa-4ec7-81ad-b671dfaa7834-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gtbpt\" (UID: \"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:17.789384 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.789347    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ff7c272-9326-4af9-93a7-dc9134cd0eb8-cert\") pod \"kserve-controller-manager-d6f4b65b8-6kzmq\" (UID: \"1ff7c272-9326-4af9-93a7-dc9134cd0eb8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.789575 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.789396    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqgs9\" (UniqueName: \"kubernetes.io/projected/1ff7c272-9326-4af9-93a7-dc9134cd0eb8-kube-api-access-lqgs9\") pod \"kserve-controller-manager-d6f4b65b8-6kzmq\" (UID: \"1ff7c272-9326-4af9-93a7-dc9134cd0eb8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.789575 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.789429    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq6jx\" (UniqueName: \"kubernetes.io/projected/e7bd10b1-15aa-4ec7-81ad-b671dfaa7834-kube-api-access-sq6jx\") pod \"llmisvc-controller-manager-777c6bd7d5-gtbpt\" (UID: \"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:17.789575 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.789453    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7bd10b1-15aa-4ec7-81ad-b671dfaa7834-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gtbpt\" (UID: \"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:17.792059 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.792039    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ff7c272-9326-4af9-93a7-dc9134cd0eb8-cert\") pod \"kserve-controller-manager-d6f4b65b8-6kzmq\" (UID: \"1ff7c272-9326-4af9-93a7-dc9134cd0eb8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.792161 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.792075    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7bd10b1-15aa-4ec7-81ad-b671dfaa7834-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gtbpt\" (UID: \"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:17.793763 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.793741    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5" event={"ID":"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55","Type":"ContainerStarted","Data":"e0cb711312e626c3b0496461c9f6d0878d90e468841cac8836ed0244ade221cf"}
Jul 06 14:36:17.851509 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.851433    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqgs9\" (UniqueName: \"kubernetes.io/projected/1ff7c272-9326-4af9-93a7-dc9134cd0eb8-kube-api-access-lqgs9\") pod \"kserve-controller-manager-d6f4b65b8-6kzmq\" (UID: \"1ff7c272-9326-4af9-93a7-dc9134cd0eb8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.864244 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.864213    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:17.867367 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.867349    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq6jx\" (UniqueName: \"kubernetes.io/projected/e7bd10b1-15aa-4ec7-81ad-b671dfaa7834-kube-api-access-sq6jx\") pod \"llmisvc-controller-manager-777c6bd7d5-gtbpt\" (UID: \"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:17.924101 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:17.924064    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:18.033512 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:18.033374    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"]
Jul 06 14:36:18.036967 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:36:18.036935    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff7c272_9326_4af9_93a7_dc9134cd0eb8.slice/crio-32c277976b2a8c297c046cf5ebd882652afb5a4fe5f50f5511746853b19f4d96 WatchSource:0}: Error finding container 32c277976b2a8c297c046cf5ebd882652afb5a4fe5f50f5511746853b19f4d96: Status 404 returned error can't find the container with id 32c277976b2a8c297c046cf5ebd882652afb5a4fe5f50f5511746853b19f4d96
Jul 06 14:36:18.071497 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:36:18.071461    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7bd10b1_15aa_4ec7_81ad_b671dfaa7834.slice/crio-bb4146acf1d2db2aa65c5b6a5dd2cb2598b102c8c528d563b92de2ec138a1d13 WatchSource:0}: Error finding container bb4146acf1d2db2aa65c5b6a5dd2cb2598b102c8c528d563b92de2ec138a1d13: Status 404 returned error can't find the container with id bb4146acf1d2db2aa65c5b6a5dd2cb2598b102c8c528d563b92de2ec138a1d13
Jul 06 14:36:18.071855 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:18.071829    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"]
Jul 06 14:36:18.786270 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:18.786233    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:18.801568 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:18.801530    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq" event={"ID":"1ff7c272-9326-4af9-93a7-dc9134cd0eb8","Type":"ContainerStarted","Data":"32c277976b2a8c297c046cf5ebd882652afb5a4fe5f50f5511746853b19f4d96"}
Jul 06 14:36:18.802936 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:18.802903    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt" event={"ID":"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834","Type":"ContainerStarted","Data":"bb4146acf1d2db2aa65c5b6a5dd2cb2598b102c8c528d563b92de2ec138a1d13"}
Jul 06 14:36:19.485108 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.485073    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"]
Jul 06 14:36:19.485610 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.485282    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" podUID="0c440491-b875-4d1c-b879-38a94f12212c" containerName="discovery" containerID="cri-o://51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f" gracePeriod=30
Jul 06 14:36:19.739861 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.739802    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:19.808593 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.808556    2552 generic.go:356] "Generic (PLEG): container finished" podID="0c440491-b875-4d1c-b879-38a94f12212c" containerID="51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f" exitCode=0
Jul 06 14:36:19.808753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.808610    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" event={"ID":"0c440491-b875-4d1c-b879-38a94f12212c","Type":"ContainerDied","Data":"51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f"}
Jul 06 14:36:19.808753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.808628    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"
Jul 06 14:36:19.808753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.808678    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l5frd" event={"ID":"0c440491-b875-4d1c-b879-38a94f12212c","Type":"ContainerDied","Data":"3fcb3749e3d612f3e695442cc38a5358bc0f31631f876e0e5056070097c822d9"}
Jul 06 14:36:19.808753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.808698    2552 scope.go:117] "RemoveContainer" containerID="51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f"
Jul 06 14:36:19.816960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.816937    2552 scope.go:117] "RemoveContainer" containerID="51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f"
Jul 06 14:36:19.817241 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:36:19.817223    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f\": container with ID starting with 51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f not found: ID does not exist" containerID="51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f"
Jul 06 14:36:19.817298 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.817249    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f"} err="failed to get container status \"51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f\": rpc error: code = NotFound desc = could not find container \"51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f\": container with ID starting with 51299ef3e092f1d6c2c9a979a105586f69e66aa161344f5e2570d58530f3cb0f not found: ID does not exist"
Jul 06 14:36:19.909120 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909059    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-ca-configmap\") pod \"0c440491-b875-4d1c-b879-38a94f12212c\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") "
Jul 06 14:36:19.909325 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909131    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-dns-cert\") pod \"0c440491-b875-4d1c-b879-38a94f12212c\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") "
Jul 06 14:36:19.909325 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909174    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c440491-b875-4d1c-b879-38a94f12212c-local-certs\") pod \"0c440491-b875-4d1c-b879-38a94f12212c\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") "
Jul 06 14:36:19.909325 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909203    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-cacerts\") pod \"0c440491-b875-4d1c-b879-38a94f12212c\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") "
Jul 06 14:36:19.909325 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909245    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-kubeconfig\") pod \"0c440491-b875-4d1c-b879-38a94f12212c\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") "
Jul 06 14:36:19.909325 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909291    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-istio-token\") pod \"0c440491-b875-4d1c-b879-38a94f12212c\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") "
Jul 06 14:36:19.909592 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909331    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk6hj\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-kube-api-access-vk6hj\") pod \"0c440491-b875-4d1c-b879-38a94f12212c\" (UID: \"0c440491-b875-4d1c-b879-38a94f12212c\") "
Jul 06 14:36:19.909592 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909515    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0c440491-b875-4d1c-b879-38a94f12212c" (UID: "0c440491-b875-4d1c-b879-38a94f12212c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:36:19.909697 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.909628    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-ca-configmap\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:36:19.912257 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.912222    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-kube-api-access-vk6hj" (OuterVolumeSpecName: "kube-api-access-vk6hj") pod "0c440491-b875-4d1c-b879-38a94f12212c" (UID: "0c440491-b875-4d1c-b879-38a94f12212c"). InnerVolumeSpecName "kube-api-access-vk6hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:36:19.912394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.912282    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0c440491-b875-4d1c-b879-38a94f12212c" (UID: "0c440491-b875-4d1c-b879-38a94f12212c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:36:19.912575 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.912429    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c440491-b875-4d1c-b879-38a94f12212c-local-certs" (OuterVolumeSpecName: "local-certs") pod "0c440491-b875-4d1c-b879-38a94f12212c" (UID: "0c440491-b875-4d1c-b879-38a94f12212c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:36:19.912643 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.912564    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0c440491-b875-4d1c-b879-38a94f12212c" (UID: "0c440491-b875-4d1c-b879-38a94f12212c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:36:19.912643 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.912628    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c440491-b875-4d1c-b879-38a94f12212c" (UID: "0c440491-b875-4d1c-b879-38a94f12212c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:36:19.912747 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:19.912715    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-cacerts" (OuterVolumeSpecName: "cacerts") pod "0c440491-b875-4d1c-b879-38a94f12212c" (UID: "0c440491-b875-4d1c-b879-38a94f12212c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:36:20.011133 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.011047    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-csr-dns-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:36:20.011133 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.011076    2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c440491-b875-4d1c-b879-38a94f12212c-local-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:36:20.011133 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.011086    2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-cacerts\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:36:20.011133 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.011097    2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0c440491-b875-4d1c-b879-38a94f12212c-istio-kubeconfig\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:36:20.011133 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.011105    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:36:20.011133 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.011113    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk6hj\" (UniqueName: \"kubernetes.io/projected/0c440491-b875-4d1c-b879-38a94f12212c-kube-api-access-vk6hj\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:36:20.157687 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.157650    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"]
Jul 06 14:36:20.163157 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:20.163125    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l5frd"]
Jul 06 14:36:21.156191 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.156100    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c440491-b875-4d1c-b879-38a94f12212c" path="/var/lib/kubelet/pods/0c440491-b875-4d1c-b879-38a94f12212c/volumes"
Jul 06 14:36:21.765161 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.765066    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bzzzn"
Jul 06 14:36:21.767527 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.767502    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6xr5x"
Jul 06 14:36:21.820848 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.820808    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq" event={"ID":"1ff7c272-9326-4af9-93a7-dc9134cd0eb8","Type":"ContainerStarted","Data":"aceb9ba3633e91b3178387389efcd68049d12f2aa0ecc916247ace176564687e"}
Jul 06 14:36:21.821148 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.820877    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:36:21.822803 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.822776    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt" event={"ID":"e7bd10b1-15aa-4ec7-81ad-b671dfaa7834","Type":"ContainerStarted","Data":"1613bcca8975e6a62fbb305318159ad691aa58356d7e10738725a9a89fa27f73"}
Jul 06 14:36:21.822925 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.822912    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:21.871168 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.871108    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq" podStartSLOduration=1.41208277 podStartE2EDuration="4.871089304s" totalImagesPullingTime="3.459006534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:21.869306925 +0000 UTC m=+443.261211097" watchObservedRunningTime="2026-07-06 14:36:21.871089304 +0000 UTC m=+443.262993480"
Jul 06 14:36:21.912074 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:21.912024    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt" podStartSLOduration=1.483468414 podStartE2EDuration="4.911979871s" totalImagesPullingTime="3.428511457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:21.911209248 +0000 UTC m=+443.303113422" watchObservedRunningTime="2026-07-06 14:36:21.911979871 +0000 UTC m=+443.303884042"
Jul 06 14:36:24.368441 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:24.368408    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:36:24.368683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:24.368493    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:36:24.368683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:24.368520    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:36:24.836900 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:24.836810    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5" event={"ID":"fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55","Type":"ContainerStarted","Data":"8e3688244234b44d7aa8050aa29134eb140a40e97634648fa336290267b83e73"}
Jul 06 14:36:24.875177 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:24.875124    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5" podStartSLOduration=1.8402614750000001 podStartE2EDuration="8.875107201s" totalImagesPullingTime="7.034845726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:36:24.868975521 +0000 UTC m=+446.260879703" watchObservedRunningTime="2026-07-06 14:36:24.875107201 +0000 UTC m=+446.267011371"
Jul 06 14:36:25.122806 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:25.122769    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:25.127502 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:25.127474    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:25.841009 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:25.840961    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:25.842032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:25.842012    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46g7z5"
Jul 06 14:36:52.829416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:52.829377    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gtbpt"
Jul 06 14:36:52.832386 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:36:52.832363    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6kzmq"
Jul 06 14:37:02.942034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.941982    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vhghf"]
Jul 06 14:37:02.942422 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.942342    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c440491-b875-4d1c-b879-38a94f12212c" containerName="discovery"
Jul 06 14:37:02.942422 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.942355    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c440491-b875-4d1c-b879-38a94f12212c" containerName="discovery"
Jul 06 14:37:02.942422 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.942407    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c440491-b875-4d1c-b879-38a94f12212c" containerName="discovery"
Jul 06 14:37:02.950602 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.950574    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:02.953692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.953668    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9dbch\""
Jul 06 14:37:02.954323 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.954300    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 14:37:02.954450 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.954333    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 14:37:02.960730 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:02.960700    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vhghf"]
Jul 06 14:37:03.065698 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:03.065657    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twt2b\" (UniqueName: \"kubernetes.io/projected/19e611be-66e2-47ce-810e-c0f0820e35f2-kube-api-access-twt2b\") pod \"kuadrant-operator-catalog-vhghf\" (UID: \"19e611be-66e2-47ce-810e-c0f0820e35f2\") " pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:03.166609 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:03.166573    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twt2b\" (UniqueName: \"kubernetes.io/projected/19e611be-66e2-47ce-810e-c0f0820e35f2-kube-api-access-twt2b\") pod \"kuadrant-operator-catalog-vhghf\" (UID: \"19e611be-66e2-47ce-810e-c0f0820e35f2\") " pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:03.179375 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:03.179342    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twt2b\" (UniqueName: \"kubernetes.io/projected/19e611be-66e2-47ce-810e-c0f0820e35f2-kube-api-access-twt2b\") pod \"kuadrant-operator-catalog-vhghf\" (UID: \"19e611be-66e2-47ce-810e-c0f0820e35f2\") " pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:03.261514 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:03.261419    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:03.410632 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:03.410555    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vhghf"]
Jul 06 14:37:03.414220 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:03.414188    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e611be_66e2_47ce_810e_c0f0820e35f2.slice/crio-bdd9ec5118341684898fa47f2e2b3a7acb1eaad81a74a781097d4287fd3746db WatchSource:0}: Error finding container bdd9ec5118341684898fa47f2e2b3a7acb1eaad81a74a781097d4287fd3746db: Status 404 returned error can't find the container with id bdd9ec5118341684898fa47f2e2b3a7acb1eaad81a74a781097d4287fd3746db
Jul 06 14:37:03.999052 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:03.999017    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vhghf" event={"ID":"19e611be-66e2-47ce-810e-c0f0820e35f2","Type":"ContainerStarted","Data":"bdd9ec5118341684898fa47f2e2b3a7acb1eaad81a74a781097d4287fd3746db"}
Jul 06 14:37:06.008659 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:06.008617    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vhghf" event={"ID":"19e611be-66e2-47ce-810e-c0f0820e35f2","Type":"ContainerStarted","Data":"88e91200731f7b07223c0e95d5e1dc56e8897f6b1110c6428aad1f16f17852c0"}
Jul 06 14:37:06.078929 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:06.078872    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vhghf" podStartSLOduration=2.029317147 podStartE2EDuration="4.078855409s" totalImagesPullingTime="2.049538262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:37:06.073233956 +0000 UTC m=+487.465138126" watchObservedRunningTime="2026-07-06 14:37:06.078855409 +0000 UTC m=+487.470759580"
Jul 06 14:37:13.261705 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:13.261665    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:13.262117 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:13.261738    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:13.284622 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:13.284595    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:14.062939 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:14.062908    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vhghf"
Jul 06 14:37:17.262740 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.262681    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"]
Jul 06 14:37:17.266250 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.266233    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.270200 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.270185    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t92s5\""
Jul 06 14:37:17.293710 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.293676    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"]
Jul 06 14:37:17.388356 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.388301    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.388356 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.388365    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5q2\" (UniqueName: \"kubernetes.io/projected/1ad4a287-2dbf-4da1-a319-1c6d319e3887-kube-api-access-gp5q2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.388582 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.388440    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.488951 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.488899    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.489130 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.489040    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.489130 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.489084    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5q2\" (UniqueName: \"kubernetes.io/projected/1ad4a287-2dbf-4da1-a319-1c6d319e3887-kube-api-access-gp5q2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.489394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.489375    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.489475 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.489428    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.500512 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.500483    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5q2\" (UniqueName: \"kubernetes.io/projected/1ad4a287-2dbf-4da1-a319-1c6d319e3887-kube-api-access-gp5q2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.575574 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.575480    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:17.611695 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.611661    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"]
Jul 06 14:37:17.617054 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.617029    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.632425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.632390    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"]
Jul 06 14:37:17.715522 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.715488    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"]
Jul 06 14:37:17.718436 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:17.718407    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad4a287_2dbf_4da1_a319_1c6d319e3887.slice/crio-6ee45110eeff8566b1181c741510f68af32fef5d150049c94a98722a11fa162e WatchSource:0}: Error finding container 6ee45110eeff8566b1181c741510f68af32fef5d150049c94a98722a11fa162e: Status 404 returned error can't find the container with id 6ee45110eeff8566b1181c741510f68af32fef5d150049c94a98722a11fa162e
Jul 06 14:37:17.792438 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.792405    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r45q6\" (UniqueName: \"kubernetes.io/projected/2976a7f8-ff3d-4289-b2a4-86b84d078b42-kube-api-access-r45q6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.792590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.792467    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.792590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.792535    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.893364 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.893323    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r45q6\" (UniqueName: \"kubernetes.io/projected/2976a7f8-ff3d-4289-b2a4-86b84d078b42-kube-api-access-r45q6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.893539 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.893375    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.893539 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.893399    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.893786 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.893770    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.893837 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.893825    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.903506 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.903478    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r45q6\" (UniqueName: \"kubernetes.io/projected/2976a7f8-ff3d-4289-b2a4-86b84d078b42-kube-api-access-r45q6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:17.932191 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:17.932161    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:18.034578 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.034540    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"]
Jul 06 14:37:18.039680 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.039643    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.049943 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.049917    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"]
Jul 06 14:37:18.066028 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.065958    2552 generic.go:356] "Generic (PLEG): container finished" podID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerID="d339512b577022c392833d443b951f49e2b2c12a8d1dbb1dcea4d5ab00be19bd" exitCode=0
Jul 06 14:37:18.066216 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.066044    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs" event={"ID":"1ad4a287-2dbf-4da1-a319-1c6d319e3887","Type":"ContainerDied","Data":"d339512b577022c392833d443b951f49e2b2c12a8d1dbb1dcea4d5ab00be19bd"}
Jul 06 14:37:18.066216 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.066125    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs" event={"ID":"1ad4a287-2dbf-4da1-a319-1c6d319e3887","Type":"ContainerStarted","Data":"6ee45110eeff8566b1181c741510f68af32fef5d150049c94a98722a11fa162e"}
Jul 06 14:37:18.068572 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.068543    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"]
Jul 06 14:37:18.071118 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:18.071093    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2976a7f8_ff3d_4289_b2a4_86b84d078b42.slice/crio-8fd70dd5d5989e7fb99815e1d551e5d06ac17de76c9b39b8fb8a30fffa258bb5 WatchSource:0}: Error finding container 8fd70dd5d5989e7fb99815e1d551e5d06ac17de76c9b39b8fb8a30fffa258bb5: Status 404 returned error can't find the container with id 8fd70dd5d5989e7fb99815e1d551e5d06ac17de76c9b39b8fb8a30fffa258bb5
Jul 06 14:37:18.195788 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.195753    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.195960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.195925    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.195960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.195958    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bw78\" (UniqueName: \"kubernetes.io/projected/aa8f22d8-4852-43ad-a871-71460c0afa6b-kube-api-access-4bw78\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.296693 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.296646    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.296693 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.296691    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bw78\" (UniqueName: \"kubernetes.io/projected/aa8f22d8-4852-43ad-a871-71460c0afa6b-kube-api-access-4bw78\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.297141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.296731    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.297141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.297066    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.297141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.297095    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.308580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.308557    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bw78\" (UniqueName: \"kubernetes.io/projected/aa8f22d8-4852-43ad-a871-71460c0afa6b-kube-api-access-4bw78\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.350715 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.350680    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:18.430143 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.429923    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"]
Jul 06 14:37:18.434946 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.434920    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.445193 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.445141    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"]
Jul 06 14:37:18.489183 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.489151    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"]
Jul 06 14:37:18.492862 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:18.492835    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8f22d8_4852_43ad_a871_71460c0afa6b.slice/crio-4f771c941bc9ccfdf4b16b545182455d3b89b61ddbc1bec966cef3c3f17eac04 WatchSource:0}: Error finding container 4f771c941bc9ccfdf4b16b545182455d3b89b61ddbc1bec966cef3c3f17eac04: Status 404 returned error can't find the container with id 4f771c941bc9ccfdf4b16b545182455d3b89b61ddbc1bec966cef3c3f17eac04
Jul 06 14:37:18.599341 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.599315    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.599459 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.599356    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.599459 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.599399    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z2tl\" (UniqueName: \"kubernetes.io/projected/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-kube-api-access-2z2tl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.699975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.699901    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.699975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.699956    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.700177 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.700022    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z2tl\" (UniqueName: \"kubernetes.io/projected/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-kube-api-access-2z2tl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.700363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.700271    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.700363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.700333    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.710862 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.710836    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z2tl\" (UniqueName: \"kubernetes.io/projected/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-kube-api-access-2z2tl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.747454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.747432    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:18.898421 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:18.898387    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"]
Jul 06 14:37:18.901225 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:18.901200    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb97162d_97f7_4fb0_b09e_5bdd947c81ec.slice/crio-faa67beb4b5ed31875b7711e049ac71cc1730997501980da75d3535223df8d0e WatchSource:0}: Error finding container faa67beb4b5ed31875b7711e049ac71cc1730997501980da75d3535223df8d0e: Status 404 returned error can't find the container with id faa67beb4b5ed31875b7711e049ac71cc1730997501980da75d3535223df8d0e
Jul 06 14:37:19.071488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.071450    2552 generic.go:356] "Generic (PLEG): container finished" podID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerID="9e5c70c09f5d27d6856c6dcecbab131b9911d1f67ed9b6794f55fee1a9120244" exitCode=0
Jul 06 14:37:19.071681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.071542    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv" event={"ID":"eb97162d-97f7-4fb0-b09e-5bdd947c81ec","Type":"ContainerDied","Data":"9e5c70c09f5d27d6856c6dcecbab131b9911d1f67ed9b6794f55fee1a9120244"}
Jul 06 14:37:19.071681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.071604    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv" event={"ID":"eb97162d-97f7-4fb0-b09e-5bdd947c81ec","Type":"ContainerStarted","Data":"faa67beb4b5ed31875b7711e049ac71cc1730997501980da75d3535223df8d0e"}
Jul 06 14:37:19.073402 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.073382    2552 generic.go:356] "Generic (PLEG): container finished" podID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerID="7f64ebd0a637e41ce2894842bfc87744e8f91e9c9c5daec7b17abaf8e329c98b" exitCode=0
Jul 06 14:37:19.073503 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.073458    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs" event={"ID":"1ad4a287-2dbf-4da1-a319-1c6d319e3887","Type":"ContainerDied","Data":"7f64ebd0a637e41ce2894842bfc87744e8f91e9c9c5daec7b17abaf8e329c98b"}
Jul 06 14:37:19.075024 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.074957    2552 generic.go:356] "Generic (PLEG): container finished" podID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerID="fd6765052e3bf7d641d67b15a7745a70c90cca4094fe351c08ec47004bdcdf15" exitCode=0
Jul 06 14:37:19.075094 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.075053    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l" event={"ID":"aa8f22d8-4852-43ad-a871-71460c0afa6b","Type":"ContainerDied","Data":"fd6765052e3bf7d641d67b15a7745a70c90cca4094fe351c08ec47004bdcdf15"}
Jul 06 14:37:19.075094 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.075085    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l" event={"ID":"aa8f22d8-4852-43ad-a871-71460c0afa6b","Type":"ContainerStarted","Data":"4f771c941bc9ccfdf4b16b545182455d3b89b61ddbc1bec966cef3c3f17eac04"}
Jul 06 14:37:19.076745 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.076718    2552 generic.go:356] "Generic (PLEG): container finished" podID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerID="1abb9856365d790e58e793807c208266563618d06b67ca71d00449d6e9be6e06" exitCode=0
Jul 06 14:37:19.076833 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.076802    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5" event={"ID":"2976a7f8-ff3d-4289-b2a4-86b84d078b42","Type":"ContainerDied","Data":"1abb9856365d790e58e793807c208266563618d06b67ca71d00449d6e9be6e06"}
Jul 06 14:37:19.076891 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:19.076841    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5" event={"ID":"2976a7f8-ff3d-4289-b2a4-86b84d078b42","Type":"ContainerStarted","Data":"8fd70dd5d5989e7fb99815e1d551e5d06ac17de76c9b39b8fb8a30fffa258bb5"}
Jul 06 14:37:20.083309 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:20.083280    2552 generic.go:356] "Generic (PLEG): container finished" podID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerID="c85c5b80705c9b302194464741dc382fc4f1046e0b3f28c7cfe754e518674b0c" exitCode=0
Jul 06 14:37:20.083738 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:20.083355    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv" event={"ID":"eb97162d-97f7-4fb0-b09e-5bdd947c81ec","Type":"ContainerDied","Data":"c85c5b80705c9b302194464741dc382fc4f1046e0b3f28c7cfe754e518674b0c"}
Jul 06 14:37:20.085692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:20.085667    2552 generic.go:356] "Generic (PLEG): container finished" podID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerID="9aead118c8f2e0bc8170f1b99f8b40019e8367b7ff292b7efbdf56a1693f8258" exitCode=0
Jul 06 14:37:20.085783 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:20.085767    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs" event={"ID":"1ad4a287-2dbf-4da1-a319-1c6d319e3887","Type":"ContainerDied","Data":"9aead118c8f2e0bc8170f1b99f8b40019e8367b7ff292b7efbdf56a1693f8258"}
Jul 06 14:37:20.087484 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:20.087457    2552 generic.go:356] "Generic (PLEG): container finished" podID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerID="c2dd565241ba08c6142d62a4fcbcd1803193a3ffe2cdfe1dd90c8e9d58989338" exitCode=0
Jul 06 14:37:20.087558 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:20.087524    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5" event={"ID":"2976a7f8-ff3d-4289-b2a4-86b84d078b42","Type":"ContainerDied","Data":"c2dd565241ba08c6142d62a4fcbcd1803193a3ffe2cdfe1dd90c8e9d58989338"}
Jul 06 14:37:21.097619 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.097579    2552 generic.go:356] "Generic (PLEG): container finished" podID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerID="185a5badda3cfb8995b74eedd5361e487944c34d97c8fb98db26430349574bf1" exitCode=0
Jul 06 14:37:21.098109 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.097677    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv" event={"ID":"eb97162d-97f7-4fb0-b09e-5bdd947c81ec","Type":"ContainerDied","Data":"185a5badda3cfb8995b74eedd5361e487944c34d97c8fb98db26430349574bf1"}
Jul 06 14:37:21.099319 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.099296    2552 generic.go:356] "Generic (PLEG): container finished" podID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerID="3d30e04a51e87d00439fd3056d3b51534d9f9810682bea6bea3d807786ca3f86" exitCode=0
Jul 06 14:37:21.099443 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.099368    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l" event={"ID":"aa8f22d8-4852-43ad-a871-71460c0afa6b","Type":"ContainerDied","Data":"3d30e04a51e87d00439fd3056d3b51534d9f9810682bea6bea3d807786ca3f86"}
Jul 06 14:37:21.101502 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.101476    2552 generic.go:356] "Generic (PLEG): container finished" podID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerID="c31f9a32ce387a525aa58a8f071f722f3eee2703d650252ac87ecedd22a7ff4d" exitCode=0
Jul 06 14:37:21.101590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.101560    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5" event={"ID":"2976a7f8-ff3d-4289-b2a4-86b84d078b42","Type":"ContainerDied","Data":"c31f9a32ce387a525aa58a8f071f722f3eee2703d650252ac87ecedd22a7ff4d"}
Jul 06 14:37:21.240568 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.240537    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:21.425143 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.425089    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-util\") pod \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") "
Jul 06 14:37:21.425143 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.425159    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-bundle\") pod \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") "
Jul 06 14:37:21.425400 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.425229    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp5q2\" (UniqueName: \"kubernetes.io/projected/1ad4a287-2dbf-4da1-a319-1c6d319e3887-kube-api-access-gp5q2\") pod \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\" (UID: \"1ad4a287-2dbf-4da1-a319-1c6d319e3887\") "
Jul 06 14:37:21.425627 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.425594    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-bundle" (OuterVolumeSpecName: "bundle") pod "1ad4a287-2dbf-4da1-a319-1c6d319e3887" (UID: "1ad4a287-2dbf-4da1-a319-1c6d319e3887"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:21.427471 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.427448    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad4a287-2dbf-4da1-a319-1c6d319e3887-kube-api-access-gp5q2" (OuterVolumeSpecName: "kube-api-access-gp5q2") pod "1ad4a287-2dbf-4da1-a319-1c6d319e3887" (UID: "1ad4a287-2dbf-4da1-a319-1c6d319e3887"). InnerVolumeSpecName "kube-api-access-gp5q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:37:21.430661 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.430627    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-util" (OuterVolumeSpecName: "util") pod "1ad4a287-2dbf-4da1-a319-1c6d319e3887" (UID: "1ad4a287-2dbf-4da1-a319-1c6d319e3887"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:21.526408 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.526365    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp5q2\" (UniqueName: \"kubernetes.io/projected/1ad4a287-2dbf-4da1-a319-1c6d319e3887-kube-api-access-gp5q2\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:21.526408 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.526413    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-util\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:21.526605 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:21.526422    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ad4a287-2dbf-4da1-a319-1c6d319e3887-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:22.108108 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.108073    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs" event={"ID":"1ad4a287-2dbf-4da1-a319-1c6d319e3887","Type":"ContainerDied","Data":"6ee45110eeff8566b1181c741510f68af32fef5d150049c94a98722a11fa162e"}
Jul 06 14:37:22.108108 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.108096    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs"
Jul 06 14:37:22.108610 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.108124    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ee45110eeff8566b1181c741510f68af32fef5d150049c94a98722a11fa162e"
Jul 06 14:37:22.110112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.110086    2552 generic.go:356] "Generic (PLEG): container finished" podID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerID="4b02babca9eb4c57acefa949727f6783d6a27bc2d917cfa20cb480d2d53e72ff" exitCode=0
Jul 06 14:37:22.110243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.110172    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l" event={"ID":"aa8f22d8-4852-43ad-a871-71460c0afa6b","Type":"ContainerDied","Data":"4b02babca9eb4c57acefa949727f6783d6a27bc2d917cfa20cb480d2d53e72ff"}
Jul 06 14:37:22.247311 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.247277    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:22.277927 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.277898    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:22.435703 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.435664    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-util\") pod \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") "
Jul 06 14:37:22.435872 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.435710    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-bundle\") pod \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") "
Jul 06 14:37:22.435872 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.435751    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-bundle\") pod \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") "
Jul 06 14:37:22.435872 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.435791    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-util\") pod \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") "
Jul 06 14:37:22.435872 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.435810    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r45q6\" (UniqueName: \"kubernetes.io/projected/2976a7f8-ff3d-4289-b2a4-86b84d078b42-kube-api-access-r45q6\") pod \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\" (UID: \"2976a7f8-ff3d-4289-b2a4-86b84d078b42\") "
Jul 06 14:37:22.435872 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.435832    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z2tl\" (UniqueName: \"kubernetes.io/projected/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-kube-api-access-2z2tl\") pod \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\" (UID: \"eb97162d-97f7-4fb0-b09e-5bdd947c81ec\") "
Jul 06 14:37:22.436359 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.436328    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-bundle" (OuterVolumeSpecName: "bundle") pod "2976a7f8-ff3d-4289-b2a4-86b84d078b42" (UID: "2976a7f8-ff3d-4289-b2a4-86b84d078b42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:22.436478 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.436413    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-bundle" (OuterVolumeSpecName: "bundle") pod "eb97162d-97f7-4fb0-b09e-5bdd947c81ec" (UID: "eb97162d-97f7-4fb0-b09e-5bdd947c81ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:22.438096 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.438073    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2976a7f8-ff3d-4289-b2a4-86b84d078b42-kube-api-access-r45q6" (OuterVolumeSpecName: "kube-api-access-r45q6") pod "2976a7f8-ff3d-4289-b2a4-86b84d078b42" (UID: "2976a7f8-ff3d-4289-b2a4-86b84d078b42"). InnerVolumeSpecName "kube-api-access-r45q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:37:22.438194 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.438146    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-kube-api-access-2z2tl" (OuterVolumeSpecName: "kube-api-access-2z2tl") pod "eb97162d-97f7-4fb0-b09e-5bdd947c81ec" (UID: "eb97162d-97f7-4fb0-b09e-5bdd947c81ec"). InnerVolumeSpecName "kube-api-access-2z2tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:37:22.440749 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.440713    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-util" (OuterVolumeSpecName: "util") pod "eb97162d-97f7-4fb0-b09e-5bdd947c81ec" (UID: "eb97162d-97f7-4fb0-b09e-5bdd947c81ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:22.441538 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.441516    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-util" (OuterVolumeSpecName: "util") pod "2976a7f8-ff3d-4289-b2a4-86b84d078b42" (UID: "2976a7f8-ff3d-4289-b2a4-86b84d078b42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:22.536805 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.536768    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-util\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:22.536805 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.536798    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:22.536805 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.536806    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:22.536805 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.536814    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2976a7f8-ff3d-4289-b2a4-86b84d078b42-util\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:22.537106 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.536823    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r45q6\" (UniqueName: \"kubernetes.io/projected/2976a7f8-ff3d-4289-b2a4-86b84d078b42-kube-api-access-r45q6\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:22.537106 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:22.536832    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z2tl\" (UniqueName: \"kubernetes.io/projected/eb97162d-97f7-4fb0-b09e-5bdd947c81ec-kube-api-access-2z2tl\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:23.121531 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.121502    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv"
Jul 06 14:37:23.121531 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.121525    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv" event={"ID":"eb97162d-97f7-4fb0-b09e-5bdd947c81ec","Type":"ContainerDied","Data":"faa67beb4b5ed31875b7711e049ac71cc1730997501980da75d3535223df8d0e"}
Jul 06 14:37:23.122117 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.121592    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="faa67beb4b5ed31875b7711e049ac71cc1730997501980da75d3535223df8d0e"
Jul 06 14:37:23.123416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.123383    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5" event={"ID":"2976a7f8-ff3d-4289-b2a4-86b84d078b42","Type":"ContainerDied","Data":"8fd70dd5d5989e7fb99815e1d551e5d06ac17de76c9b39b8fb8a30fffa258bb5"}
Jul 06 14:37:23.123416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.123414    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5"
Jul 06 14:37:23.123551 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.123433    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fd70dd5d5989e7fb99815e1d551e5d06ac17de76c9b39b8fb8a30fffa258bb5"
Jul 06 14:37:23.259907 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.259879    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:23.444730 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.444641    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-bundle\") pod \"aa8f22d8-4852-43ad-a871-71460c0afa6b\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") "
Jul 06 14:37:23.444730 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.444694    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-util\") pod \"aa8f22d8-4852-43ad-a871-71460c0afa6b\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") "
Jul 06 14:37:23.444950 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.444756    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bw78\" (UniqueName: \"kubernetes.io/projected/aa8f22d8-4852-43ad-a871-71460c0afa6b-kube-api-access-4bw78\") pod \"aa8f22d8-4852-43ad-a871-71460c0afa6b\" (UID: \"aa8f22d8-4852-43ad-a871-71460c0afa6b\") "
Jul 06 14:37:23.445285 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.445251    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-bundle" (OuterVolumeSpecName: "bundle") pod "aa8f22d8-4852-43ad-a871-71460c0afa6b" (UID: "aa8f22d8-4852-43ad-a871-71460c0afa6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:23.446882 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.446860    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8f22d8-4852-43ad-a871-71460c0afa6b-kube-api-access-4bw78" (OuterVolumeSpecName: "kube-api-access-4bw78") pod "aa8f22d8-4852-43ad-a871-71460c0afa6b" (UID: "aa8f22d8-4852-43ad-a871-71460c0afa6b"). InnerVolumeSpecName "kube-api-access-4bw78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:37:23.449976 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.449953    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-util" (OuterVolumeSpecName: "util") pod "aa8f22d8-4852-43ad-a871-71460c0afa6b" (UID: "aa8f22d8-4852-43ad-a871-71460c0afa6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:37:23.545681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.545631    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bw78\" (UniqueName: \"kubernetes.io/projected/aa8f22d8-4852-43ad-a871-71460c0afa6b-kube-api-access-4bw78\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:23.545681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.545671    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:23.545681 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:23.545684    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa8f22d8-4852-43ad-a871-71460c0afa6b-util\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:37:24.131182 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:24.131154    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l"
Jul 06 14:37:24.131182 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:24.131165    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l" event={"ID":"aa8f22d8-4852-43ad-a871-71460c0afa6b","Type":"ContainerDied","Data":"4f771c941bc9ccfdf4b16b545182455d3b89b61ddbc1bec966cef3c3f17eac04"}
Jul 06 14:37:24.131724 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:24.131204    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f771c941bc9ccfdf4b16b545182455d3b89b61ddbc1bec966cef3c3f17eac04"
Jul 06 14:37:27.314769 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.314740    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7458b866-mb8xc"]
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315054    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerName="util"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315067    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerName="util"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315075    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerName="pull"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315081    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerName="pull"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315087    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerName="pull"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315093    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerName="pull"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315102    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerName="pull"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315108    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerName="pull"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315115    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerName="extract"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315120    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerName="extract"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315128    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerName="extract"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315132    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerName="extract"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315138    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerName="extract"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315143    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerName="extract"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315149    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerName="util"
Jul 06 14:37:27.315144 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315154    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerName="util"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315161    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerName="util"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315165    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerName="util"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315177    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerName="util"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315182    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerName="util"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315187    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerName="extract"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315192    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerName="extract"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315200    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerName="pull"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315205    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerName="pull"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315249    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2976a7f8-ff3d-4289-b2a4-86b84d078b42" containerName="extract"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315257    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb97162d-97f7-4fb0-b09e-5bdd947c81ec" containerName="extract"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315264    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad4a287-2dbf-4da1-a319-1c6d319e3887" containerName="extract"
Jul 06 14:37:27.315599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.315269    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8f22d8-4852-43ad-a871-71460c0afa6b" containerName="extract"
Jul 06 14:37:27.318238 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.318220    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.332324 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.332295    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7458b866-mb8xc"]
Jul 06 14:37:27.374950 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.374914    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-trusted-ca-bundle\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.374950 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.374949    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-serving-cert\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.375187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.374972    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-oauth-config\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.375187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.375013    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-service-ca\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.375187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.375060    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-oauth-serving-cert\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.375187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.375086    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-config\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.375187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.375146    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccgvn\" (UniqueName: \"kubernetes.io/projected/089816a4-dc47-48ce-b18f-e15a7e9e0d51-kube-api-access-ccgvn\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.475506 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.475462    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-oauth-config\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.475506 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.475496    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-service-ca\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.475706 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.475609    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-oauth-serving-cert\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.475706 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.475649    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-config\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.475819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.475743    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgvn\" (UniqueName: \"kubernetes.io/projected/089816a4-dc47-48ce-b18f-e15a7e9e0d51-kube-api-access-ccgvn\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.475819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.475787    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-trusted-ca-bundle\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.475819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.475814    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-serving-cert\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.480725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.476620    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-oauth-serving-cert\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.480725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.476839    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-config\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.480725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.477325    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-trusted-ca-bundle\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.480725 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.478263    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/089816a4-dc47-48ce-b18f-e15a7e9e0d51-service-ca\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.483893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.483867    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-oauth-config\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.484350 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.484328    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/089816a4-dc47-48ce-b18f-e15a7e9e0d51-console-serving-cert\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.488857 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.488829    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgvn\" (UniqueName: \"kubernetes.io/projected/089816a4-dc47-48ce-b18f-e15a7e9e0d51-kube-api-access-ccgvn\") pod \"console-6b7458b866-mb8xc\" (UID: \"089816a4-dc47-48ce-b18f-e15a7e9e0d51\") " pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.626766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.626731    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:27.768635 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:27.768587    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7458b866-mb8xc"]
Jul 06 14:37:27.774429 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:27.774401    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089816a4_dc47_48ce_b18f_e15a7e9e0d51.slice/crio-78facd5c00fefcc07bfb3b3721f41685300550b96c41d8b9ae686a3be0cf736f WatchSource:0}: Error finding container 78facd5c00fefcc07bfb3b3721f41685300550b96c41d8b9ae686a3be0cf736f: Status 404 returned error can't find the container with id 78facd5c00fefcc07bfb3b3721f41685300550b96c41d8b9ae686a3be0cf736f
Jul 06 14:37:28.150126 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:28.150087    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7458b866-mb8xc" event={"ID":"089816a4-dc47-48ce-b18f-e15a7e9e0d51","Type":"ContainerStarted","Data":"3707f4bbc3bbd590834ce32c2868e9824b5bcf16eacbeead262da05107c4295e"}
Jul 06 14:37:28.150294 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:28.150136    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7458b866-mb8xc" event={"ID":"089816a4-dc47-48ce-b18f-e15a7e9e0d51","Type":"ContainerStarted","Data":"78facd5c00fefcc07bfb3b3721f41685300550b96c41d8b9ae686a3be0cf736f"}
Jul 06 14:37:28.173278 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:28.173220    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b7458b866-mb8xc" podStartSLOduration=1.173205668 podStartE2EDuration="1.173205668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:37:28.172705005 +0000 UTC m=+509.564609179" watchObservedRunningTime="2026-07-06 14:37:28.173205668 +0000 UTC m=+509.565109838"
Jul 06 14:37:33.658964 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.658928    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"]
Jul 06 14:37:33.662340 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.662323    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:37:33.665073 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.665050    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gtvhs\""
Jul 06 14:37:33.674644 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.674619    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"]
Jul 06 14:37:33.730182 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.730142    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dll25\" (UniqueName: \"kubernetes.io/projected/caaf08cb-2a18-436d-ace9-58087ff79b5b-kube-api-access-dll25\") pod \"limitador-operator-controller-manager-859d7b78bd-n2fw7\" (UID: \"caaf08cb-2a18-436d-ace9-58087ff79b5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:37:33.831022 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.830954    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dll25\" (UniqueName: \"kubernetes.io/projected/caaf08cb-2a18-436d-ace9-58087ff79b5b-kube-api-access-dll25\") pod \"limitador-operator-controller-manager-859d7b78bd-n2fw7\" (UID: \"caaf08cb-2a18-436d-ace9-58087ff79b5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:37:33.871442 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.871407    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dll25\" (UniqueName: \"kubernetes.io/projected/caaf08cb-2a18-436d-ace9-58087ff79b5b-kube-api-access-dll25\") pod \"limitador-operator-controller-manager-859d7b78bd-n2fw7\" (UID: \"caaf08cb-2a18-436d-ace9-58087ff79b5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:37:33.972275 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:33.972193    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:37:34.129084 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:34.129059    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"]
Jul 06 14:37:34.131670 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:34.131641    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaaf08cb_2a18_436d_ace9_58087ff79b5b.slice/crio-764eee7009b1ee7ce7db859c28311214e7e6a61d67ae4d7f730d0f3987164716 WatchSource:0}: Error finding container 764eee7009b1ee7ce7db859c28311214e7e6a61d67ae4d7f730d0f3987164716: Status 404 returned error can't find the container with id 764eee7009b1ee7ce7db859c28311214e7e6a61d67ae4d7f730d0f3987164716
Jul 06 14:37:34.180971 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:34.180934    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7" event={"ID":"caaf08cb-2a18-436d-ace9-58087ff79b5b","Type":"ContainerStarted","Data":"764eee7009b1ee7ce7db859c28311214e7e6a61d67ae4d7f730d0f3987164716"}
Jul 06 14:37:36.192284 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:36.192249    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7" event={"ID":"caaf08cb-2a18-436d-ace9-58087ff79b5b","Type":"ContainerStarted","Data":"2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e"}
Jul 06 14:37:36.192691 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:36.192357    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:37:36.227371 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:36.227313    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7" podStartSLOduration=1.37371379 podStartE2EDuration="3.227296493s" totalImagesPullingTime="1.853582703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:37:36.226551638 +0000 UTC m=+517.618455810" watchObservedRunningTime="2026-07-06 14:37:36.227296493 +0000 UTC m=+517.619200663"
Jul 06 14:37:37.441527 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.441478    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"]
Jul 06 14:37:37.444853 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.444836    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"
Jul 06 14:37:37.451482 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.451450    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qxrbb\""
Jul 06 14:37:37.454856 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.454837    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 14:37:37.527432 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.527391    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"]
Jul 06 14:37:37.563657 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.563616    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvk7\" (UniqueName: \"kubernetes.io/projected/3c4cf28f-40ab-498c-807f-ca59a7686538-kube-api-access-wdvk7\") pod \"dns-operator-controller-manager-864dd78c4c-cgmbf\" (UID: \"3c4cf28f-40ab-498c-807f-ca59a7686538\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"
Jul 06 14:37:37.627197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.627154    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:37.627197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.627208    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:37.631794 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.631773    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:37.664926 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.664889    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvk7\" (UniqueName: \"kubernetes.io/projected/3c4cf28f-40ab-498c-807f-ca59a7686538-kube-api-access-wdvk7\") pod \"dns-operator-controller-manager-864dd78c4c-cgmbf\" (UID: \"3c4cf28f-40ab-498c-807f-ca59a7686538\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"
Jul 06 14:37:37.675236 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.675213    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvk7\" (UniqueName: \"kubernetes.io/projected/3c4cf28f-40ab-498c-807f-ca59a7686538-kube-api-access-wdvk7\") pod \"dns-operator-controller-manager-864dd78c4c-cgmbf\" (UID: \"3c4cf28f-40ab-498c-807f-ca59a7686538\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"
Jul 06 14:37:37.754883 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.754791    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"
Jul 06 14:37:37.911978 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:37.911954    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"]
Jul 06 14:37:37.914241 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:37.914215    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4cf28f_40ab_498c_807f_ca59a7686538.slice/crio-b2e7253fea5e5c1d34e34aa5d7627b26c1b536e3a3a55417d908cc0cb8c2cfe0 WatchSource:0}: Error finding container b2e7253fea5e5c1d34e34aa5d7627b26c1b536e3a3a55417d908cc0cb8c2cfe0: Status 404 returned error can't find the container with id b2e7253fea5e5c1d34e34aa5d7627b26c1b536e3a3a55417d908cc0cb8c2cfe0
Jul 06 14:37:38.202290 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:38.202255    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf" event={"ID":"3c4cf28f-40ab-498c-807f-ca59a7686538","Type":"ContainerStarted","Data":"b2e7253fea5e5c1d34e34aa5d7627b26c1b536e3a3a55417d908cc0cb8c2cfe0"}
Jul 06 14:37:38.206127 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:38.206104    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7458b866-mb8xc"
Jul 06 14:37:38.337356 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:38.337320    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87cf5bbcd-kbxdv"]
Jul 06 14:37:40.214169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:40.214130    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf" event={"ID":"3c4cf28f-40ab-498c-807f-ca59a7686538","Type":"ContainerStarted","Data":"194bc8ca9dc145bf641693bb295e3bf057474bf6b768887de8d1da81d375a6cd"}
Jul 06 14:37:40.214584 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:40.214243    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"
Jul 06 14:37:40.255870 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:40.255814    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf" podStartSLOduration=1.4425134050000001 podStartE2EDuration="3.255798079s" totalImagesPullingTime="1.813284674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:37:40.252825932 +0000 UTC m=+521.644730104" watchObservedRunningTime="2026-07-06 14:37:40.255798079 +0000 UTC m=+521.647702250"
Jul 06 14:37:41.059443 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.059408    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"]
Jul 06 14:37:41.062756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.062738    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"
Jul 06 14:37:41.073662 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.073642    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fkfpl\""
Jul 06 14:37:41.093564 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.093534    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"]
Jul 06 14:37:41.100532 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.100507    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8rd\" (UniqueName: \"kubernetes.io/projected/e29303ab-392d-4f8e-b469-0ae47387f2ec-kube-api-access-gh8rd\") pod \"authorino-operator-75cc8d5cb7-8hd28\" (UID: \"e29303ab-392d-4f8e-b469-0ae47387f2ec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"
Jul 06 14:37:41.201468 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.201401    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8rd\" (UniqueName: \"kubernetes.io/projected/e29303ab-392d-4f8e-b469-0ae47387f2ec-kube-api-access-gh8rd\") pod \"authorino-operator-75cc8d5cb7-8hd28\" (UID: \"e29303ab-392d-4f8e-b469-0ae47387f2ec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"
Jul 06 14:37:41.241421 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.241384    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8rd\" (UniqueName: \"kubernetes.io/projected/e29303ab-392d-4f8e-b469-0ae47387f2ec-kube-api-access-gh8rd\") pod \"authorino-operator-75cc8d5cb7-8hd28\" (UID: \"e29303ab-392d-4f8e-b469-0ae47387f2ec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"
Jul 06 14:37:41.372446 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.372410    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"
Jul 06 14:37:41.524683 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:41.524653    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29303ab_392d_4f8e_b469_0ae47387f2ec.slice/crio-4527b344f5091f749c8dfe49bd5cc4b619d52524935972bbc31cc859ca26957b WatchSource:0}: Error finding container 4527b344f5091f749c8dfe49bd5cc4b619d52524935972bbc31cc859ca26957b: Status 404 returned error can't find the container with id 4527b344f5091f749c8dfe49bd5cc4b619d52524935972bbc31cc859ca26957b
Jul 06 14:37:41.535410 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:41.535388    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"]
Jul 06 14:37:42.229687 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:42.229647    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28" event={"ID":"e29303ab-392d-4f8e-b469-0ae47387f2ec","Type":"ContainerStarted","Data":"4527b344f5091f749c8dfe49bd5cc4b619d52524935972bbc31cc859ca26957b"}
Jul 06 14:37:44.240872 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:44.240831    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28" event={"ID":"e29303ab-392d-4f8e-b469-0ae47387f2ec","Type":"ContainerStarted","Data":"bff453136b5e05be08a59a183047e999631fb8ab9910de7e057c2f8bc56d3249"}
Jul 06 14:37:44.241391 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:44.240975    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"
Jul 06 14:37:44.262843 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:44.262799    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28" podStartSLOduration=1.101168756 podStartE2EDuration="3.26278338s" totalImagesPullingTime="2.161614624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:37:44.261364652 +0000 UTC m=+525.653268823" watchObservedRunningTime="2026-07-06 14:37:44.26278338 +0000 UTC m=+525.654687551"
Jul 06 14:37:46.676040 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.676004    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"]
Jul 06 14:37:46.679415 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.679396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:46.681777 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.681759    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7qwlm\""
Jul 06 14:37:46.692780 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.692758    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"]
Jul 06 14:37:46.751174 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.751127    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc8796-7d1f-4190-9799-41087584067e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:46.751358 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.751183    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv2fl\" (UniqueName: \"kubernetes.io/projected/6cbc8796-7d1f-4190-9799-41087584067e-kube-api-access-lv2fl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:46.852460 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.852417    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc8796-7d1f-4190-9799-41087584067e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:46.852626 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.852467    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv2fl\" (UniqueName: \"kubernetes.io/projected/6cbc8796-7d1f-4190-9799-41087584067e-kube-api-access-lv2fl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:46.852846 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.852824    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc8796-7d1f-4190-9799-41087584067e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:46.864883 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.864849    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv2fl\" (UniqueName: \"kubernetes.io/projected/6cbc8796-7d1f-4190-9799-41087584067e-kube-api-access-lv2fl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:46.989204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:46.989117    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:47.135300 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:47.135271    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"]
Jul 06 14:37:47.137954 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:37:47.137917    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbc8796_7d1f_4190_9799_41087584067e.slice/crio-88f059f31a6d04d11503f63218532429521ceacd26fce3d66a0def473f433c30 WatchSource:0}: Error finding container 88f059f31a6d04d11503f63218532429521ceacd26fce3d66a0def473f433c30: Status 404 returned error can't find the container with id 88f059f31a6d04d11503f63218532429521ceacd26fce3d66a0def473f433c30
Jul 06 14:37:47.199778 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:47.199748    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:37:47.257834 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:47.257749    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r" event={"ID":"6cbc8796-7d1f-4190-9799-41087584067e","Type":"ContainerStarted","Data":"88f059f31a6d04d11503f63218532429521ceacd26fce3d66a0def473f433c30"}
Jul 06 14:37:51.221193 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:51.221110    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgmbf"
Jul 06 14:37:53.291084 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:53.291048    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r" event={"ID":"6cbc8796-7d1f-4190-9799-41087584067e","Type":"ContainerStarted","Data":"20620ee089b99940054d4bb376b4c4aeefadba4601d7b18e618883cecc18e334"}
Jul 06 14:37:53.291571 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:53.291187    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:37:53.324236 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:53.324180    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r" podStartSLOduration=1.861489862 podStartE2EDuration="7.324163713s" totalImagesPullingTime="5.462673851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:37:53.320822167 +0000 UTC m=+534.712726340" watchObservedRunningTime="2026-07-06 14:37:53.324163713 +0000 UTC m=+534.716067883"
Jul 06 14:37:55.249247 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:37:55.249218    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8hd28"
Jul 06 14:38:03.359051 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.359010    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-87cf5bbcd-kbxdv" podUID="a689d5ae-0e37-4e85-b1df-65bb967f8aaf" containerName="console" containerID="cri-o://69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0" gracePeriod=15
Jul 06 14:38:03.605105 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.605079    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:38:03.699244 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699213    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-oauth-serving-cert\") pod \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") "
Jul 06 14:38:03.699451 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699275    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-trusted-ca-bundle\") pod \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") "
Jul 06 14:38:03.699451 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699298    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-service-ca\") pod \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") "
Jul 06 14:38:03.699451 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699343    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7bdb\" (UniqueName: \"kubernetes.io/projected/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-kube-api-access-x7bdb\") pod \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") "
Jul 06 14:38:03.699451 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699374    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-oauth-config\") pod \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") "
Jul 06 14:38:03.699451 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699390    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-serving-cert\") pod \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") "
Jul 06 14:38:03.699716 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699471    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-config\") pod \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\" (UID: \"a689d5ae-0e37-4e85-b1df-65bb967f8aaf\") "
Jul 06 14:38:03.699716 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699691    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a689d5ae-0e37-4e85-b1df-65bb967f8aaf" (UID: "a689d5ae-0e37-4e85-b1df-65bb967f8aaf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:38:03.699888 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699822    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-service-ca" (OuterVolumeSpecName: "service-ca") pod "a689d5ae-0e37-4e85-b1df-65bb967f8aaf" (UID: "a689d5ae-0e37-4e85-b1df-65bb967f8aaf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:38:03.699888 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699852    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a689d5ae-0e37-4e85-b1df-65bb967f8aaf" (UID: "a689d5ae-0e37-4e85-b1df-65bb967f8aaf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:38:03.700037 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.699947    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-config" (OuterVolumeSpecName: "console-config") pod "a689d5ae-0e37-4e85-b1df-65bb967f8aaf" (UID: "a689d5ae-0e37-4e85-b1df-65bb967f8aaf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:38:03.701660 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.701628    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a689d5ae-0e37-4e85-b1df-65bb967f8aaf" (UID: "a689d5ae-0e37-4e85-b1df-65bb967f8aaf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:38:03.701660 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.701645    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a689d5ae-0e37-4e85-b1df-65bb967f8aaf" (UID: "a689d5ae-0e37-4e85-b1df-65bb967f8aaf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:38:03.701801 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.701664    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-kube-api-access-x7bdb" (OuterVolumeSpecName: "kube-api-access-x7bdb") pod "a689d5ae-0e37-4e85-b1df-65bb967f8aaf" (UID: "a689d5ae-0e37-4e85-b1df-65bb967f8aaf"). InnerVolumeSpecName "kube-api-access-x7bdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:38:03.800139 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.800100    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7bdb\" (UniqueName: \"kubernetes.io/projected/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-kube-api-access-x7bdb\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:03.800139 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.800134    2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-oauth-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:03.800139 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.800145    2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:03.800370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.800154    2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-console-config\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:03.800370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.800165    2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-oauth-serving-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:03.800370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.800175    2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-trusted-ca-bundle\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:03.800370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:03.800183    2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a689d5ae-0e37-4e85-b1df-65bb967f8aaf-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:04.298469 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.298442    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:04.347732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.347694    2552 generic.go:356] "Generic (PLEG): container finished" podID="a689d5ae-0e37-4e85-b1df-65bb967f8aaf" containerID="69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0" exitCode=0
Jul 06 14:38:04.347893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.347752    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87cf5bbcd-kbxdv"
Jul 06 14:38:04.347893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.347773    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87cf5bbcd-kbxdv" event={"ID":"a689d5ae-0e37-4e85-b1df-65bb967f8aaf","Type":"ContainerDied","Data":"69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0"}
Jul 06 14:38:04.347893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.347823    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87cf5bbcd-kbxdv" event={"ID":"a689d5ae-0e37-4e85-b1df-65bb967f8aaf","Type":"ContainerDied","Data":"aab7692b7693b340a8d1c4b03666629708ea231a46c53eaa6facafdfc9cf64cc"}
Jul 06 14:38:04.347893 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.347846    2552 scope.go:117] "RemoveContainer" containerID="69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0"
Jul 06 14:38:04.356519 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.356501    2552 scope.go:117] "RemoveContainer" containerID="69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0"
Jul 06 14:38:04.356796 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:04.356772    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0\": container with ID starting with 69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0 not found: ID does not exist" containerID="69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0"
Jul 06 14:38:04.356857 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.356810    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0"} err="failed to get container status \"69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0\": rpc error: code = NotFound desc = could not find container \"69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0\": container with ID starting with 69c21ecc59c87b620d276ae6d069d22c81904d18bc44074a0279b5269acc15b0 not found: ID does not exist"
Jul 06 14:38:04.380057 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.380026    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87cf5bbcd-kbxdv"]
Jul 06 14:38:04.387186 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:04.387163    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-87cf5bbcd-kbxdv"]
Jul 06 14:38:05.155799 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:05.155764    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a689d5ae-0e37-4e85-b1df-65bb967f8aaf" path="/var/lib/kubelet/pods/a689d5ae-0e37-4e85-b1df-65bb967f8aaf/volumes"
Jul 06 14:38:05.884449 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:05.884414    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"]
Jul 06 14:38:05.884819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:05.884753    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a689d5ae-0e37-4e85-b1df-65bb967f8aaf" containerName="console"
Jul 06 14:38:05.884819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:05.884763    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a689d5ae-0e37-4e85-b1df-65bb967f8aaf" containerName="console"
Jul 06 14:38:05.884819 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:05.884815    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a689d5ae-0e37-4e85-b1df-65bb967f8aaf" containerName="console"
Jul 06 14:38:05.889356 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:05.889337    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:05.904307 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:05.904280    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"]
Jul 06 14:38:06.019166 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.019128    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3121b4-d440-48a5-b309-118341acefd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:06.019166 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.019177    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9lk\" (UniqueName: \"kubernetes.io/projected/9d3121b4-d440-48a5-b309-118341acefd8-kube-api-access-ht9lk\") pod \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:06.120212 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.120167    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3121b4-d440-48a5-b309-118341acefd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:06.120212 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.120212    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9lk\" (UniqueName: \"kubernetes.io/projected/9d3121b4-d440-48a5-b309-118341acefd8-kube-api-access-ht9lk\") pod \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:06.120618 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.120590    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3121b4-d440-48a5-b309-118341acefd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:06.136594 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.136527    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9lk\" (UniqueName: \"kubernetes.io/projected/9d3121b4-d440-48a5-b309-118341acefd8-kube-api-access-ht9lk\") pod \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:06.187842 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.187801    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"]
Jul 06 14:38:06.188143 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.188126    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:06.203225 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.203198    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"]
Jul 06 14:38:06.222479 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.222443    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"]
Jul 06 14:38:06.222674 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.222647    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r" podUID="6cbc8796-7d1f-4190-9799-41087584067e" containerName="manager" containerID="cri-o://20620ee089b99940054d4bb376b4c4aeefadba4601d7b18e618883cecc18e334" gracePeriod=2
Jul 06 14:38:06.234889 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.234858    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"]
Jul 06 14:38:06.238418 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.238387    2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6cbc8796-7d1f-4190-9799-41087584067e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\": pods \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:06.241664 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.241638    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"]
Jul 06 14:38:06.242069 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.242040    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cbc8796-7d1f-4190-9799-41087584067e" containerName="manager"
Jul 06 14:38:06.242069 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.242056    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cbc8796-7d1f-4190-9799-41087584067e" containerName="manager"
Jul 06 14:38:06.242181 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.242140    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cbc8796-7d1f-4190-9799-41087584067e" containerName="manager"
Jul 06 14:38:06.245004 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.244973    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.247146 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.247122    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="6cbc8796-7d1f-4190-9799-41087584067e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:06.262958 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.262933    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"]
Jul 06 14:38:06.263201 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.263175    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" containerName="manager" containerID="cri-o://2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e" gracePeriod=2
Jul 06 14:38:06.268747 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.268718    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"]
Jul 06 14:38:06.284769 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.284742    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"]
Jul 06 14:38:06.292820 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.292789    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"]
Jul 06 14:38:06.293269 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.293244    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" containerName="manager"
Jul 06 14:38:06.293269 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.293267    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" containerName="manager"
Jul 06 14:38:06.293469 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.293382    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" containerName="manager"
Jul 06 14:38:06.296503 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.296484    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.321363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.321323    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"]
Jul 06 14:38:06.345724 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.345689    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="6cbc8796-7d1f-4190-9799-41087584067e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:06.347272 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.347248    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n2fw7\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:38:06.359621 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.359590    2552 generic.go:356] "Generic (PLEG): container finished" podID="6cbc8796-7d1f-4190-9799-41087584067e" containerID="20620ee089b99940054d4bb376b4c4aeefadba4601d7b18e618883cecc18e334" exitCode=0
Jul 06 14:38:06.422404 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.422321    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a222bdc1-42bb-4d29-aef9-ab424fe82805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kf9lc\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.422404 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.422371    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/307bf10b-613e-476e-8811-693f63f01c94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9499\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.422599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.422448    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f42kk\" (UniqueName: \"kubernetes.io/projected/a222bdc1-42bb-4d29-aef9-ab424fe82805-kube-api-access-f42kk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kf9lc\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.422599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.422526    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/307bf10b-613e-476e-8811-693f63f01c94-kube-api-access-74qjs\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9499\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.489114 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.489088    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:06.491186 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.491155    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="6cbc8796-7d1f-4190-9799-41087584067e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:06.492874 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.492847    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n2fw7\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:38:06.493875 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.493860    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:38:06.495701 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.495677    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mjj5r\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="6cbc8796-7d1f-4190-9799-41087584067e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:06.497227 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:06.497207    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n2fw7\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:38:06.523741 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.523712    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a222bdc1-42bb-4d29-aef9-ab424fe82805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kf9lc\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.523878 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.523754    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/307bf10b-613e-476e-8811-693f63f01c94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9499\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.523878 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.523790    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f42kk\" (UniqueName: \"kubernetes.io/projected/a222bdc1-42bb-4d29-aef9-ab424fe82805-kube-api-access-f42kk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kf9lc\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.523878 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.523847    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/307bf10b-613e-476e-8811-693f63f01c94-kube-api-access-74qjs\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9499\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.524132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.524111    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a222bdc1-42bb-4d29-aef9-ab424fe82805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kf9lc\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.524200 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.524183    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/307bf10b-613e-476e-8811-693f63f01c94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9499\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.546082 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.546060    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f42kk\" (UniqueName: \"kubernetes.io/projected/a222bdc1-42bb-4d29-aef9-ab424fe82805-kube-api-access-f42kk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kf9lc\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.548565 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.548539    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/307bf10b-613e-476e-8811-693f63f01c94-kube-api-access-74qjs\") pod \"kuadrant-operator-controller-manager-55467d9f7-n9499\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.624353 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.624320    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv2fl\" (UniqueName: \"kubernetes.io/projected/6cbc8796-7d1f-4190-9799-41087584067e-kube-api-access-lv2fl\") pod \"6cbc8796-7d1f-4190-9799-41087584067e\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") "
Jul 06 14:38:06.624526 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.624401    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dll25\" (UniqueName: \"kubernetes.io/projected/caaf08cb-2a18-436d-ace9-58087ff79b5b-kube-api-access-dll25\") pod \"caaf08cb-2a18-436d-ace9-58087ff79b5b\" (UID: \"caaf08cb-2a18-436d-ace9-58087ff79b5b\") "
Jul 06 14:38:06.624526 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.624424    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc8796-7d1f-4190-9799-41087584067e-extensions-socket-volume\") pod \"6cbc8796-7d1f-4190-9799-41087584067e\" (UID: \"6cbc8796-7d1f-4190-9799-41087584067e\") "
Jul 06 14:38:06.624856 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.624829    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cbc8796-7d1f-4190-9799-41087584067e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6cbc8796-7d1f-4190-9799-41087584067e" (UID: "6cbc8796-7d1f-4190-9799-41087584067e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:38:06.626413 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.626389    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caaf08cb-2a18-436d-ace9-58087ff79b5b-kube-api-access-dll25" (OuterVolumeSpecName: "kube-api-access-dll25") pod "caaf08cb-2a18-436d-ace9-58087ff79b5b" (UID: "caaf08cb-2a18-436d-ace9-58087ff79b5b"). InnerVolumeSpecName "kube-api-access-dll25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:38:06.626491 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.626428    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbc8796-7d1f-4190-9799-41087584067e-kube-api-access-lv2fl" (OuterVolumeSpecName: "kube-api-access-lv2fl") pod "6cbc8796-7d1f-4190-9799-41087584067e" (UID: "6cbc8796-7d1f-4190-9799-41087584067e"). InnerVolumeSpecName "kube-api-access-lv2fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:38:06.671340 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.671305    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:06.677324 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.677293    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:06.725431 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.725235    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dll25\" (UniqueName: \"kubernetes.io/projected/caaf08cb-2a18-436d-ace9-58087ff79b5b-kube-api-access-dll25\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:06.725431 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.725271    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cbc8796-7d1f-4190-9799-41087584067e-extensions-socket-volume\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:06.725431 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.725298    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv2fl\" (UniqueName: \"kubernetes.io/projected/6cbc8796-7d1f-4190-9799-41087584067e-kube-api-access-lv2fl\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:06.831759 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.831730    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"]
Jul 06 14:38:06.834251 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:38:06.834223    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda222bdc1_42bb_4d29_aef9_ab424fe82805.slice/crio-9368addfcc45e0c395b83664d9e78f2f7181ea2836b9e28de2badddd81591de9 WatchSource:0}: Error finding container 9368addfcc45e0c395b83664d9e78f2f7181ea2836b9e28de2badddd81591de9: Status 404 returned error can't find the container with id 9368addfcc45e0c395b83664d9e78f2f7181ea2836b9e28de2badddd81591de9
Jul 06 14:38:06.854886 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:06.854863    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"]
Jul 06 14:38:06.866064 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:38:06.866035    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307bf10b_613e_476e_8811_693f63f01c94.slice/crio-a8da0fdc49a868ea6e050bd8c644f2f5d57da889ae3908675b8afa184b45f56e WatchSource:0}: Error finding container a8da0fdc49a868ea6e050bd8c644f2f5d57da889ae3908675b8afa184b45f56e: Status 404 returned error can't find the container with id a8da0fdc49a868ea6e050bd8c644f2f5d57da889ae3908675b8afa184b45f56e
Jul 06 14:38:07.158154 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.158125    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cbc8796-7d1f-4190-9799-41087584067e" path="/var/lib/kubelet/pods/6cbc8796-7d1f-4190-9799-41087584067e/volumes"
Jul 06 14:38:07.158522 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.158508    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caaf08cb-2a18-436d-ace9-58087ff79b5b" path="/var/lib/kubelet/pods/caaf08cb-2a18-436d-ace9-58087ff79b5b/volumes"
Jul 06 14:38:07.366298 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.366263    2552 generic.go:356] "Generic (PLEG): container finished" podID="caaf08cb-2a18-436d-ace9-58087ff79b5b" containerID="2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e" exitCode=0
Jul 06 14:38:07.366298 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.366296    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n2fw7"
Jul 06 14:38:07.366543 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.366350    2552 scope.go:117] "RemoveContainer" containerID="2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e"
Jul 06 14:38:07.368291 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.368246    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499" event={"ID":"307bf10b-613e-476e-8811-693f63f01c94","Type":"ContainerStarted","Data":"6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185"}
Jul 06 14:38:07.368405 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.368316    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499" event={"ID":"307bf10b-613e-476e-8811-693f63f01c94","Type":"ContainerStarted","Data":"a8da0fdc49a868ea6e050bd8c644f2f5d57da889ae3908675b8afa184b45f56e"}
Jul 06 14:38:07.368518 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.368498    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:07.370149 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.370121    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc" event={"ID":"a222bdc1-42bb-4d29-aef9-ab424fe82805","Type":"ContainerStarted","Data":"72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd"}
Jul 06 14:38:07.370320 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.370171    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc" event={"ID":"a222bdc1-42bb-4d29-aef9-ab424fe82805","Type":"ContainerStarted","Data":"9368addfcc45e0c395b83664d9e78f2f7181ea2836b9e28de2badddd81591de9"}
Jul 06 14:38:07.370320 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.370204    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:07.371544 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.371524    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mjj5r"
Jul 06 14:38:07.375732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.375717    2552 scope.go:117] "RemoveContainer" containerID="2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e"
Jul 06 14:38:07.375978 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:07.375962    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e\": container with ID starting with 2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e not found: ID does not exist" containerID="2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e"
Jul 06 14:38:07.376078 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.376006    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e"} err="failed to get container status \"2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e\": rpc error: code = NotFound desc = could not find container \"2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e\": container with ID starting with 2e84dcbe2c68b9a38aa44596b6503b108509ad956f65d9ac1c2669641aae9f1e not found: ID does not exist"
Jul 06 14:38:07.376078 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.376031    2552 scope.go:117] "RemoveContainer" containerID="20620ee089b99940054d4bb376b4c4aeefadba4601d7b18e618883cecc18e334"
Jul 06 14:38:07.457228 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.456527    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499" podStartSLOduration=1.456505557 podStartE2EDuration="1.456505557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:07.455227176 +0000 UTC m=+548.847131347" watchObservedRunningTime="2026-07-06 14:38:07.456505557 +0000 UTC m=+548.848409730"
Jul 06 14:38:07.490423 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:07.490364    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc" podStartSLOduration=1.490348942 podStartE2EDuration="1.490348942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:07.488105641 +0000 UTC m=+548.880009813" watchObservedRunningTime="2026-07-06 14:38:07.490348942 +0000 UTC m=+548.882253137"
Jul 06 14:38:08.731546 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:08.731493    2552 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-7jnm9_kuadrant-system_9d3121b4-d440-48a5-b309-118341acefd8_0(fdd7869086b3494b861cc2617342c6b9c1bfa4c4282e3131e07d660d327db730): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-7jnm9 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 06 14:38:08.731815 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:08.731586    2552 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-7jnm9_kuadrant-system_9d3121b4-d440-48a5-b309-118341acefd8_0(fdd7869086b3494b861cc2617342c6b9c1bfa4c4282e3131e07d660d327db730): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-7jnm9 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:09.382866 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.382832    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:09.384882 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:09.384841    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="9d3121b4-d440-48a5-b309-118341acefd8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:09.389874 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.389853    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:09.391977 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:09.391947    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="9d3121b4-d440-48a5-b309-118341acefd8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:09.551123 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.551087    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3121b4-d440-48a5-b309-118341acefd8-extensions-socket-volume\") pod \"9d3121b4-d440-48a5-b309-118341acefd8\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") "
Jul 06 14:38:09.551287 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.551140    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht9lk\" (UniqueName: \"kubernetes.io/projected/9d3121b4-d440-48a5-b309-118341acefd8-kube-api-access-ht9lk\") pod \"9d3121b4-d440-48a5-b309-118341acefd8\" (UID: \"9d3121b4-d440-48a5-b309-118341acefd8\") "
Jul 06 14:38:09.551362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.551336    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d3121b4-d440-48a5-b309-118341acefd8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9d3121b4-d440-48a5-b309-118341acefd8" (UID: "9d3121b4-d440-48a5-b309-118341acefd8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:38:09.553222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.553193    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3121b4-d440-48a5-b309-118341acefd8-kube-api-access-ht9lk" (OuterVolumeSpecName: "kube-api-access-ht9lk") pod "9d3121b4-d440-48a5-b309-118341acefd8" (UID: "9d3121b4-d440-48a5-b309-118341acefd8"). InnerVolumeSpecName "kube-api-access-ht9lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:38:09.652524 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.652440    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d3121b4-d440-48a5-b309-118341acefd8-extensions-socket-volume\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:09.652524 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:09.652468    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht9lk\" (UniqueName: \"kubernetes.io/projected/9d3121b4-d440-48a5-b309-118341acefd8-kube-api-access-ht9lk\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:10.388152 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:10.388125    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:10.390212 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:10.390181    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="9d3121b4-d440-48a5-b309-118341acefd8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:10.395838 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:10.395811    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7jnm9\" is forbidden: User \"system:node:ip-10-0-129-16.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-16.ec2.internal' and this object" podUID="9d3121b4-d440-48a5-b309-118341acefd8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7jnm9"
Jul 06 14:38:11.155535 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:11.155500    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3121b4-d440-48a5-b309-118341acefd8" path="/var/lib/kubelet/pods/9d3121b4-d440-48a5-b309-118341acefd8/volumes"
Jul 06 14:38:18.380079 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.380042    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:18.380477 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.380119    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:18.504046 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.504012    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"]
Jul 06 14:38:18.504239 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.504197    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc" podUID="a222bdc1-42bb-4d29-aef9-ab424fe82805" containerName="manager" containerID="cri-o://72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd" gracePeriod=10
Jul 06 14:38:18.752577 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.752551    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:18.813096 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.813066    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a222bdc1-42bb-4d29-aef9-ab424fe82805-extensions-socket-volume\") pod \"a222bdc1-42bb-4d29-aef9-ab424fe82805\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") "
Jul 06 14:38:18.813346 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.813103    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f42kk\" (UniqueName: \"kubernetes.io/projected/a222bdc1-42bb-4d29-aef9-ab424fe82805-kube-api-access-f42kk\") pod \"a222bdc1-42bb-4d29-aef9-ab424fe82805\" (UID: \"a222bdc1-42bb-4d29-aef9-ab424fe82805\") "
Jul 06 14:38:18.813542 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.813516    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a222bdc1-42bb-4d29-aef9-ab424fe82805-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a222bdc1-42bb-4d29-aef9-ab424fe82805" (UID: "a222bdc1-42bb-4d29-aef9-ab424fe82805"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:38:18.815340 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.815320    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a222bdc1-42bb-4d29-aef9-ab424fe82805-kube-api-access-f42kk" (OuterVolumeSpecName: "kube-api-access-f42kk") pod "a222bdc1-42bb-4d29-aef9-ab424fe82805" (UID: "a222bdc1-42bb-4d29-aef9-ab424fe82805"). InnerVolumeSpecName "kube-api-access-f42kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:38:18.914173 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.914141    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a222bdc1-42bb-4d29-aef9-ab424fe82805-extensions-socket-volume\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:18.914173 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:18.914164    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f42kk\" (UniqueName: \"kubernetes.io/projected/a222bdc1-42bb-4d29-aef9-ab424fe82805-kube-api-access-f42kk\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:19.440563 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.440465    2552 generic.go:356] "Generic (PLEG): container finished" podID="a222bdc1-42bb-4d29-aef9-ab424fe82805" containerID="72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd" exitCode=0
Jul 06 14:38:19.440563 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.440532    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"
Jul 06 14:38:19.440563 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.440548    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc" event={"ID":"a222bdc1-42bb-4d29-aef9-ab424fe82805","Type":"ContainerDied","Data":"72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd"}
Jul 06 14:38:19.441066 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.440605    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc" event={"ID":"a222bdc1-42bb-4d29-aef9-ab424fe82805","Type":"ContainerDied","Data":"9368addfcc45e0c395b83664d9e78f2f7181ea2836b9e28de2badddd81591de9"}
Jul 06 14:38:19.441066 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.440620    2552 scope.go:117] "RemoveContainer" containerID="72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd"
Jul 06 14:38:19.449286 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.449251    2552 scope.go:117] "RemoveContainer" containerID="72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd"
Jul 06 14:38:19.449605 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:19.449577    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd\": container with ID starting with 72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd not found: ID does not exist" containerID="72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd"
Jul 06 14:38:19.449667 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.449618    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd"} err="failed to get container status \"72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd\": rpc error: code = NotFound desc = could not find container \"72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd\": container with ID starting with 72ab5faecb555a572644516d85a6638c42f76bd4b95f84cab146da4a8fa7a7bd not found: ID does not exist"
Jul 06 14:38:19.450908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.450888    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"]
Jul 06 14:38:19.451226 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.451213    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a222bdc1-42bb-4d29-aef9-ab424fe82805" containerName="manager"
Jul 06 14:38:19.451270 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.451228    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a222bdc1-42bb-4d29-aef9-ab424fe82805" containerName="manager"
Jul 06 14:38:19.451304 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.451293    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a222bdc1-42bb-4d29-aef9-ab424fe82805" containerName="manager"
Jul 06 14:38:19.455669 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.455653    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.475602 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.475569    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"]
Jul 06 14:38:19.490437 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.490403    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"]
Jul 06 14:38:19.492892 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.492867    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kf9lc"]
Jul 06 14:38:19.518903 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.518865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45vm6\" (UniqueName: \"kubernetes.io/projected/899adfa8-0cf5-4884-b7c8-a479d565a761-kube-api-access-45vm6\") pod \"kuadrant-operator-controller-manager-86878c769f-7mx5t\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.519108 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.518913    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/899adfa8-0cf5-4884-b7c8-a479d565a761-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mx5t\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.619491 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.619452    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45vm6\" (UniqueName: \"kubernetes.io/projected/899adfa8-0cf5-4884-b7c8-a479d565a761-kube-api-access-45vm6\") pod \"kuadrant-operator-controller-manager-86878c769f-7mx5t\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.619683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.619509    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/899adfa8-0cf5-4884-b7c8-a479d565a761-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mx5t\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.619850 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.619832    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/899adfa8-0cf5-4884-b7c8-a479d565a761-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7mx5t\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.635013 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.634966    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45vm6\" (UniqueName: \"kubernetes.io/projected/899adfa8-0cf5-4884-b7c8-a479d565a761-kube-api-access-45vm6\") pod \"kuadrant-operator-controller-manager-86878c769f-7mx5t\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.764729 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.764645    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:19.920465 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:19.920431    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"]
Jul 06 14:38:19.923954 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:38:19.923929    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899adfa8_0cf5_4884_b7c8_a479d565a761.slice/crio-8e7242b81c1dff003c9d22d2908b87691726fc6f1fbd746898dcf8b623f578e7 WatchSource:0}: Error finding container 8e7242b81c1dff003c9d22d2908b87691726fc6f1fbd746898dcf8b623f578e7: Status 404 returned error can't find the container with id 8e7242b81c1dff003c9d22d2908b87691726fc6f1fbd746898dcf8b623f578e7
Jul 06 14:38:20.447518 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:20.447479    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t" event={"ID":"899adfa8-0cf5-4884-b7c8-a479d565a761","Type":"ContainerStarted","Data":"606309d0590a5f1fbab40535d8fd299310215ef02d8adca2c2d337b882ed2bfa"}
Jul 06 14:38:20.447908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:20.447538    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t" event={"ID":"899adfa8-0cf5-4884-b7c8-a479d565a761","Type":"ContainerStarted","Data":"8e7242b81c1dff003c9d22d2908b87691726fc6f1fbd746898dcf8b623f578e7"}
Jul 06 14:38:20.447908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:20.447621    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:20.474813 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:20.474755    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t" podStartSLOduration=1.474737014 podStartE2EDuration="1.474737014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:20.472882937 +0000 UTC m=+561.864787108" watchObservedRunningTime="2026-07-06 14:38:20.474737014 +0000 UTC m=+561.866641185"
Jul 06 14:38:21.156376 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:21.156338    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a222bdc1-42bb-4d29-aef9-ab424fe82805" path="/var/lib/kubelet/pods/a222bdc1-42bb-4d29-aef9-ab424fe82805/volumes"
Jul 06 14:38:31.459782 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.459748    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:38:31.544580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.544538    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"]
Jul 06 14:38:31.544815 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.544769    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499" podUID="307bf10b-613e-476e-8811-693f63f01c94" containerName="manager" containerID="cri-o://6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185" gracePeriod=10
Jul 06 14:38:31.784292 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.784269    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:31.803694 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.803671    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/307bf10b-613e-476e-8811-693f63f01c94-kube-api-access-74qjs\") pod \"307bf10b-613e-476e-8811-693f63f01c94\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") "
Jul 06 14:38:31.803795 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.803741    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/307bf10b-613e-476e-8811-693f63f01c94-extensions-socket-volume\") pod \"307bf10b-613e-476e-8811-693f63f01c94\" (UID: \"307bf10b-613e-476e-8811-693f63f01c94\") "
Jul 06 14:38:31.804105 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.804084    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307bf10b-613e-476e-8811-693f63f01c94-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "307bf10b-613e-476e-8811-693f63f01c94" (UID: "307bf10b-613e-476e-8811-693f63f01c94"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:38:31.805656 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.805636    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307bf10b-613e-476e-8811-693f63f01c94-kube-api-access-74qjs" (OuterVolumeSpecName: "kube-api-access-74qjs") pod "307bf10b-613e-476e-8811-693f63f01c94" (UID: "307bf10b-613e-476e-8811-693f63f01c94"). InnerVolumeSpecName "kube-api-access-74qjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:38:31.904647 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.904606    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/307bf10b-613e-476e-8811-693f63f01c94-kube-api-access-74qjs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:31.904647 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:31.904640    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/307bf10b-613e-476e-8811-693f63f01c94-extensions-socket-volume\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:38:32.509942 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.509904    2552 generic.go:356] "Generic (PLEG): container finished" podID="307bf10b-613e-476e-8811-693f63f01c94" containerID="6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185" exitCode=0
Jul 06 14:38:32.509942 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.509947    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"
Jul 06 14:38:32.510466 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.509984    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499" event={"ID":"307bf10b-613e-476e-8811-693f63f01c94","Type":"ContainerDied","Data":"6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185"}
Jul 06 14:38:32.510466 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.510059    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499" event={"ID":"307bf10b-613e-476e-8811-693f63f01c94","Type":"ContainerDied","Data":"a8da0fdc49a868ea6e050bd8c644f2f5d57da889ae3908675b8afa184b45f56e"}
Jul 06 14:38:32.510466 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.510082    2552 scope.go:117] "RemoveContainer" containerID="6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185"
Jul 06 14:38:32.519818 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.519797    2552 scope.go:117] "RemoveContainer" containerID="6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185"
Jul 06 14:38:32.520073 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:38:32.520053    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185\": container with ID starting with 6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185 not found: ID does not exist" containerID="6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185"
Jul 06 14:38:32.520137 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.520084    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185"} err="failed to get container status \"6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185\": rpc error: code = NotFound desc = could not find container \"6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185\": container with ID starting with 6ee1f9d5b4be9358d0cc60562062509d0f5515afee67b7fec979ea666cc60185 not found: ID does not exist"
Jul 06 14:38:32.547805 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.547767    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"]
Jul 06 14:38:32.556839 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:32.556815    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-n9499"]
Jul 06 14:38:33.155753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:33.155716    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="307bf10b-613e-476e-8811-693f63f01c94" path="/var/lib/kubelet/pods/307bf10b-613e-476e-8811-693f63f01c94/volumes"
Jul 06 14:38:35.204009 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.203971    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"]
Jul 06 14:38:35.208018 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.205030    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bf10b-613e-476e-8811-693f63f01c94" containerName="manager"
Jul 06 14:38:35.208018 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.205066    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bf10b-613e-476e-8811-693f63f01c94" containerName="manager"
Jul 06 14:38:35.208018 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.205237    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="307bf10b-613e-476e-8811-693f63f01c94" containerName="manager"
Jul 06 14:38:35.211236 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.211209    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.216085 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.216064    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-55z67\""
Jul 06 14:38:35.226788 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.226759    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"]
Jul 06 14:38:35.234043 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234019    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234051    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edaf42e8-85d0-4ceb-a293-b5ec27587994-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234101    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234258 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234175    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234258 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234214    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzl6k\" (UniqueName: \"kubernetes.io/projected/edaf42e8-85d0-4ceb-a293-b5ec27587994-kube-api-access-rzl6k\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234258 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234251    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234379 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234298    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234379 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234334    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.234379 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.234366    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335364 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335323    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335562 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335380    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335562 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335407    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335562 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335434    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335562 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335492    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335562 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335518    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edaf42e8-85d0-4ceb-a293-b5ec27587994-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335562 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335541    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335569    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335605    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzl6k\" (UniqueName: \"kubernetes.io/projected/edaf42e8-85d0-4ceb-a293-b5ec27587994-kube-api-access-rzl6k\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335814    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.335860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.335849    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.336114 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.336076    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.336174 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.336148    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.336352 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.336329    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edaf42e8-85d0-4ceb-a293-b5ec27587994-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.337767 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.337745    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.338109 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.338088    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.365361 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.365331    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzl6k\" (UniqueName: \"kubernetes.io/projected/edaf42e8-85d0-4ceb-a293-b5ec27587994-kube-api-access-rzl6k\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.365499 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.365332    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edaf42e8-85d0-4ceb-a293-b5ec27587994-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ndwvw\" (UID: \"edaf42e8-85d0-4ceb-a293-b5ec27587994\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.521025 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.520896    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:35.681605 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.681564    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"]
Jul 06 14:38:35.684652 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:38:35.684621    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedaf42e8_85d0_4ceb_a293_b5ec27587994.slice/crio-1c518d8592cfcd58755d4398280a59ffcc100b1afe06f25286f6ca1373382265 WatchSource:0}: Error finding container 1c518d8592cfcd58755d4398280a59ffcc100b1afe06f25286f6ca1373382265: Status 404 returned error can't find the container with id 1c518d8592cfcd58755d4398280a59ffcc100b1afe06f25286f6ca1373382265
Jul 06 14:38:35.686709 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.686677    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:38:35.686762 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.686748    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:38:35.686805 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:35.686778    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:38:36.532153 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:36.532118    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" event={"ID":"edaf42e8-85d0-4ceb-a293-b5ec27587994","Type":"ContainerStarted","Data":"f752a5c27bc7300e68c34350c1dd7f50624aecab782729dfc57601c08017f31f"}
Jul 06 14:38:36.532552 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:36.532176    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" event={"ID":"edaf42e8-85d0-4ceb-a293-b5ec27587994","Type":"ContainerStarted","Data":"1c518d8592cfcd58755d4398280a59ffcc100b1afe06f25286f6ca1373382265"}
Jul 06 14:38:36.567192 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:36.567142    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" podStartSLOduration=1.5671235540000001 podStartE2EDuration="1.567123554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:36.567045788 +0000 UTC m=+577.958949961" watchObservedRunningTime="2026-07-06 14:38:36.567123554 +0000 UTC m=+577.959027723"
Jul 06 14:38:37.521684 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:37.521643    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:37.526375 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:37.526349    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:37.537260 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:37.537234    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:37.538118 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:37.538100    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:38:52.572354 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.572308    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"]
Jul 06 14:38:52.575439 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.575423    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:52.578161 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.578142    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t92s5\""
Jul 06 14:38:52.578777 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.578757    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 14:38:52.586337 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.586315    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"]
Jul 06 14:38:52.651906 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.651875    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"]
Jul 06 14:38:52.689600 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.689565    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpblc\" (UniqueName: \"kubernetes.io/projected/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-kube-api-access-dpblc\") pod \"limitador-limitador-64c94fd64f-wnnlj\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:52.689799 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.689685    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-config-file\") pod \"limitador-limitador-64c94fd64f-wnnlj\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:52.790621 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.790582    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-config-file\") pod \"limitador-limitador-64c94fd64f-wnnlj\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:52.790809 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.790647    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpblc\" (UniqueName: \"kubernetes.io/projected/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-kube-api-access-dpblc\") pod \"limitador-limitador-64c94fd64f-wnnlj\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:52.791242 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.791220    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-config-file\") pod \"limitador-limitador-64c94fd64f-wnnlj\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:52.812606 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.812573    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpblc\" (UniqueName: \"kubernetes.io/projected/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-kube-api-access-dpblc\") pod \"limitador-limitador-64c94fd64f-wnnlj\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:52.886880 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:52.886841    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:53.031727 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.031702    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"]
Jul 06 14:38:53.033330 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:38:53.033288    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddccfe2_94f5_4c16_88b8_84a5c7d0c624.slice/crio-ec3d7dd13d077797c51076e261897857be8a6ff5966ac8dfa76234ac9a04ee33 WatchSource:0}: Error finding container ec3d7dd13d077797c51076e261897857be8a6ff5966ac8dfa76234ac9a04ee33: Status 404 returned error can't find the container with id ec3d7dd13d077797c51076e261897857be8a6ff5966ac8dfa76234ac9a04ee33
Jul 06 14:38:53.527957 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.527921    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-gwqz9"]
Jul 06 14:38:53.531431 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.531407    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gwqz9"
Jul 06 14:38:53.534327 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.534302    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qz6zs\""
Jul 06 14:38:53.551899 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.551873    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gwqz9"]
Jul 06 14:38:53.597050 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.597016    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dwqc\" (UniqueName: \"kubernetes.io/projected/1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6-kube-api-access-2dwqc\") pod \"authorino-58cd955675-gwqz9\" (UID: \"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6\") " pod="kuadrant-system/authorino-58cd955675-gwqz9"
Jul 06 14:38:53.620403 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.620362    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj" event={"ID":"dddccfe2-94f5-4c16-88b8-84a5c7d0c624","Type":"ContainerStarted","Data":"ec3d7dd13d077797c51076e261897857be8a6ff5966ac8dfa76234ac9a04ee33"}
Jul 06 14:38:53.697779 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.697743    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dwqc\" (UniqueName: \"kubernetes.io/projected/1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6-kube-api-access-2dwqc\") pod \"authorino-58cd955675-gwqz9\" (UID: \"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6\") " pod="kuadrant-system/authorino-58cd955675-gwqz9"
Jul 06 14:38:53.712581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.712550    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dwqc\" (UniqueName: \"kubernetes.io/projected/1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6-kube-api-access-2dwqc\") pod \"authorino-58cd955675-gwqz9\" (UID: \"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6\") " pod="kuadrant-system/authorino-58cd955675-gwqz9"
Jul 06 14:38:53.841729 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:53.841638    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gwqz9"
Jul 06 14:38:54.060574 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:54.060530    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gwqz9"]
Jul 06 14:38:54.062541 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:38:54.062513    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ee43ff0_a71d_47dd_8685_dc4e8c3ff3f6.slice/crio-a694539a0b73e4d8c118e7347e837cf60e7dee0ed3ab52bc109b40a804081fa1 WatchSource:0}: Error finding container a694539a0b73e4d8c118e7347e837cf60e7dee0ed3ab52bc109b40a804081fa1: Status 404 returned error can't find the container with id a694539a0b73e4d8c118e7347e837cf60e7dee0ed3ab52bc109b40a804081fa1
Jul 06 14:38:54.628473 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:54.628432    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gwqz9" event={"ID":"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6","Type":"ContainerStarted","Data":"a694539a0b73e4d8c118e7347e837cf60e7dee0ed3ab52bc109b40a804081fa1"}
Jul 06 14:38:56.643715 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:56.643649    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj" event={"ID":"dddccfe2-94f5-4c16-88b8-84a5c7d0c624","Type":"ContainerStarted","Data":"04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7"}
Jul 06 14:38:56.644232 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:56.643723    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:38:57.951363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:57.951306    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj" podStartSLOduration=3.188902542 podStartE2EDuration="5.951289581s" totalImagesPullingTime="2.762387039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:56.673306623 +0000 UTC m=+598.065210794" watchObservedRunningTime="2026-07-06 14:38:57.951289581 +0000 UTC m=+599.343193759"
Jul 06 14:38:57.952342 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:57.952321    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gwqz9"]
Jul 06 14:38:58.656316 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:58.656278    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gwqz9" event={"ID":"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6","Type":"ContainerStarted","Data":"928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f"}
Jul 06 14:38:58.679523 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:58.679468    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-gwqz9" podStartSLOduration=1.902743694 podStartE2EDuration="5.679447483s" totalImagesPullingTime="3.776703789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:38:58.678876841 +0000 UTC m=+600.070781011" watchObservedRunningTime="2026-07-06 14:38:58.679447483 +0000 UTC m=+600.071351651"
Jul 06 14:38:59.660766 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:59.660699    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-gwqz9" podUID="1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6" containerName="authorino" containerID="cri-o://928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f" gracePeriod=30
Jul 06 14:38:59.911381 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:38:59.911322    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gwqz9"
Jul 06 14:39:00.059462 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.059431    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dwqc\" (UniqueName: \"kubernetes.io/projected/1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6-kube-api-access-2dwqc\") pod \"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6\" (UID: \"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6\") "
Jul 06 14:39:00.061502 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.061473    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6-kube-api-access-2dwqc" (OuterVolumeSpecName: "kube-api-access-2dwqc") pod "1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6" (UID: "1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6"). InnerVolumeSpecName "kube-api-access-2dwqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:39:00.160986 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.160944    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dwqc\" (UniqueName: \"kubernetes.io/projected/1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6-kube-api-access-2dwqc\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:39:00.666443 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.666405    2552 generic.go:356] "Generic (PLEG): container finished" podID="1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6" containerID="928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f" exitCode=0
Jul 06 14:39:00.666939 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.666450    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gwqz9"
Jul 06 14:39:00.666939 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.666457    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gwqz9" event={"ID":"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6","Type":"ContainerDied","Data":"928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f"}
Jul 06 14:39:00.666939 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.666486    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gwqz9" event={"ID":"1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6","Type":"ContainerDied","Data":"a694539a0b73e4d8c118e7347e837cf60e7dee0ed3ab52bc109b40a804081fa1"}
Jul 06 14:39:00.666939 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.666503    2552 scope.go:117] "RemoveContainer" containerID="928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f"
Jul 06 14:39:00.675716 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.675696    2552 scope.go:117] "RemoveContainer" containerID="928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f"
Jul 06 14:39:00.675969 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:39:00.675945    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f\": container with ID starting with 928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f not found: ID does not exist" containerID="928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f"
Jul 06 14:39:00.676082 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.675975    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f"} err="failed to get container status \"928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f\": rpc error: code = NotFound desc = could not find container \"928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f\": container with ID starting with 928fcc966e04951c5dd0304f5847bbf1924c9f4f9d6e5444cfd342d2ae8a9b5f not found: ID does not exist"
Jul 06 14:39:00.697386 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.697358    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gwqz9"]
Jul 06 14:39:00.704089 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:00.704063    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-gwqz9"]
Jul 06 14:39:01.155966 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:01.155932    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6" path="/var/lib/kubelet/pods/1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6/volumes"
Jul 06 14:39:07.650541 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:07.650493    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:39:07.964226 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:07.964131    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"]
Jul 06 14:39:07.964411 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:07.964382    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj" podUID="dddccfe2-94f5-4c16-88b8-84a5c7d0c624" containerName="limitador" containerID="cri-o://04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7" gracePeriod=30
Jul 06 14:39:08.516724 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.516697    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:39:08.635415 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.635388    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpblc\" (UniqueName: \"kubernetes.io/projected/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-kube-api-access-dpblc\") pod \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") "
Jul 06 14:39:08.635599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.635454    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-config-file\") pod \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\" (UID: \"dddccfe2-94f5-4c16-88b8-84a5c7d0c624\") "
Jul 06 14:39:08.635835 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.635810    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-config-file" (OuterVolumeSpecName: "config-file") pod "dddccfe2-94f5-4c16-88b8-84a5c7d0c624" (UID: "dddccfe2-94f5-4c16-88b8-84a5c7d0c624"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:39:08.637473 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.637448    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-kube-api-access-dpblc" (OuterVolumeSpecName: "kube-api-access-dpblc") pod "dddccfe2-94f5-4c16-88b8-84a5c7d0c624" (UID: "dddccfe2-94f5-4c16-88b8-84a5c7d0c624"). InnerVolumeSpecName "kube-api-access-dpblc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:39:08.707826 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.707790    2552 generic.go:356] "Generic (PLEG): container finished" podID="dddccfe2-94f5-4c16-88b8-84a5c7d0c624" containerID="04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7" exitCode=0
Jul 06 14:39:08.708239 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.707835    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"
Jul 06 14:39:08.708239 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.707876    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj" event={"ID":"dddccfe2-94f5-4c16-88b8-84a5c7d0c624","Type":"ContainerDied","Data":"04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7"}
Jul 06 14:39:08.708239 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.707926    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wnnlj" event={"ID":"dddccfe2-94f5-4c16-88b8-84a5c7d0c624","Type":"ContainerDied","Data":"ec3d7dd13d077797c51076e261897857be8a6ff5966ac8dfa76234ac9a04ee33"}
Jul 06 14:39:08.708239 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.707949    2552 scope.go:117] "RemoveContainer" containerID="04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7"
Jul 06 14:39:08.716851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.716832    2552 scope.go:117] "RemoveContainer" containerID="04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7"
Jul 06 14:39:08.717153 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:39:08.717130    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7\": container with ID starting with 04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7 not found: ID does not exist" containerID="04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7"
Jul 06 14:39:08.717229 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.717161    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7"} err="failed to get container status \"04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7\": rpc error: code = NotFound desc = could not find container \"04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7\": container with ID starting with 04f8104c9b6bc50f5c38140814d33d343ff4fdc5c8bad44da43f4a13e7c970a7 not found: ID does not exist"
Jul 06 14:39:08.732573 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.732545    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"]
Jul 06 14:39:08.736860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.736840    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpblc\" (UniqueName: \"kubernetes.io/projected/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-kube-api-access-dpblc\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:39:08.736973 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.736863    2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dddccfe2-94f5-4c16-88b8-84a5c7d0c624-config-file\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:39:08.740417 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:08.740394    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wnnlj"]
Jul 06 14:39:09.155793 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.155760    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dddccfe2-94f5-4c16-88b8-84a5c7d0c624" path="/var/lib/kubelet/pods/dddccfe2-94f5-4c16-88b8-84a5c7d0c624/volumes"
Jul 06 14:39:09.877524 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.877486    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ndk2b"]
Jul 06 14:39:09.877975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.877809    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dddccfe2-94f5-4c16-88b8-84a5c7d0c624" containerName="limitador"
Jul 06 14:39:09.877975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.877821    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dddccfe2-94f5-4c16-88b8-84a5c7d0c624" containerName="limitador"
Jul 06 14:39:09.877975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.877838    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6" containerName="authorino"
Jul 06 14:39:09.877975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.877843    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6" containerName="authorino"
Jul 06 14:39:09.877975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.877896    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="dddccfe2-94f5-4c16-88b8-84a5c7d0c624" containerName="limitador"
Jul 06 14:39:09.877975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.877905    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee43ff0-a71d-47dd-8685-dc4e8c3ff3f6" containerName="authorino"
Jul 06 14:39:09.882183 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.882160    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:09.884578 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.884558    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 14:39:09.884697 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.884678    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8sxjp\""
Jul 06 14:39:09.891911 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:09.891883    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ndk2b"]
Jul 06 14:39:10.048157 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.048122    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/655f0294-7c22-42a9-a186-2eb808095b05-data\") pod \"postgres-69fb4594cf-ndk2b\" (UID: \"655f0294-7c22-42a9-a186-2eb808095b05\") " pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:10.048157 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.048157    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmjrz\" (UniqueName: \"kubernetes.io/projected/655f0294-7c22-42a9-a186-2eb808095b05-kube-api-access-dmjrz\") pod \"postgres-69fb4594cf-ndk2b\" (UID: \"655f0294-7c22-42a9-a186-2eb808095b05\") " pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:10.149019 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.148892    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/655f0294-7c22-42a9-a186-2eb808095b05-data\") pod \"postgres-69fb4594cf-ndk2b\" (UID: \"655f0294-7c22-42a9-a186-2eb808095b05\") " pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:10.149019 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.148937    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmjrz\" (UniqueName: \"kubernetes.io/projected/655f0294-7c22-42a9-a186-2eb808095b05-kube-api-access-dmjrz\") pod \"postgres-69fb4594cf-ndk2b\" (UID: \"655f0294-7c22-42a9-a186-2eb808095b05\") " pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:10.149335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.149296    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/655f0294-7c22-42a9-a186-2eb808095b05-data\") pod \"postgres-69fb4594cf-ndk2b\" (UID: \"655f0294-7c22-42a9-a186-2eb808095b05\") " pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:10.158352 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.158328    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmjrz\" (UniqueName: \"kubernetes.io/projected/655f0294-7c22-42a9-a186-2eb808095b05-kube-api-access-dmjrz\") pod \"postgres-69fb4594cf-ndk2b\" (UID: \"655f0294-7c22-42a9-a186-2eb808095b05\") " pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:10.192842 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.192810    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:10.329312 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.329286    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ndk2b"]
Jul 06 14:39:10.331407 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:39:10.331380    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655f0294_7c22_42a9_a186_2eb808095b05.slice/crio-6b39e9f9370c7d7c1d4f16f463f73af9cb6c5af9d8a01b3f359ab6cf6842bff4 WatchSource:0}: Error finding container 6b39e9f9370c7d7c1d4f16f463f73af9cb6c5af9d8a01b3f359ab6cf6842bff4: Status 404 returned error can't find the container with id 6b39e9f9370c7d7c1d4f16f463f73af9cb6c5af9d8a01b3f359ab6cf6842bff4
Jul 06 14:39:10.725428 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:10.725389    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ndk2b" event={"ID":"655f0294-7c22-42a9-a186-2eb808095b05","Type":"ContainerStarted","Data":"6b39e9f9370c7d7c1d4f16f463f73af9cb6c5af9d8a01b3f359ab6cf6842bff4"}
Jul 06 14:39:15.754025 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:15.753975    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ndk2b" event={"ID":"655f0294-7c22-42a9-a186-2eb808095b05","Type":"ContainerStarted","Data":"ba7ff5fafe9255b9b89729e0ed72b36d421fa67289abbb2cf96938a60a3d38de"}
Jul 06 14:39:15.754483 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:15.754108    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:15.772896 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:15.772843    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ndk2b" podStartSLOduration=2.00968692 podStartE2EDuration="6.772828831s" totalImagesPullingTime="4.763141911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:39:15.772105808 +0000 UTC m=+617.164009975" watchObservedRunningTime="2026-07-06 14:39:15.772828831 +0000 UTC m=+617.164733001"
Jul 06 14:39:21.789815 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:21.789741    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ndk2b"
Jul 06 14:39:22.414289 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.414215    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5kq4m"]
Jul 06 14:39:22.420231 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.420202    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5kq4m"
Jul 06 14:39:22.422595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.422570    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qz6zs\""
Jul 06 14:39:22.425145 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.425121    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5kq4m"]
Jul 06 14:39:22.455142 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.455112    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npdv\" (UniqueName: \"kubernetes.io/projected/d2a42987-04b9-42ac-adde-f329a789006f-kube-api-access-2npdv\") pod \"authorino-5d4b67c446-5kq4m\" (UID: \"d2a42987-04b9-42ac-adde-f329a789006f\") " pod="kuadrant-system/authorino-5d4b67c446-5kq4m"
Jul 06 14:39:22.555941 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.555903    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2npdv\" (UniqueName: \"kubernetes.io/projected/d2a42987-04b9-42ac-adde-f329a789006f-kube-api-access-2npdv\") pod \"authorino-5d4b67c446-5kq4m\" (UID: \"d2a42987-04b9-42ac-adde-f329a789006f\") " pod="kuadrant-system/authorino-5d4b67c446-5kq4m"
Jul 06 14:39:22.567396 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.567371    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npdv\" (UniqueName: \"kubernetes.io/projected/d2a42987-04b9-42ac-adde-f329a789006f-kube-api-access-2npdv\") pod \"authorino-5d4b67c446-5kq4m\" (UID: \"d2a42987-04b9-42ac-adde-f329a789006f\") " pod="kuadrant-system/authorino-5d4b67c446-5kq4m"
Jul 06 14:39:22.680797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.680708    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5kq4m"]
Jul 06 14:39:22.680983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.680968    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5kq4m"
Jul 06 14:39:22.768407 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.768358    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5595799bf9-fj877"]
Jul 06 14:39:22.781025 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.780656    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595799bf9-fj877"
Jul 06 14:39:22.801405 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.801373    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5595799bf9-fj877"]
Jul 06 14:39:22.830314 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.830284    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5kq4m"]
Jul 06 14:39:22.832540 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:39:22.832511    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2a42987_04b9_42ac_adde_f329a789006f.slice/crio-b17ddcfa9859e11907bd0cc476ff7406104f2f08e7805776cc5b44082fd51d9d WatchSource:0}: Error finding container b17ddcfa9859e11907bd0cc476ff7406104f2f08e7805776cc5b44082fd51d9d: Status 404 returned error can't find the container with id b17ddcfa9859e11907bd0cc476ff7406104f2f08e7805776cc5b44082fd51d9d
Jul 06 14:39:22.858385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.858350    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72t4\" (UniqueName: \"kubernetes.io/projected/76127c3b-e1e5-420e-9426-4d0d329ef8d3-kube-api-access-s72t4\") pod \"authorino-5595799bf9-fj877\" (UID: \"76127c3b-e1e5-420e-9426-4d0d329ef8d3\") " pod="kuadrant-system/authorino-5595799bf9-fj877"
Jul 06 14:39:22.959039 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.958924    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s72t4\" (UniqueName: \"kubernetes.io/projected/76127c3b-e1e5-420e-9426-4d0d329ef8d3-kube-api-access-s72t4\") pod \"authorino-5595799bf9-fj877\" (UID: \"76127c3b-e1e5-420e-9426-4d0d329ef8d3\") " pod="kuadrant-system/authorino-5595799bf9-fj877"
Jul 06 14:39:22.973231 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:22.973196    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72t4\" (UniqueName: \"kubernetes.io/projected/76127c3b-e1e5-420e-9426-4d0d329ef8d3-kube-api-access-s72t4\") pod \"authorino-5595799bf9-fj877\" (UID: \"76127c3b-e1e5-420e-9426-4d0d329ef8d3\") " pod="kuadrant-system/authorino-5595799bf9-fj877"
Jul 06 14:39:23.092036 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.091976    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595799bf9-fj877"
Jul 06 14:39:23.231289 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.231267    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5595799bf9-fj877"]
Jul 06 14:39:23.234164 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:39:23.234107    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76127c3b_e1e5_420e_9426_4d0d329ef8d3.slice/crio-49d199807b16e75b023045ce362702ce896daebac0a42e76b909012dc76c0781 WatchSource:0}: Error finding container 49d199807b16e75b023045ce362702ce896daebac0a42e76b909012dc76c0781: Status 404 returned error can't find the container with id 49d199807b16e75b023045ce362702ce896daebac0a42e76b909012dc76c0781
Jul 06 14:39:23.241377 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.241352    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5595799bf9-fj877"]
Jul 06 14:39:23.288053 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.288023    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74b8d44ff5-qdnpz"]
Jul 06 14:39:23.291649 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.291620    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.293970 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.293946    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 14:39:23.303701 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.303672    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b8d44ff5-qdnpz"]
Jul 06 14:39:23.361810 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.361768    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzwkf\" (UniqueName: \"kubernetes.io/projected/b44c199f-ae93-463b-9964-ab5943b0d19b-kube-api-access-dzwkf\") pod \"authorino-74b8d44ff5-qdnpz\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") " pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.362015 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.361825    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b44c199f-ae93-463b-9964-ab5943b0d19b-tls-cert\") pod \"authorino-74b8d44ff5-qdnpz\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") " pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.462488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.462442    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzwkf\" (UniqueName: \"kubernetes.io/projected/b44c199f-ae93-463b-9964-ab5943b0d19b-kube-api-access-dzwkf\") pod \"authorino-74b8d44ff5-qdnpz\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") " pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.462695 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.462501    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b44c199f-ae93-463b-9964-ab5943b0d19b-tls-cert\") pod \"authorino-74b8d44ff5-qdnpz\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") " pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.465092 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.465023    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b44c199f-ae93-463b-9964-ab5943b0d19b-tls-cert\") pod \"authorino-74b8d44ff5-qdnpz\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") " pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.473813 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.473793    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzwkf\" (UniqueName: \"kubernetes.io/projected/b44c199f-ae93-463b-9964-ab5943b0d19b-kube-api-access-dzwkf\") pod \"authorino-74b8d44ff5-qdnpz\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") " pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.602303 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.602261    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:39:23.752612 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.752583    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74b8d44ff5-qdnpz"]
Jul 06 14:39:23.754350 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:39:23.754320    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb44c199f_ae93_463b_9964_ab5943b0d19b.slice/crio-cd96684fbb09caa6fc96ba0209c034d99e9e117709204b7263e8c1421e27ddc8 WatchSource:0}: Error finding container cd96684fbb09caa6fc96ba0209c034d99e9e117709204b7263e8c1421e27ddc8: Status 404 returned error can't find the container with id cd96684fbb09caa6fc96ba0209c034d99e9e117709204b7263e8c1421e27ddc8
Jul 06 14:39:23.800363 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.800323    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz" event={"ID":"b44c199f-ae93-463b-9964-ab5943b0d19b","Type":"ContainerStarted","Data":"cd96684fbb09caa6fc96ba0209c034d99e9e117709204b7263e8c1421e27ddc8"}
Jul 06 14:39:23.802182 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.802150    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5kq4m" event={"ID":"d2a42987-04b9-42ac-adde-f329a789006f","Type":"ContainerStarted","Data":"7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20"}
Jul 06 14:39:23.802663 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.802195    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5kq4m" event={"ID":"d2a42987-04b9-42ac-adde-f329a789006f","Type":"ContainerStarted","Data":"b17ddcfa9859e11907bd0cc476ff7406104f2f08e7805776cc5b44082fd51d9d"}
Jul 06 14:39:23.802663 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.802225    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5kq4m" podUID="d2a42987-04b9-42ac-adde-f329a789006f" containerName="authorino" containerID="cri-o://7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20" gracePeriod=30
Jul 06 14:39:23.804250 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.804219    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595799bf9-fj877" event={"ID":"76127c3b-e1e5-420e-9426-4d0d329ef8d3","Type":"ContainerStarted","Data":"608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27"}
Jul 06 14:39:23.804401 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.804262    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595799bf9-fj877" event={"ID":"76127c3b-e1e5-420e-9426-4d0d329ef8d3","Type":"ContainerStarted","Data":"49d199807b16e75b023045ce362702ce896daebac0a42e76b909012dc76c0781"}
Jul 06 14:39:23.804401 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.804289    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5595799bf9-fj877" podUID="76127c3b-e1e5-420e-9426-4d0d329ef8d3" containerName="authorino" containerID="cri-o://608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27" gracePeriod=30
Jul 06 14:39:23.824247 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.824196    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5kq4m" podStartSLOduration=1.488118139 podStartE2EDuration="1.8241797s" totalImagesPullingTime="336.061561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:39:23.82176698 +0000 UTC m=+625.213671150" watchObservedRunningTime="2026-07-06 14:39:23.8241797 +0000 UTC m=+625.216083870"
Jul 06 14:39:23.842443 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:23.842389    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5595799bf9-fj877" podStartSLOduration=1.430529401 podStartE2EDuration="1.842371054s" totalImagesPullingTime="411.841653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:39:23.839840613 +0000 UTC m=+625.231744781" watchObservedRunningTime="2026-07-06 14:39:23.842371054 +0000 UTC m=+625.234275224"
Jul 06 14:39:24.071915 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.071894    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5kq4m"
Jul 06 14:39:24.078748 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.078720    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595799bf9-fj877"
Jul 06 14:39:24.268924 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.268844    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s72t4\" (UniqueName: \"kubernetes.io/projected/76127c3b-e1e5-420e-9426-4d0d329ef8d3-kube-api-access-s72t4\") pod \"76127c3b-e1e5-420e-9426-4d0d329ef8d3\" (UID: \"76127c3b-e1e5-420e-9426-4d0d329ef8d3\") "
Jul 06 14:39:24.268924 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.268886    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2npdv\" (UniqueName: \"kubernetes.io/projected/d2a42987-04b9-42ac-adde-f329a789006f-kube-api-access-2npdv\") pod \"d2a42987-04b9-42ac-adde-f329a789006f\" (UID: \"d2a42987-04b9-42ac-adde-f329a789006f\") "
Jul 06 14:39:24.271034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.270988    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a42987-04b9-42ac-adde-f329a789006f-kube-api-access-2npdv" (OuterVolumeSpecName: "kube-api-access-2npdv") pod "d2a42987-04b9-42ac-adde-f329a789006f" (UID: "d2a42987-04b9-42ac-adde-f329a789006f"). InnerVolumeSpecName "kube-api-access-2npdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:39:24.271119 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.271001    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76127c3b-e1e5-420e-9426-4d0d329ef8d3-kube-api-access-s72t4" (OuterVolumeSpecName: "kube-api-access-s72t4") pod "76127c3b-e1e5-420e-9426-4d0d329ef8d3" (UID: "76127c3b-e1e5-420e-9426-4d0d329ef8d3"). InnerVolumeSpecName "kube-api-access-s72t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:39:24.369433 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.369398    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2npdv\" (UniqueName: \"kubernetes.io/projected/d2a42987-04b9-42ac-adde-f329a789006f-kube-api-access-2npdv\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:39:24.369433 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.369428    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s72t4\" (UniqueName: \"kubernetes.io/projected/76127c3b-e1e5-420e-9426-4d0d329ef8d3-kube-api-access-s72t4\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:39:24.811790 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.811745    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz" event={"ID":"b44c199f-ae93-463b-9964-ab5943b0d19b","Type":"ContainerStarted","Data":"07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db"}
Jul 06 14:39:24.813007 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.812967    2552 generic.go:356] "Generic (PLEG): container finished" podID="d2a42987-04b9-42ac-adde-f329a789006f" containerID="7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20" exitCode=0
Jul 06 14:39:24.813132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.813015    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5kq4m"
Jul 06 14:39:24.813132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.813031    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5kq4m" event={"ID":"d2a42987-04b9-42ac-adde-f329a789006f","Type":"ContainerDied","Data":"7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20"}
Jul 06 14:39:24.813132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.813070    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5kq4m" event={"ID":"d2a42987-04b9-42ac-adde-f329a789006f","Type":"ContainerDied","Data":"b17ddcfa9859e11907bd0cc476ff7406104f2f08e7805776cc5b44082fd51d9d"}
Jul 06 14:39:24.813132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.813092    2552 scope.go:117] "RemoveContainer" containerID="7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20"
Jul 06 14:39:24.814416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.814365    2552 generic.go:356] "Generic (PLEG): container finished" podID="76127c3b-e1e5-420e-9426-4d0d329ef8d3" containerID="608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27" exitCode=0
Jul 06 14:39:24.814416 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.814413    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595799bf9-fj877"
Jul 06 14:39:24.814529 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.814440    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595799bf9-fj877" event={"ID":"76127c3b-e1e5-420e-9426-4d0d329ef8d3","Type":"ContainerDied","Data":"608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27"}
Jul 06 14:39:24.814529 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.814476    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595799bf9-fj877" event={"ID":"76127c3b-e1e5-420e-9426-4d0d329ef8d3","Type":"ContainerDied","Data":"49d199807b16e75b023045ce362702ce896daebac0a42e76b909012dc76c0781"}
Jul 06 14:39:24.821945 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.821850    2552 scope.go:117] "RemoveContainer" containerID="7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20"
Jul 06 14:39:24.822145 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:39:24.822128    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20\": container with ID starting with 7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20 not found: ID does not exist" containerID="7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20"
Jul 06 14:39:24.822209 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.822152    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20"} err="failed to get container status \"7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20\": rpc error: code = NotFound desc = could not find container \"7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20\": container with ID starting with 7aae26fbed15d95d73caed62dc154044c2ef861443de07425539c563247f9a20 not found: ID does not exist"
Jul 06 14:39:24.822209 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.822168    2552 scope.go:117] "RemoveContainer" containerID="608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27"
Jul 06 14:39:24.830175 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.830155    2552 scope.go:117] "RemoveContainer" containerID="608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27"
Jul 06 14:39:24.830443 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:39:24.830425    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27\": container with ID starting with 608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27 not found: ID does not exist" containerID="608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27"
Jul 06 14:39:24.830492 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.830452    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27"} err="failed to get container status \"608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27\": rpc error: code = NotFound desc = could not find container \"608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27\": container with ID starting with 608489ba59812e9093bd60621aa05b8916a02ced83822303201c24f5fc18ad27 not found: ID does not exist"
Jul 06 14:39:24.834075 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.834037    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz" podStartSLOduration=1.483577798 podStartE2EDuration="1.834024385s" totalImagesPullingTime="350.446587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:39:24.831978706 +0000 UTC m=+626.223882876" watchObservedRunningTime="2026-07-06 14:39:24.834024385 +0000 UTC m=+626.225928556"
Jul 06 14:39:24.855915 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.855879    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5kq4m"]
Jul 06 14:39:24.867830 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.867797    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5kq4m"]
Jul 06 14:39:24.895310 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.895270    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5595799bf9-fj877"]
Jul 06 14:39:24.899242 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:24.899213    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5595799bf9-fj877"]
Jul 06 14:39:25.159155 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:25.159125    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76127c3b-e1e5-420e-9426-4d0d329ef8d3" path="/var/lib/kubelet/pods/76127c3b-e1e5-420e-9426-4d0d329ef8d3/volumes"
Jul 06 14:39:25.159448 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:39:25.159435    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a42987-04b9-42ac-adde-f329a789006f" path="/var/lib/kubelet/pods/d2a42987-04b9-42ac-adde-f329a789006f/volumes"
Jul 06 14:40:02.242818 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.242780    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8755677bc-kb92r"]
Jul 06 14:40:02.243243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.243138    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76127c3b-e1e5-420e-9426-4d0d329ef8d3" containerName="authorino"
Jul 06 14:40:02.243243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.243151    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="76127c3b-e1e5-420e-9426-4d0d329ef8d3" containerName="authorino"
Jul 06 14:40:02.243243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.243158    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a42987-04b9-42ac-adde-f329a789006f" containerName="authorino"
Jul 06 14:40:02.243243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.243163    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a42987-04b9-42ac-adde-f329a789006f" containerName="authorino"
Jul 06 14:40:02.243243 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.243241    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="76127c3b-e1e5-420e-9426-4d0d329ef8d3" containerName="authorino"
Jul 06 14:40:02.243397 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.243248    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a42987-04b9-42ac-adde-f329a789006f" containerName="authorino"
Jul 06 14:40:02.247826 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.247809    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.251003 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.250971    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2zlpp\""
Jul 06 14:40:02.251150 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.251132    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 14:40:02.267419 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.267383    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8755677bc-kb92r"]
Jul 06 14:40:02.393240 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.393199    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/499e2ad9-7b0a-48f0-857c-5b0a6515a640-openshift-service-ca\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.393467 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.393342    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flrq8\" (UniqueName: \"kubernetes.io/projected/499e2ad9-7b0a-48f0-857c-5b0a6515a640-kube-api-access-flrq8\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.393467 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.393402    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/499e2ad9-7b0a-48f0-857c-5b0a6515a640-maas-api-tls\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.494345 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.494253    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flrq8\" (UniqueName: \"kubernetes.io/projected/499e2ad9-7b0a-48f0-857c-5b0a6515a640-kube-api-access-flrq8\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.494345 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.494292    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/499e2ad9-7b0a-48f0-857c-5b0a6515a640-maas-api-tls\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.494345 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.494339    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/499e2ad9-7b0a-48f0-857c-5b0a6515a640-openshift-service-ca\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.494578 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:40:02.494470    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 14:40:02.494578 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:40:02.494549    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/499e2ad9-7b0a-48f0-857c-5b0a6515a640-maas-api-tls podName:499e2ad9-7b0a-48f0-857c-5b0a6515a640 nodeName:}" failed. No retries permitted until 2026-07-06 14:40:02.994515806 +0000 UTC m=+664.386419972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/499e2ad9-7b0a-48f0-857c-5b0a6515a640-maas-api-tls") pod "maas-api-8755677bc-kb92r" (UID: "499e2ad9-7b0a-48f0-857c-5b0a6515a640") : secret "maas-api-serving-cert" not found
Jul 06 14:40:02.495042 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.495014    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/499e2ad9-7b0a-48f0-857c-5b0a6515a640-openshift-service-ca\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.506963 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.506942    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flrq8\" (UniqueName: \"kubernetes.io/projected/499e2ad9-7b0a-48f0-857c-5b0a6515a640-kube-api-access-flrq8\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:02.999580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:02.999542    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/499e2ad9-7b0a-48f0-857c-5b0a6515a640-maas-api-tls\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:03.000394 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.000372    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h8m6j"]
Jul 06 14:40:03.002104 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.002071    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/499e2ad9-7b0a-48f0-857c-5b0a6515a640-maas-api-tls\") pod \"maas-api-8755677bc-kb92r\" (UID: \"499e2ad9-7b0a-48f0-857c-5b0a6515a640\") " pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:03.004096 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.004072    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.006531 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.006507    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 14:40:03.006647 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.006507    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8d6z5\""
Jul 06 14:40:03.014914 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.014883    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h8m6j"]
Jul 06 14:40:03.100506 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.100473    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6q47\" (UniqueName: \"kubernetes.io/projected/8bfa84da-faca-43ca-a13f-088b103a5efe-kube-api-access-h6q47\") pod \"payload-pre-processing-7964457696-h8m6j\" (UID: \"8bfa84da-faca-43ca-a13f-088b103a5efe\") " pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.100684 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.100591    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bfa84da-faca-43ca-a13f-088b103a5efe-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h8m6j\" (UID: \"8bfa84da-faca-43ca-a13f-088b103a5efe\") " pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.157650 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.157619    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:03.201625 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.201588    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bfa84da-faca-43ca-a13f-088b103a5efe-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h8m6j\" (UID: \"8bfa84da-faca-43ca-a13f-088b103a5efe\") " pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.201812 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.201640    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6q47\" (UniqueName: \"kubernetes.io/projected/8bfa84da-faca-43ca-a13f-088b103a5efe-kube-api-access-h6q47\") pod \"payload-pre-processing-7964457696-h8m6j\" (UID: \"8bfa84da-faca-43ca-a13f-088b103a5efe\") " pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.202592 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.202567    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bfa84da-faca-43ca-a13f-088b103a5efe-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h8m6j\" (UID: \"8bfa84da-faca-43ca-a13f-088b103a5efe\") " pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.215618 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.215583    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6q47\" (UniqueName: \"kubernetes.io/projected/8bfa84da-faca-43ca-a13f-088b103a5efe-kube-api-access-h6q47\") pod \"payload-pre-processing-7964457696-h8m6j\" (UID: \"8bfa84da-faca-43ca-a13f-088b103a5efe\") " pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.299356 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.299083    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8755677bc-kb92r"]
Jul 06 14:40:03.303803 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.303765    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:40:03.320595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.320568    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:03.455062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:03.455033    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h8m6j"]
Jul 06 14:40:03.457510 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:40:03.457482    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfa84da_faca_43ca_a13f_088b103a5efe.slice/crio-e50f024dfae7a120b759fc3a42ecb465e9e6cb3d3c9918a5ce2a4eb9e2c3ed03 WatchSource:0}: Error finding container e50f024dfae7a120b759fc3a42ecb465e9e6cb3d3c9918a5ce2a4eb9e2c3ed03: Status 404 returned error can't find the container with id e50f024dfae7a120b759fc3a42ecb465e9e6cb3d3c9918a5ce2a4eb9e2c3ed03
Jul 06 14:40:04.022091 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:04.022051    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j" event={"ID":"8bfa84da-faca-43ca-a13f-088b103a5efe","Type":"ContainerStarted","Data":"e50f024dfae7a120b759fc3a42ecb465e9e6cb3d3c9918a5ce2a4eb9e2c3ed03"}
Jul 06 14:40:04.023163 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:04.023133    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8755677bc-kb92r" event={"ID":"499e2ad9-7b0a-48f0-857c-5b0a6515a640","Type":"ContainerStarted","Data":"e745d10d1bed656c57e58826e6f2bdd2e2009f3a14470af35622aa48dbdc8c11"}
Jul 06 14:40:06.037726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:06.037675    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j" event={"ID":"8bfa84da-faca-43ca-a13f-088b103a5efe","Type":"ContainerStarted","Data":"0cdc432abeb3a782a87060ec5638b6b36222e1fc957dc923dfa6a1dbbb38dad5"}
Jul 06 14:40:06.038199 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:06.037764    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:06.067884 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:06.067811    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j" podStartSLOduration=2.320658509 podStartE2EDuration="4.067788606s" totalImagesPullingTime="1.747130097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:40:06.066483244 +0000 UTC m=+667.458387430" watchObservedRunningTime="2026-07-06 14:40:06.067788606 +0000 UTC m=+667.459692777"
Jul 06 14:40:07.045186 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:07.045146    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8755677bc-kb92r" event={"ID":"499e2ad9-7b0a-48f0-857c-5b0a6515a640","Type":"ContainerStarted","Data":"a9a2108c44c280e777f72338236acf5e6588067473317c770ef5eff5fb745095"}
Jul 06 14:40:07.066791 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:07.066712    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8755677bc-kb92r" podStartSLOduration=2.242458486 podStartE2EDuration="5.066676546s" totalImagesPullingTime="2.82421806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:40:07.065372952 +0000 UTC m=+668.457277125" watchObservedRunningTime="2026-07-06 14:40:07.066676546 +0000 UTC m=+668.458580716"
Jul 06 14:40:08.051590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:08.051509    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:10.530127 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:40:10.530082    2552 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedaf42e8_85d0_4ceb_a293_b5ec27587994.slice/crio-f752a5c27bc7300e68c34350c1dd7f50624aecab782729dfc57601c08017f31f.scope\": RecentStats: unable to find data in memory cache], [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@0-15431-0.service\": RecentStats: unable to find data in memory cache]"
Jul 06 14:40:11.069595 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:11.069560    2552 generic.go:356] "Generic (PLEG): container finished" podID="edaf42e8-85d0-4ceb-a293-b5ec27587994" containerID="f752a5c27bc7300e68c34350c1dd7f50624aecab782729dfc57601c08017f31f" exitCode=0
Jul 06 14:40:11.069774 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:11.069635    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" event={"ID":"edaf42e8-85d0-4ceb-a293-b5ec27587994","Type":"ContainerDied","Data":"f752a5c27bc7300e68c34350c1dd7f50624aecab782729dfc57601c08017f31f"}
Jul 06 14:40:11.070052 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:11.070038    2552 scope.go:117] "RemoveContainer" containerID="f752a5c27bc7300e68c34350c1dd7f50624aecab782729dfc57601c08017f31f"
Jul 06 14:40:11.070954 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:11.070927    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:40:11.071030 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:11.071012    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:40:11.071076 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:11.071057    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:40:12.079692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:12.079649    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" event={"ID":"edaf42e8-85d0-4ceb-a293-b5ec27587994","Type":"ContainerStarted","Data":"a311cfe9e1e28d4d7705de8f28d141d054d5b23274d9c4e72599b8b1d989c776"}
Jul 06 14:40:12.521357 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:12.521310    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:40:12.521605 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:12.521580    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ndwvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 14:40:12.521687 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:12.521641    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" podUID="edaf42e8-85d0-4ceb-a293-b5ec27587994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 14:40:13.521850 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:13.521808    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ndwvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 14:40:13.522292 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:13.521866    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" podUID="edaf42e8-85d0-4ceb-a293-b5ec27587994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 14:40:14.065268 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:14.065228    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8755677bc-kb92r"
Jul 06 14:40:14.527570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:14.522476    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ndwvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 14:40:14.527570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:14.522559    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" podUID="edaf42e8-85d0-4ceb-a293-b5ec27587994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 14:40:15.521517 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:15.521480    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ndwvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 14:40:15.521705 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:15.521532    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw" podUID="edaf42e8-85d0-4ceb-a293-b5ec27587994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 14:40:16.524759 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:16.524726    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:40:16.525146 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:16.525037    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:40:16.525773 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:16.525756    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ndwvw"
Jul 06 14:40:17.047590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:17.047560    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-h8m6j"
Jul 06 14:40:22.410417 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.410346    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"]
Jul 06 14:40:22.416327 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.416307    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.418984 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.418961    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 14:40:22.419626 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.419609    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 14:40:22.420066 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.420049    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 14:40:22.420122 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.420049    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q94n4\""
Jul 06 14:40:22.428167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.428139    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"]
Jul 06 14:40:22.579772 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.579734    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.579947 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.579783    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.579947 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.579812    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.579947 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.579894    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.580077 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.579946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kks9g\" (UniqueName: \"kubernetes.io/projected/01be8453-deef-4c50-942a-bdd62d8e479c-kube-api-access-kks9g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.580116 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.580062    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01be8453-deef-4c50-942a-bdd62d8e479c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.680983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.680882    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.680983 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.680938    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kks9g\" (UniqueName: \"kubernetes.io/projected/01be8453-deef-4c50-942a-bdd62d8e479c-kube-api-access-kks9g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.681260 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.681034    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01be8453-deef-4c50-942a-bdd62d8e479c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.681260 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.681089    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.681260 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.681125    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.681260 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.681156    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.681483 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.681412    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.681544 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.681510    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.681604 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.681584    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.683333 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.683314    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01be8453-deef-4c50-942a-bdd62d8e479c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.683496 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.683481    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01be8453-deef-4c50-942a-bdd62d8e479c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.692584 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.692559    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kks9g\" (UniqueName: \"kubernetes.io/projected/01be8453-deef-4c50-942a-bdd62d8e479c-kube-api-access-kks9g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv\" (UID: \"01be8453-deef-4c50-942a-bdd62d8e479c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.726581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.726544    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:22.908975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:22.908948    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"]
Jul 06 14:40:22.911700 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:40:22.911671    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01be8453_deef_4c50_942a_bdd62d8e479c.slice/crio-eb3bdb8b22d1e945c874a3518d6a4f41cb24fae7d4b8163f3781dd5c375834d4 WatchSource:0}: Error finding container eb3bdb8b22d1e945c874a3518d6a4f41cb24fae7d4b8163f3781dd5c375834d4: Status 404 returned error can't find the container with id eb3bdb8b22d1e945c874a3518d6a4f41cb24fae7d4b8163f3781dd5c375834d4
Jul 06 14:40:23.140584 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:23.140546    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv" event={"ID":"01be8453-deef-4c50-942a-bdd62d8e479c","Type":"ContainerStarted","Data":"eb3bdb8b22d1e945c874a3518d6a4f41cb24fae7d4b8163f3781dd5c375834d4"}
Jul 06 14:40:25.156175 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:25.156140    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv" event={"ID":"01be8453-deef-4c50-942a-bdd62d8e479c","Type":"ContainerStarted","Data":"943cbf92e44009204440013851281cbefa276348cb15792bf555d2b0bd3fc19b"}
Jul 06 14:40:25.175588 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:25.175525    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv" podStartSLOduration=1.964851439 podStartE2EDuration="3.175508345s" totalImagesPullingTime="1.210656906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:40:25.17444381 +0000 UTC m=+686.566347982" watchObservedRunningTime="2026-07-06 14:40:25.175508345 +0000 UTC m=+686.567412515"
Jul 06 14:40:32.726938 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:32.726895    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:32.727382 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:32.727036    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:32.739797 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:32.739765    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:33.206515 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:33.206482    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv"
Jul 06 14:40:50.524907 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.524823    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"]
Jul 06 14:40:50.529698 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.529675    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.531682 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.531661    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 14:40:50.538740 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.538715    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"]
Jul 06 14:40:50.618845 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.618798    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.619039 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.618902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.619039 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.618946    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.619039 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.619009    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn29n\" (UniqueName: \"kubernetes.io/projected/10bd2eae-618e-4d3f-880c-6f73d6319263-kube-api-access-bn29n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.619224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.619094    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.619224 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.619126    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd2eae-618e-4d3f-880c-6f73d6319263-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720103 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720057    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn29n\" (UniqueName: \"kubernetes.io/projected/10bd2eae-618e-4d3f-880c-6f73d6319263-kube-api-access-bn29n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720125    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720151    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd2eae-618e-4d3f-880c-6f73d6319263-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720211    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720265    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720305 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720295    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720709 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720678    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720837 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720714    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.720837 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.720759    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.722474 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.722446    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10bd2eae-618e-4d3f-880c-6f73d6319263-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.722846 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.722823    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10bd2eae-618e-4d3f-880c-6f73d6319263-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.737149 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.737122    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn29n\" (UniqueName: \"kubernetes.io/projected/10bd2eae-618e-4d3f-880c-6f73d6319263-kube-api-access-bn29n\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vzjq\" (UID: \"10bd2eae-618e-4d3f-880c-6f73d6319263\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.840820 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.840727    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:40:50.981094 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:50.981067    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"]
Jul 06 14:40:50.982885 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:40:50.982863    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bd2eae_618e_4d3f_880c_6f73d6319263.slice/crio-6901fe066d9502de30ed94cfe26ba5ef2c7fb61a996939d9e03445653d11c64d WatchSource:0}: Error finding container 6901fe066d9502de30ed94cfe26ba5ef2c7fb61a996939d9e03445653d11c64d: Status 404 returned error can't find the container with id 6901fe066d9502de30ed94cfe26ba5ef2c7fb61a996939d9e03445653d11c64d
Jul 06 14:40:51.291183 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:51.291142    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq" event={"ID":"10bd2eae-618e-4d3f-880c-6f73d6319263","Type":"ContainerStarted","Data":"cdedc8aad913f3b26ea932faf81a7d76faabe3235cccdc01e069fdf743f14bb0"}
Jul 06 14:40:51.291349 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:51.291196    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq" event={"ID":"10bd2eae-618e-4d3f-880c-6f73d6319263","Type":"ContainerStarted","Data":"6901fe066d9502de30ed94cfe26ba5ef2c7fb61a996939d9e03445653d11c64d"}
Jul 06 14:40:51.310982 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:40:51.310927    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq" podStartSLOduration=1.067840166 podStartE2EDuration="1.310909521s" totalImagesPullingTime="243.069355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:40:51.308230467 +0000 UTC m=+712.700134638" watchObservedRunningTime="2026-07-06 14:40:51.310909521 +0000 UTC m=+712.702813691"
Jul 06 14:41:00.841737 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:00.841695    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:41:00.842167 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:00.841765    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:41:00.854253 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:00.854220    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:41:01.361141 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:01.361112    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vzjq"
Jul 06 14:41:21.178104 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.178065    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"]
Jul 06 14:41:21.183500 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.183478    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.186851 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.186832    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 14:41:21.275148 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.275109    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"]
Jul 06 14:41:21.317372 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.317336    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.317579 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.317403    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.317579 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.317437    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.317579 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.317459    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.317579 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.317511    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.317579 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.317542    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zh8m\" (UniqueName: \"kubernetes.io/projected/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-kube-api-access-9zh8m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.418450 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418411    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.418450 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418452    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.418726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418471    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.418726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418591    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.418726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418641    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zh8m\" (UniqueName: \"kubernetes.io/projected/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-kube-api-access-9zh8m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.418879 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418746    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.418879 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418847    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.419029 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.418916    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.419152 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.419132    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.420825 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.420802    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.421041 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.421024    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.429733 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.429668    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zh8m\" (UniqueName: \"kubernetes.io/projected/8ddd8aef-d6c6-4799-abfd-17e4aa14db01-kube-api-access-9zh8m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9\" (UID: \"8ddd8aef-d6c6-4799-abfd-17e4aa14db01\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.492960 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.492919    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:21.632311 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:21.632284    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"]
Jul 06 14:41:21.634530 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:41:21.634504    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ddd8aef_d6c6_4799_abfd_17e4aa14db01.slice/crio-faf314ab0d192b7eae2845e3e13896c8e5f525ada6660d3898b7313162a48f2f WatchSource:0}: Error finding container faf314ab0d192b7eae2845e3e13896c8e5f525ada6660d3898b7313162a48f2f: Status 404 returned error can't find the container with id faf314ab0d192b7eae2845e3e13896c8e5f525ada6660d3898b7313162a48f2f
Jul 06 14:41:22.459165 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:22.459123    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9" event={"ID":"8ddd8aef-d6c6-4799-abfd-17e4aa14db01","Type":"ContainerStarted","Data":"5f80541fcd2015cc80d93b37d5798cec9b97828bb6177348afe138737e41ecd4"}
Jul 06 14:41:22.459574 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:22.459175    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9" event={"ID":"8ddd8aef-d6c6-4799-abfd-17e4aa14db01","Type":"ContainerStarted","Data":"faf314ab0d192b7eae2845e3e13896c8e5f525ada6660d3898b7313162a48f2f"}
Jul 06 14:41:22.481264 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:22.481213    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9" podStartSLOduration=1.102875466 podStartE2EDuration="1.48119588s" totalImagesPullingTime="378.320414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:41:22.478947889 +0000 UTC m=+743.870852071" watchObservedRunningTime="2026-07-06 14:41:22.48119588 +0000 UTC m=+743.873100051"
Jul 06 14:41:31.493346 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:31.493292    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:31.493346 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:31.493357    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:31.505906 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:31.505868    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:41:31.520202 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:41:31.520171    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9"
Jul 06 14:42:00.871020 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:00.870940    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74b8d44ff5-qdnpz"]
Jul 06 14:42:00.871656 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:00.871160    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz" podUID="b44c199f-ae93-463b-9964-ab5943b0d19b" containerName="authorino" containerID="cri-o://07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db" gracePeriod=30
Jul 06 14:42:01.120370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.120343    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:42:01.288424 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.288348    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzwkf\" (UniqueName: \"kubernetes.io/projected/b44c199f-ae93-463b-9964-ab5943b0d19b-kube-api-access-dzwkf\") pod \"b44c199f-ae93-463b-9964-ab5943b0d19b\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") "
Jul 06 14:42:01.288424 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.288386    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b44c199f-ae93-463b-9964-ab5943b0d19b-tls-cert\") pod \"b44c199f-ae93-463b-9964-ab5943b0d19b\" (UID: \"b44c199f-ae93-463b-9964-ab5943b0d19b\") "
Jul 06 14:42:01.290558 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.290529    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b44c199f-ae93-463b-9964-ab5943b0d19b-kube-api-access-dzwkf" (OuterVolumeSpecName: "kube-api-access-dzwkf") pod "b44c199f-ae93-463b-9964-ab5943b0d19b" (UID: "b44c199f-ae93-463b-9964-ab5943b0d19b"). InnerVolumeSpecName "kube-api-access-dzwkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:42:01.298962 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.298937    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b44c199f-ae93-463b-9964-ab5943b0d19b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b44c199f-ae93-463b-9964-ab5943b0d19b" (UID: "b44c199f-ae93-463b-9964-ab5943b0d19b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:42:01.390045 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.390010    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzwkf\" (UniqueName: \"kubernetes.io/projected/b44c199f-ae93-463b-9964-ab5943b0d19b-kube-api-access-dzwkf\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:42:01.390220 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.390051    2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b44c199f-ae93-463b-9964-ab5943b0d19b-tls-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:42:01.667751 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.667718    2552 generic.go:356] "Generic (PLEG): container finished" podID="b44c199f-ae93-463b-9964-ab5943b0d19b" containerID="07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db" exitCode=0
Jul 06 14:42:01.667936 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.667767    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz"
Jul 06 14:42:01.667936 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.667804    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz" event={"ID":"b44c199f-ae93-463b-9964-ab5943b0d19b","Type":"ContainerDied","Data":"07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db"}
Jul 06 14:42:01.667936 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.667846    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74b8d44ff5-qdnpz" event={"ID":"b44c199f-ae93-463b-9964-ab5943b0d19b","Type":"ContainerDied","Data":"cd96684fbb09caa6fc96ba0209c034d99e9e117709204b7263e8c1421e27ddc8"}
Jul 06 14:42:01.667936 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.667864    2552 scope.go:117] "RemoveContainer" containerID="07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db"
Jul 06 14:42:01.677026 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.677008    2552 scope.go:117] "RemoveContainer" containerID="07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db"
Jul 06 14:42:01.677301 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:42:01.677279    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db\": container with ID starting with 07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db not found: ID does not exist" containerID="07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db"
Jul 06 14:42:01.677409 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.677314    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db"} err="failed to get container status \"07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db\": rpc error: code = NotFound desc = could not find container \"07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db\": container with ID starting with 07d0a4ae7d4aa6284060da44b1a654f8a2926c9d2d1927847b4fe43dcd0870db not found: ID does not exist"
Jul 06 14:42:01.703615 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.703589    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74b8d44ff5-qdnpz"]
Jul 06 14:42:01.707578 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:01.707555    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74b8d44ff5-qdnpz"]
Jul 06 14:42:03.157981 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:42:03.157945    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b44c199f-ae93-463b-9964-ab5943b0d19b" path="/var/lib/kubelet/pods/b44c199f-ae93-463b-9964-ab5943b0d19b/volumes"
Jul 06 14:48:16.250160 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:16.250123    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"]
Jul 06 14:48:16.250683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:16.250334    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t" podUID="899adfa8-0cf5-4884-b7c8-a479d565a761" containerName="manager" containerID="cri-o://606309d0590a5f1fbab40535d8fd299310215ef02d8adca2c2d337b882ed2bfa" gracePeriod=10
Jul 06 14:48:19.667153 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.667124    2552 generic.go:356] "Generic (PLEG): container finished" podID="899adfa8-0cf5-4884-b7c8-a479d565a761" containerID="606309d0590a5f1fbab40535d8fd299310215ef02d8adca2c2d337b882ed2bfa" exitCode=0
Jul 06 14:48:19.667452 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.667196    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t" event={"ID":"899adfa8-0cf5-4884-b7c8-a479d565a761","Type":"ContainerDied","Data":"606309d0590a5f1fbab40535d8fd299310215ef02d8adca2c2d337b882ed2bfa"}
Jul 06 14:48:19.810682 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.810651    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:48:19.881256 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.881214    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/899adfa8-0cf5-4884-b7c8-a479d565a761-extensions-socket-volume\") pod \"899adfa8-0cf5-4884-b7c8-a479d565a761\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") "
Jul 06 14:48:19.881459 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.881282    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45vm6\" (UniqueName: \"kubernetes.io/projected/899adfa8-0cf5-4884-b7c8-a479d565a761-kube-api-access-45vm6\") pod \"899adfa8-0cf5-4884-b7c8-a479d565a761\" (UID: \"899adfa8-0cf5-4884-b7c8-a479d565a761\") "
Jul 06 14:48:19.881669 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.881643    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899adfa8-0cf5-4884-b7c8-a479d565a761-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "899adfa8-0cf5-4884-b7c8-a479d565a761" (UID: "899adfa8-0cf5-4884-b7c8-a479d565a761"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:48:19.883316 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.883287    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899adfa8-0cf5-4884-b7c8-a479d565a761-kube-api-access-45vm6" (OuterVolumeSpecName: "kube-api-access-45vm6") pod "899adfa8-0cf5-4884-b7c8-a479d565a761" (UID: "899adfa8-0cf5-4884-b7c8-a479d565a761"). InnerVolumeSpecName "kube-api-access-45vm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:48:19.982760 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.982661    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45vm6\" (UniqueName: \"kubernetes.io/projected/899adfa8-0cf5-4884-b7c8-a479d565a761-kube-api-access-45vm6\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:48:19.982760 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:19.982697    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/899adfa8-0cf5-4884-b7c8-a479d565a761-extensions-socket-volume\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:48:20.673920 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:20.673842    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"
Jul 06 14:48:20.674409 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:20.673829    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t" event={"ID":"899adfa8-0cf5-4884-b7c8-a479d565a761","Type":"ContainerDied","Data":"8e7242b81c1dff003c9d22d2908b87691726fc6f1fbd746898dcf8b623f578e7"}
Jul 06 14:48:20.674409 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:20.673986    2552 scope.go:117] "RemoveContainer" containerID="606309d0590a5f1fbab40535d8fd299310215ef02d8adca2c2d337b882ed2bfa"
Jul 06 14:48:21.317302 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:21.317266    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"]
Jul 06 14:48:21.324623 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:21.324588    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7mx5t"]
Jul 06 14:48:23.156562 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:48:23.156528    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899adfa8-0cf5-4884-b7c8-a479d565a761" path="/var/lib/kubelet/pods/899adfa8-0cf5-4884-b7c8-a479d565a761/volumes"
Jul 06 14:49:17.439145 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.439105    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"]
Jul 06 14:49:17.439570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.439499    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b44c199f-ae93-463b-9964-ab5943b0d19b" containerName="authorino"
Jul 06 14:49:17.439570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.439513    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44c199f-ae93-463b-9964-ab5943b0d19b" containerName="authorino"
Jul 06 14:49:17.439570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.439524    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899adfa8-0cf5-4884-b7c8-a479d565a761" containerName="manager"
Jul 06 14:49:17.439570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.439529    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="899adfa8-0cf5-4884-b7c8-a479d565a761" containerName="manager"
Jul 06 14:49:17.439707 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.439594    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="899adfa8-0cf5-4884-b7c8-a479d565a761" containerName="manager"
Jul 06 14:49:17.439707 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.439604    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b44c199f-ae93-463b-9964-ab5943b0d19b" containerName="authorino"
Jul 06 14:49:17.443670 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.443651    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.445970 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.445948    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7qwlm\""
Jul 06 14:49:17.454222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.454198    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"]
Jul 06 14:49:17.486404 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.486349    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ccd65d-6a72-4de1-a82c-847e5fada9e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pz4dx\" (UID: \"25ccd65d-6a72-4de1-a82c-847e5fada9e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.486404 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.486409    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkslt\" (UniqueName: \"kubernetes.io/projected/25ccd65d-6a72-4de1-a82c-847e5fada9e6-kube-api-access-qkslt\") pod \"kuadrant-operator-controller-manager-86878c769f-pz4dx\" (UID: \"25ccd65d-6a72-4de1-a82c-847e5fada9e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.586940 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.586881    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ccd65d-6a72-4de1-a82c-847e5fada9e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pz4dx\" (UID: \"25ccd65d-6a72-4de1-a82c-847e5fada9e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.586940 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.586938    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkslt\" (UniqueName: \"kubernetes.io/projected/25ccd65d-6a72-4de1-a82c-847e5fada9e6-kube-api-access-qkslt\") pod \"kuadrant-operator-controller-manager-86878c769f-pz4dx\" (UID: \"25ccd65d-6a72-4de1-a82c-847e5fada9e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.587298 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.587279    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ccd65d-6a72-4de1-a82c-847e5fada9e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pz4dx\" (UID: \"25ccd65d-6a72-4de1-a82c-847e5fada9e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.603483 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.603448    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkslt\" (UniqueName: \"kubernetes.io/projected/25ccd65d-6a72-4de1-a82c-847e5fada9e6-kube-api-access-qkslt\") pod \"kuadrant-operator-controller-manager-86878c769f-pz4dx\" (UID: \"25ccd65d-6a72-4de1-a82c-847e5fada9e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.755019 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.754890    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:17.895437 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.895411    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"]
Jul 06 14:49:17.897865 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:49:17.897824    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ccd65d_6a72_4de1_a82c_847e5fada9e6.slice/crio-505fa4d1c94af7c4151501e8e37cbe4b8211bc0932948cf0984fe602c088d65f WatchSource:0}: Error finding container 505fa4d1c94af7c4151501e8e37cbe4b8211bc0932948cf0984fe602c088d65f: Status 404 returned error can't find the container with id 505fa4d1c94af7c4151501e8e37cbe4b8211bc0932948cf0984fe602c088d65f
Jul 06 14:49:17.984506 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.984474    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx" event={"ID":"25ccd65d-6a72-4de1-a82c-847e5fada9e6","Type":"ContainerStarted","Data":"9b68064adc8de2ae3e65767f982bdc3d96b610b7fa3470cc6364a2e02da0f5f7"}
Jul 06 14:49:17.984678 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.984520    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx" event={"ID":"25ccd65d-6a72-4de1-a82c-847e5fada9e6","Type":"ContainerStarted","Data":"505fa4d1c94af7c4151501e8e37cbe4b8211bc0932948cf0984fe602c088d65f"}
Jul 06 14:49:17.984678 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:17.984567    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:49:18.010756 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:18.010669    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx" podStartSLOduration=1.010652445 podStartE2EDuration="1.010652445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:49:18.00935567 +0000 UTC m=+1219.401259841" watchObservedRunningTime="2026-07-06 14:49:18.010652445 +0000 UTC m=+1219.402556691"
Jul 06 14:49:28.992920 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:49:28.992883    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pz4dx"
Jul 06 14:55:30.275572 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.275535    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"]
Jul 06 14:55:30.283541 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.283378    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.286663 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.286638    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6e78599e-openshift-default-dockercfg-jbh8k\""
Jul 06 14:55:30.304123 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.304093    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"]
Jul 06 14:55:30.402657 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402621    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd69362-0a57-4d5f-89de-93fac5cd9365-istiod-ca-cert\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.402657 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402661    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-envoy\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.402912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402682    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-podinfo\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.402912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402774    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh7x6\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-kube-api-access-bh7x6\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.402912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402827    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-certs\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.402912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402851    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-credential-socket\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.402912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402879    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-socket\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.402912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.402905    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-data\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.403201 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.403013    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-token\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.503901 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.503859    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-envoy\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.503901 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.503905    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-podinfo\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.503934    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh7x6\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-kube-api-access-bh7x6\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.503967    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-certs\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.503985    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-credential-socket\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504222 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504042    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-socket\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504223    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-data\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504280    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-token\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504359    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd69362-0a57-4d5f-89de-93fac5cd9365-istiod-ca-cert\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504414    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-socket\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504491    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-credential-socket\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504594    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-data\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.504817 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504663    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-certs\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.505322 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.504944    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd69362-0a57-4d5f-89de-93fac5cd9365-istiod-ca-cert\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.506338 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.506319    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-envoy\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.506425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.506385    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-podinfo\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.513046 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.513025    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-token\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.513125 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.513041    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh7x6\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-kube-api-access-bh7x6\") pod \"e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") " pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.597496 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.597405    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:30.744782 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.744749    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"]
Jul 06 14:55:30.747955 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:55:30.747931    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd69362_0a57_4d5f_89de_93fac5cd9365.slice/crio-82d0c1ee27ad7ce70f53a7547f1a75ae927efe068d42da4ef7c04a4bd61f5948 WatchSource:0}: Error finding container 82d0c1ee27ad7ce70f53a7547f1a75ae927efe068d42da4ef7c04a4bd61f5948: Status 404 returned error can't find the container with id 82d0c1ee27ad7ce70f53a7547f1a75ae927efe068d42da4ef7c04a4bd61f5948
Jul 06 14:55:30.750030 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.749976    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:30.750135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.750077    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:30.750135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.750123    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:30.941225 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.941186    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd" event={"ID":"5fd69362-0a57-4d5f-89de-93fac5cd9365","Type":"ContainerStarted","Data":"3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6"}
Jul 06 14:55:30.941425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.941248    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd" event={"ID":"5fd69362-0a57-4d5f-89de-93fac5cd9365","Type":"ContainerStarted","Data":"82d0c1ee27ad7ce70f53a7547f1a75ae927efe068d42da4ef7c04a4bd61f5948"}
Jul 06 14:55:30.968379 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:30.968324    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd" podStartSLOduration=0.96830753 podStartE2EDuration="968.30753ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:30.96537665 +0000 UTC m=+1592.357280823" watchObservedRunningTime="2026-07-06 14:55:30.96830753 +0000 UTC m=+1592.360211773"
Jul 06 14:55:31.594656 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.594622    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"]
Jul 06 14:55:31.598278 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.598254    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:31.598420 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.598336    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.601374 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.601348    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-6e78599e-serving-cert\""
Jul 06 14:55:31.602504 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.602486    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:31.608651 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.608623    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"]
Jul 06 14:55:31.716472 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.716438    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.716655 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.716501    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqk9q\" (UniqueName: \"kubernetes.io/projected/34a85fac-23a9-45cf-a9fd-d282aa6baa27-kube-api-access-hqk9q\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.716655 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.716608    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a85fac-23a9-45cf-a9fd-d282aa6baa27-openshift-service-ca\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.817466 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.817427    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.817664 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.817512    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqk9q\" (UniqueName: \"kubernetes.io/projected/34a85fac-23a9-45cf-a9fd-d282aa6baa27-kube-api-access-hqk9q\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.817664 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:55:31.817573    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-6e78599e-serving-cert: secret "maas-api-e2e-ait-6e78599e-serving-cert" not found
Jul 06 14:55:31.817664 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.817588    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a85fac-23a9-45cf-a9fd-d282aa6baa27-openshift-service-ca\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.817664 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:55:31.817636    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls podName:34a85fac-23a9-45cf-a9fd-d282aa6baa27 nodeName:}" failed. No retries permitted until 2026-07-06 14:55:32.317618586 +0000 UTC m=+1593.709522740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls") pod "maas-api-e2e-ait-6e78599e-b7786645b-j9hhx" (UID: "34a85fac-23a9-45cf-a9fd-d282aa6baa27") : secret "maas-api-e2e-ait-6e78599e-serving-cert" not found
Jul 06 14:55:31.818281 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.818263    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a85fac-23a9-45cf-a9fd-d282aa6baa27-openshift-service-ca\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.828771 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.828748    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqk9q\" (UniqueName: \"kubernetes.io/projected/34a85fac-23a9-45cf-a9fd-d282aa6baa27-kube-api-access-hqk9q\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:31.947347 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.947318    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:31.948255 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:31.948236    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:32.322414 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:32.322325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:32.324898 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:32.324870    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls\") pod \"maas-api-e2e-ait-6e78599e-b7786645b-j9hhx\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") " pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:32.509290 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:32.509252    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:32.654581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:32.654549    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"]
Jul 06 14:55:32.656622 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:55:32.656580    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a85fac_23a9_45cf_a9fd_d282aa6baa27.slice/crio-a627e7ea5ed81bda70b28e44ce83845c56cdcbd70afc60c72c2908c92594ca78 WatchSource:0}: Error finding container a627e7ea5ed81bda70b28e44ce83845c56cdcbd70afc60c72c2908c92594ca78: Status 404 returned error can't find the container with id a627e7ea5ed81bda70b28e44ce83845c56cdcbd70afc60c72c2908c92594ca78
Jul 06 14:55:32.658576 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:32.658552    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:55:32.953847 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:32.953812    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx" event={"ID":"34a85fac-23a9-45cf-a9fd-d282aa6baa27","Type":"ContainerStarted","Data":"a627e7ea5ed81bda70b28e44ce83845c56cdcbd70afc60c72c2908c92594ca78"}
Jul 06 14:55:33.963034 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:33.962974    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx" event={"ID":"34a85fac-23a9-45cf-a9fd-d282aa6baa27","Type":"ContainerStarted","Data":"8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991"}
Jul 06 14:55:33.963523 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:33.963223    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:33.984181 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:33.984132    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx" podStartSLOduration=2.425824482 podStartE2EDuration="2.984113339s" totalImagesPullingTime="558.288857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:33.982260153 +0000 UTC m=+1595.374164323" watchObservedRunningTime="2026-07-06 14:55:33.984113339 +0000 UTC m=+1595.376017544"
Jul 06 14:55:36.992063 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:36.992025    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"]
Jul 06 14:55:36.992584 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:36.992212    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd" podUID="5fd69362-0a57-4d5f-89de-93fac5cd9365" containerName="istio-proxy" containerID="cri-o://3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6" gracePeriod=30
Jul 06 14:55:37.279625 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.279521    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"]
Jul 06 14:55:37.280189 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.280155    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx" podUID="34a85fac-23a9-45cf-a9fd-d282aa6baa27" containerName="maas-api" containerID="cri-o://8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991" gracePeriod=30
Jul 06 14:55:37.549131 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.549105    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:37.682135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.680937    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls\") pod \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") "
Jul 06 14:55:37.682135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.681016    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqk9q\" (UniqueName: \"kubernetes.io/projected/34a85fac-23a9-45cf-a9fd-d282aa6baa27-kube-api-access-hqk9q\") pod \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") "
Jul 06 14:55:37.682135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.681061    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a85fac-23a9-45cf-a9fd-d282aa6baa27-openshift-service-ca\") pod \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\" (UID: \"34a85fac-23a9-45cf-a9fd-d282aa6baa27\") "
Jul 06 14:55:37.682135 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.681794    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34a85fac-23a9-45cf-a9fd-d282aa6baa27-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34a85fac-23a9-45cf-a9fd-d282aa6baa27" (UID: "34a85fac-23a9-45cf-a9fd-d282aa6baa27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:55:37.684248 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.684218    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34a85fac-23a9-45cf-a9fd-d282aa6baa27" (UID: "34a85fac-23a9-45cf-a9fd-d282aa6baa27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:55:37.684409 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.684380    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a85fac-23a9-45cf-a9fd-d282aa6baa27-kube-api-access-hqk9q" (OuterVolumeSpecName: "kube-api-access-hqk9q") pod "34a85fac-23a9-45cf-a9fd-d282aa6baa27" (UID: "34a85fac-23a9-45cf-a9fd-d282aa6baa27"). InnerVolumeSpecName "kube-api-access-hqk9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:55:37.783011 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.782940    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34a85fac-23a9-45cf-a9fd-d282aa6baa27-maas-api-tls\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:37.783011 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.782982    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqk9q\" (UniqueName: \"kubernetes.io/projected/34a85fac-23a9-45cf-a9fd-d282aa6baa27-kube-api-access-hqk9q\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:37.783011 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.783013    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34a85fac-23a9-45cf-a9fd-d282aa6baa27-openshift-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:37.992213 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.992174    2552 generic.go:356] "Generic (PLEG): container finished" podID="34a85fac-23a9-45cf-a9fd-d282aa6baa27" containerID="8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991" exitCode=0
Jul 06 14:55:37.992590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.992227    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"
Jul 06 14:55:37.992590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.992325    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx" event={"ID":"34a85fac-23a9-45cf-a9fd-d282aa6baa27","Type":"ContainerDied","Data":"8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991"}
Jul 06 14:55:37.992590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.992367    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx" event={"ID":"34a85fac-23a9-45cf-a9fd-d282aa6baa27","Type":"ContainerDied","Data":"a627e7ea5ed81bda70b28e44ce83845c56cdcbd70afc60c72c2908c92594ca78"}
Jul 06 14:55:37.992590 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:37.992391    2552 scope.go:117] "RemoveContainer" containerID="8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991"
Jul 06 14:55:38.002309 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:38.002290    2552 scope.go:117] "RemoveContainer" containerID="8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991"
Jul 06 14:55:38.002568 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:55:38.002548    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991\": container with ID starting with 8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991 not found: ID does not exist" containerID="8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991"
Jul 06 14:55:38.002649 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:38.002604    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991"} err="failed to get container status \"8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991\": rpc error: code = NotFound desc = could not find container \"8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991\": container with ID starting with 8ce38b8f668d841694448e5a2cf62d509e605e39f07e3b3ea1c3b539395e9991 not found: ID does not exist"
Jul 06 14:55:38.020026 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:38.019978    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"]
Jul 06 14:55:38.025099 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:38.025077    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-6e78599e-b7786645b-j9hhx"]
Jul 06 14:55:39.177716 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:39.177675    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34a85fac-23a9-45cf-a9fd-d282aa6baa27" path="/var/lib/kubelet/pods/34a85fac-23a9-45cf-a9fd-d282aa6baa27/volumes"
Jul 06 14:55:42.441081 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.441051    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:42.528348 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528233    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd69362-0a57-4d5f-89de-93fac5cd9365-istiod-ca-cert\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528348 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528286    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-credential-socket\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528360    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-podinfo\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528399    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-socket\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528420    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-token\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528444    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-envoy\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528485    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-certs\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528515    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh7x6\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-kube-api-access-bh7x6\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528538    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-data\") pod \"5fd69362-0a57-4d5f-89de-93fac5cd9365\" (UID: \"5fd69362-0a57-4d5f-89de-93fac5cd9365\") "
Jul 06 14:55:42.528933 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528651    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:42.528933 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528704    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd69362-0a57-4d5f-89de-93fac5cd9365-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:55:42.528933 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.528826    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:42.529137 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.529050    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.529137 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.529071    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd69362-0a57-4d5f-89de-93fac5cd9365-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.529137 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.529085    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.529137 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.529090    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:42.529449 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.529427    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:42.530706 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.530682    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:55:42.530798 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.530707    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-kube-api-access-bh7x6" (OuterVolumeSpecName: "kube-api-access-bh7x6") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "kube-api-access-bh7x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:55:42.531137 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.531113    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:42.531218 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.531116    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fd69362-0a57-4d5f-89de-93fac5cd9365" (UID: "5fd69362-0a57-4d5f-89de-93fac5cd9365"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:55:42.629892 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.629851    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.629892 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.629883    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.629892 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.629891    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.629892 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.629900    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.630199 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.629910    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh7x6\" (UniqueName: \"kubernetes.io/projected/5fd69362-0a57-4d5f-89de-93fac5cd9365-kube-api-access-bh7x6\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:42.630199 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:42.629919    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd69362-0a57-4d5f-89de-93fac5cd9365-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:43.020482 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.020449    2552 generic.go:356] "Generic (PLEG): container finished" podID="5fd69362-0a57-4d5f-89de-93fac5cd9365" containerID="3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6" exitCode=0
Jul 06 14:55:43.020658 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.020497    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"
Jul 06 14:55:43.020658 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.020536    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd" event={"ID":"5fd69362-0a57-4d5f-89de-93fac5cd9365","Type":"ContainerDied","Data":"3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6"}
Jul 06 14:55:43.020658 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.020596    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd" event={"ID":"5fd69362-0a57-4d5f-89de-93fac5cd9365","Type":"ContainerDied","Data":"82d0c1ee27ad7ce70f53a7547f1a75ae927efe068d42da4ef7c04a4bd61f5948"}
Jul 06 14:55:43.020658 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.020624    2552 scope.go:117] "RemoveContainer" containerID="3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6"
Jul 06 14:55:43.030019 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.029981    2552 scope.go:117] "RemoveContainer" containerID="3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6"
Jul 06 14:55:43.030274 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:55:43.030256    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6\": container with ID starting with 3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6 not found: ID does not exist" containerID="3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6"
Jul 06 14:55:43.030321 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.030283    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6"} err="failed to get container status \"3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6\": rpc error: code = NotFound desc = could not find container \"3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6\": container with ID starting with 3a91c0e274e032d97920ae2b4b230e38c16d8b0adf4b25f5348f9f3576cce0a6 not found: ID does not exist"
Jul 06 14:55:43.042885 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.042857    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"]
Jul 06 14:55:43.049564 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.049541    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6e78599e-openshift-default-5b9fdcc675-dgbmd"]
Jul 06 14:55:43.156846 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.156813    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd69362-0a57-4d5f-89de-93fac5cd9365" path="/var/lib/kubelet/pods/5fd69362-0a57-4d5f-89de-93fac5cd9365/volumes"
Jul 06 14:55:43.989839 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.989803    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"]
Jul 06 14:55:43.990335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.990176    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34a85fac-23a9-45cf-a9fd-d282aa6baa27" containerName="maas-api"
Jul 06 14:55:43.990335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.990188    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="34a85fac-23a9-45cf-a9fd-d282aa6baa27" containerName="maas-api"
Jul 06 14:55:43.990335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.990204    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd69362-0a57-4d5f-89de-93fac5cd9365" containerName="istio-proxy"
Jul 06 14:55:43.990335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.990210    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd69362-0a57-4d5f-89de-93fac5cd9365" containerName="istio-proxy"
Jul 06 14:55:43.990335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.990281    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd69362-0a57-4d5f-89de-93fac5cd9365" containerName="istio-proxy"
Jul 06 14:55:43.990335 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.990288    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="34a85fac-23a9-45cf-a9fd-d282aa6baa27" containerName="maas-api"
Jul 06 14:55:43.994795 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.994773    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:43.996929 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:43.996903    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1b3df01f-openshift-default-dockercfg-p9gtf\""
Jul 06 14:55:44.009808 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.009775    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"]
Jul 06 14:55:44.142480 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142437    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-socket\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142480 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142474    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-token\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142507    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-credential-socket\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142564    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-data\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142638    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb43567f-342d-413e-bbc5-1de09f104ff7-istiod-ca-cert\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142693    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-certs\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142755 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142730    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzd56\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-kube-api-access-pzd56\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142976 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142758    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-podinfo\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.142976 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.142813    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-envoy\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243467    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb43567f-342d-413e-bbc5-1de09f104ff7-istiod-ca-cert\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243513    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-certs\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243533    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzd56\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-kube-api-access-pzd56\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243560 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243558    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-podinfo\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243598    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-envoy\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243665    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-socket\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243686    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-token\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243744    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-credential-socket\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.243928 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243767    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-data\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.244237 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.243975    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-certs\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.244237 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.244189    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-data\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.244237 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.244229    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-socket\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.244392 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.244238    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-credential-socket\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.244505 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.244479    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb43567f-342d-413e-bbc5-1de09f104ff7-istiod-ca-cert\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.246004 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.245964    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-envoy\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.246226 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.246204    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-podinfo\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.257375 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.257349    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-token\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.257634 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.257611    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzd56\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-kube-api-access-pzd56\") pod \"e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") " pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.311232 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.311192    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:44.458147 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.458113    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"]
Jul 06 14:55:44.459396 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:55:44.459365    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb43567f_342d_413e_bbc5_1de09f104ff7.slice/crio-65035a8239f59224496b5d7414a01b7257f1c0f469d6fc73690198920827bbb7 WatchSource:0}: Error finding container 65035a8239f59224496b5d7414a01b7257f1c0f469d6fc73690198920827bbb7: Status 404 returned error can't find the container with id 65035a8239f59224496b5d7414a01b7257f1c0f469d6fc73690198920827bbb7
Jul 06 14:55:44.461736 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.461693    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:44.461816 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.461784    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:44.461865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:44.461829    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:45.032945 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.032907    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" event={"ID":"cb43567f-342d-413e-bbc5-1de09f104ff7","Type":"ContainerStarted","Data":"939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67"}
Jul 06 14:55:45.033464 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.033017    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" event={"ID":"cb43567f-342d-413e-bbc5-1de09f104ff7","Type":"ContainerStarted","Data":"65035a8239f59224496b5d7414a01b7257f1c0f469d6fc73690198920827bbb7"}
Jul 06 14:55:45.055735 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.055673    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" podStartSLOduration=2.055645881 podStartE2EDuration="2.055645881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:45.055358084 +0000 UTC m=+1606.447262275" watchObservedRunningTime="2026-07-06 14:55:45.055645881 +0000 UTC m=+1606.447550052"
Jul 06 14:55:45.304480 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.304390    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"]
Jul 06 14:55:45.308065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.308037    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.310122 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.310093    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-1b3df01f-serving-cert\""
Jul 06 14:55:45.311860 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.311831    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:45.316830 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.316807    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:45.327147 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.327116    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"]
Jul 06 14:55:45.454665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.454621    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.454841 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.454759    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040190a0-e323-45c9-8a40-0ffbe337938b-openshift-service-ca\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.454841 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.454816    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mrpt\" (UniqueName: \"kubernetes.io/projected/040190a0-e323-45c9-8a40-0ffbe337938b-kube-api-access-4mrpt\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.555639 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.555537    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040190a0-e323-45c9-8a40-0ffbe337938b-openshift-service-ca\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.555639 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.555624    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mrpt\" (UniqueName: \"kubernetes.io/projected/040190a0-e323-45c9-8a40-0ffbe337938b-kube-api-access-4mrpt\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.555873 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.555704    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.555939 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:55:45.555862    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-1b3df01f-serving-cert: secret "maas-api-e2e-ait-1b3df01f-serving-cert" not found
Jul 06 14:55:45.556018 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:55:45.555940    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls podName:040190a0-e323-45c9-8a40-0ffbe337938b nodeName:}" failed. No retries permitted until 2026-07-06 14:55:46.055916995 +0000 UTC m=+1607.447821161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls") pod "maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q" (UID: "040190a0-e323-45c9-8a40-0ffbe337938b") : secret "maas-api-e2e-ait-1b3df01f-serving-cert" not found
Jul 06 14:55:45.556357 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.556333    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040190a0-e323-45c9-8a40-0ffbe337938b-openshift-service-ca\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:45.573665 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:45.573633    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mrpt\" (UniqueName: \"kubernetes.io/projected/040190a0-e323-45c9-8a40-0ffbe337938b-kube-api-access-4mrpt\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:46.039165 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:46.039118    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:46.040153 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:46.040128    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:55:46.061054 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:46.061013    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:46.063683 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:46.063658    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls\") pod \"maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") " pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:46.223598 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:46.223565    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:46.360655 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:46.360630    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"]
Jul 06 14:55:46.363355 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:55:46.363323    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040190a0_e323_45c9_8a40_0ffbe337938b.slice/crio-f38ad2156e97ccd60112d22aedc186d990dced41856d20ea5e3b71dd281d3bcf WatchSource:0}: Error finding container f38ad2156e97ccd60112d22aedc186d990dced41856d20ea5e3b71dd281d3bcf: Status 404 returned error can't find the container with id f38ad2156e97ccd60112d22aedc186d990dced41856d20ea5e3b71dd281d3bcf
Jul 06 14:55:47.045952 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:47.045857    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q" event={"ID":"040190a0-e323-45c9-8a40-0ffbe337938b","Type":"ContainerStarted","Data":"e5b31a762da070322f08b4558d762bb8e8b71e32ee0f3dc5b1a972475e72696d"}
Jul 06 14:55:47.045952 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:47.045912    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q" event={"ID":"040190a0-e323-45c9-8a40-0ffbe337938b","Type":"ContainerStarted","Data":"f38ad2156e97ccd60112d22aedc186d990dced41856d20ea5e3b71dd281d3bcf"}
Jul 06 14:55:47.075548 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:47.075491    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q" podStartSLOduration=1.761917271 podStartE2EDuration="2.075475714s" totalImagesPullingTime="313.558443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:47.074143432 +0000 UTC m=+1608.466047603" watchObservedRunningTime="2026-07-06 14:55:47.075475714 +0000 UTC m=+1608.467379884"
Jul 06 14:55:48.051868 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:48.051837    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:50.873252 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:50.873040    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"]
Jul 06 14:55:50.874121 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:50.874087    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q" podUID="040190a0-e323-45c9-8a40-0ffbe337938b" containerName="maas-api" containerID="cri-o://e5b31a762da070322f08b4558d762bb8e8b71e32ee0f3dc5b1a972475e72696d" gracePeriod=30
Jul 06 14:55:51.099260 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.099191    2552 generic.go:356] "Generic (PLEG): container finished" podID="040190a0-e323-45c9-8a40-0ffbe337938b" containerID="e5b31a762da070322f08b4558d762bb8e8b71e32ee0f3dc5b1a972475e72696d" exitCode=0
Jul 06 14:55:51.099260 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.099240    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q" event={"ID":"040190a0-e323-45c9-8a40-0ffbe337938b","Type":"ContainerDied","Data":"e5b31a762da070322f08b4558d762bb8e8b71e32ee0f3dc5b1a972475e72696d"}
Jul 06 14:55:51.150472 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.150444    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:51.315627 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.315586    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040190a0-e323-45c9-8a40-0ffbe337938b-openshift-service-ca\") pod \"040190a0-e323-45c9-8a40-0ffbe337938b\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") "
Jul 06 14:55:51.315627 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.315630    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mrpt\" (UniqueName: \"kubernetes.io/projected/040190a0-e323-45c9-8a40-0ffbe337938b-kube-api-access-4mrpt\") pod \"040190a0-e323-45c9-8a40-0ffbe337938b\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") "
Jul 06 14:55:51.315833 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.315673    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls\") pod \"040190a0-e323-45c9-8a40-0ffbe337938b\" (UID: \"040190a0-e323-45c9-8a40-0ffbe337938b\") "
Jul 06 14:55:51.315947 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.315922    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/040190a0-e323-45c9-8a40-0ffbe337938b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "040190a0-e323-45c9-8a40-0ffbe337938b" (UID: "040190a0-e323-45c9-8a40-0ffbe337938b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:55:51.317753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.317730    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "040190a0-e323-45c9-8a40-0ffbe337938b" (UID: "040190a0-e323-45c9-8a40-0ffbe337938b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:55:51.317818 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.317793    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040190a0-e323-45c9-8a40-0ffbe337938b-kube-api-access-4mrpt" (OuterVolumeSpecName: "kube-api-access-4mrpt") pod "040190a0-e323-45c9-8a40-0ffbe337938b" (UID: "040190a0-e323-45c9-8a40-0ffbe337938b"). InnerVolumeSpecName "kube-api-access-4mrpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:55:51.417032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.416921    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/040190a0-e323-45c9-8a40-0ffbe337938b-maas-api-tls\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:51.417032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.416954    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/040190a0-e323-45c9-8a40-0ffbe337938b-openshift-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:51.417032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:51.416965    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mrpt\" (UniqueName: \"kubernetes.io/projected/040190a0-e323-45c9-8a40-0ffbe337938b-kube-api-access-4mrpt\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:55:52.106742 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:52.106709    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q" event={"ID":"040190a0-e323-45c9-8a40-0ffbe337938b","Type":"ContainerDied","Data":"f38ad2156e97ccd60112d22aedc186d990dced41856d20ea5e3b71dd281d3bcf"}
Jul 06 14:55:52.107169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:52.106766    2552 scope.go:117] "RemoveContainer" containerID="e5b31a762da070322f08b4558d762bb8e8b71e32ee0f3dc5b1a972475e72696d"
Jul 06 14:55:52.107169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:52.106725    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"
Jul 06 14:55:52.132824 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:52.132784    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"]
Jul 06 14:55:52.139340 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:52.139316    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-1b3df01f-7dccfdf6fc-l4m7q"]
Jul 06 14:55:53.157794 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:53.157755    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="040190a0-e323-45c9-8a40-0ffbe337938b" path="/var/lib/kubelet/pods/040190a0-e323-45c9-8a40-0ffbe337938b/volumes"
Jul 06 14:55:56.131212 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:56.131176    2552 generic.go:356] "Generic (PLEG): container finished" podID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerID="939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67" exitCode=0
Jul 06 14:55:56.131659 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:56.131249    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" event={"ID":"cb43567f-342d-413e-bbc5-1de09f104ff7","Type":"ContainerDied","Data":"939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67"}
Jul 06 14:55:56.131659 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:56.131623    2552 scope.go:117] "RemoveContainer" containerID="939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67"
Jul 06 14:55:56.132633 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:56.132602    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:56.132732 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:56.132695    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:56.132801 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:56.132754    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:55:56.833546 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:56.833510    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"]
Jul 06 14:55:57.142550 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:57.142517    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" event={"ID":"cb43567f-342d-413e-bbc5-1de09f104ff7","Type":"ContainerStarted","Data":"1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182"}
Jul 06 14:55:57.143010 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:55:57.142583    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerName="istio-proxy" containerID="cri-o://1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182" gracePeriod=30
Jul 06 14:56:01.039709 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:01.039676    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:56:02.391760 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.391733    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:56:02.422776 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422693    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-socket\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.422776 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422750    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-envoy\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.422975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422777    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-token\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.422975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422811    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-credential-socket\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.422975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422841    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-certs\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.422975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422881    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzd56\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-kube-api-access-pzd56\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.422975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422921    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-data\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.422975 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422955    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-podinfo\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.423313 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.422969    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:02.423313 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423027    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb43567f-342d-413e-bbc5-1de09f104ff7-istiod-ca-cert\") pod \"cb43567f-342d-413e-bbc5-1de09f104ff7\" (UID: \"cb43567f-342d-413e-bbc5-1de09f104ff7\") "
Jul 06 14:56:02.423313 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423154    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:02.423313 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423166    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:02.423525 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423372    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.423525 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423389    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.423525 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423402    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.423525 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423506    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb43567f-342d-413e-bbc5-1de09f104ff7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:56:02.424007 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.423963    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:02.425183 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.425151    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-kube-api-access-pzd56" (OuterVolumeSpecName: "kube-api-access-pzd56") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "kube-api-access-pzd56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:02.425280 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.425184    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:02.425403 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.425380    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:02.425567 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.425550    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb43567f-342d-413e-bbc5-1de09f104ff7" (UID: "cb43567f-342d-413e-bbc5-1de09f104ff7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:56:02.523810 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.523771    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzd56\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-kube-api-access-pzd56\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.523810 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.523803    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.523810 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.523815    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.524081 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.523824    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb43567f-342d-413e-bbc5-1de09f104ff7-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.524081 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.523832    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:02.524081 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:02.523840    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb43567f-342d-413e-bbc5-1de09f104ff7-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:03.177546 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.177513    2552 generic.go:356] "Generic (PLEG): container finished" podID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerID="1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182" exitCode=0
Jul 06 14:56:03.177692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.177566    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"
Jul 06 14:56:03.177692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.177597    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" event={"ID":"cb43567f-342d-413e-bbc5-1de09f104ff7","Type":"ContainerDied","Data":"1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182"}
Jul 06 14:56:03.177692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.177649    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x" event={"ID":"cb43567f-342d-413e-bbc5-1de09f104ff7","Type":"ContainerDied","Data":"65035a8239f59224496b5d7414a01b7257f1c0f469d6fc73690198920827bbb7"}
Jul 06 14:56:03.177692 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.177670    2552 scope.go:117] "RemoveContainer" containerID="1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182"
Jul 06 14:56:03.186909 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.186888    2552 scope.go:117] "RemoveContainer" containerID="939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67"
Jul 06 14:56:03.196399 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.196378    2552 scope.go:117] "RemoveContainer" containerID="1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182"
Jul 06 14:56:03.196782 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:56:03.196757    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182\": container with ID starting with 1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182 not found: ID does not exist" containerID="1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182"
Jul 06 14:56:03.196857 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.196794    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182"} err="failed to get container status \"1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182\": rpc error: code = NotFound desc = could not find container \"1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182\": container with ID starting with 1a4c3fd0ce82364fb222468ab6245e5f3db8be8746678148b7eaf6b9ee64d182 not found: ID does not exist"
Jul 06 14:56:03.196857 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.196818    2552 scope.go:117] "RemoveContainer" containerID="939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67"
Jul 06 14:56:03.197146 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:56:03.197127    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67\": container with ID starting with 939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67 not found: ID does not exist" containerID="939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67"
Jul 06 14:56:03.197235 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.197156    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67"} err="failed to get container status \"939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67\": rpc error: code = NotFound desc = could not find container \"939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67\": container with ID starting with 939d1f6c93ad4e7c589064272cb98501a3b5681b9c6aa4013075e45a45cf8c67 not found: ID does not exist"
Jul 06 14:56:03.197337 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.197309    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"]
Jul 06 14:56:03.204361 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.204338    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1b3df01f-openshift-default-55c68c5ddf-p4c7x"]
Jul 06 14:56:03.499593 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.499491    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"]
Jul 06 14:56:03.500140 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500118    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerName="istio-proxy"
Jul 06 14:56:03.500197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500144    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerName="istio-proxy"
Jul 06 14:56:03.500197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500160    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerName="istio-proxy"
Jul 06 14:56:03.500197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500169    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerName="istio-proxy"
Jul 06 14:56:03.500197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500182    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="040190a0-e323-45c9-8a40-0ffbe337938b" containerName="maas-api"
Jul 06 14:56:03.500197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500193    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="040190a0-e323-45c9-8a40-0ffbe337938b" containerName="maas-api"
Jul 06 14:56:03.500364 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500284    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="040190a0-e323-45c9-8a40-0ffbe337938b" containerName="maas-api"
Jul 06 14:56:03.500364 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500296    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerName="istio-proxy"
Jul 06 14:56:03.500364 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.500305    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" containerName="istio-proxy"
Jul 06 14:56:03.505764 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.505739    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.513459 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.513439    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0be4a5a5-openshift-default-dockercfg-rnrff\""
Jul 06 14:56:03.521888 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.521863    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"]
Jul 06 14:56:03.533160 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533131    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-envoy\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533267 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533178    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-socket\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533267 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533234    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-certs\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533267 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533258    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750021cb-4580-4ab1-ad2b-ba0654c366a7-istiod-ca-cert\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533300    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-token\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533329    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-credential-socket\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533425 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533401    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-podinfo\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533520 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533445    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-data\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.533520 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.533466    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8q9f\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-kube-api-access-b8q9f\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634346 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634305    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-socket\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634346 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634353    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-certs\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634613 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634377    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750021cb-4580-4ab1-ad2b-ba0654c366a7-istiod-ca-cert\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634613 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634419    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-token\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634613 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634439    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-credential-socket\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634613 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634462    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-podinfo\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634613 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634492    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-data\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634881 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634630    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8q9f\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-kube-api-access-b8q9f\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634881 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634681    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-envoy\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634881 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634817    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-socket\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.634881 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634849    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-credential-socket\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.635104 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.634884    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-certs\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.635274 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.635248    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-data\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.635347 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.635305    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750021cb-4580-4ab1-ad2b-ba0654c366a7-istiod-ca-cert\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.636749 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.636726    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-envoy\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.636961 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.636943    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-podinfo\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.645514 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.645483    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-token\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.645948 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.645926    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8q9f\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-kube-api-access-b8q9f\") pod \"e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") " pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.816636 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.816541    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:03.962580 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.962553    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"]
Jul 06 14:56:03.964766 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:56:03.964740    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750021cb_4580_4ab1_ad2b_ba0654c366a7.slice/crio-e6c06f33ac8848d3bc575b7acb54315a6aee3c76540998ea58c9d3e1ddcd88df WatchSource:0}: Error finding container e6c06f33ac8848d3bc575b7acb54315a6aee3c76540998ea58c9d3e1ddcd88df: Status 404 returned error can't find the container with id e6c06f33ac8848d3bc575b7acb54315a6aee3c76540998ea58c9d3e1ddcd88df
Jul 06 14:56:03.967106 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.967070    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:56:03.967206 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.967137    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:56:03.967206 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:03.967170    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:56:04.193291 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.193251    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr" event={"ID":"750021cb-4580-4ab1-ad2b-ba0654c366a7","Type":"ContainerStarted","Data":"7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14"}
Jul 06 14:56:04.193469 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.193356    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr" event={"ID":"750021cb-4580-4ab1-ad2b-ba0654c366a7","Type":"ContainerStarted","Data":"e6c06f33ac8848d3bc575b7acb54315a6aee3c76540998ea58c9d3e1ddcd88df"}
Jul 06 14:56:04.217486 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.217434    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr" podStartSLOduration=1.217418294 podStartE2EDuration="1.217418294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:56:04.215159305 +0000 UTC m=+1625.607063488" watchObservedRunningTime="2026-07-06 14:56:04.217418294 +0000 UTC m=+1625.609322464"
Jul 06 14:56:04.817537 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.817496    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:04.822651 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.822620    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"]
Jul 06 14:56:04.826852 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.826824    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.829087 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.829053    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-0be4a5a5-serving-cert\""
Jul 06 14:56:04.834147 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.834122    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"]
Jul 06 14:56:04.846875 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.846849    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceba03d-e5b6-44cf-a3b3-572120464b91-openshift-service-ca\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.847054 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.846882    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vdm\" (UniqueName: \"kubernetes.io/projected/aceba03d-e5b6-44cf-a3b3-572120464b91-kube-api-access-k4vdm\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.847054 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.846909    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.948352 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.948315    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceba03d-e5b6-44cf-a3b3-572120464b91-openshift-service-ca\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.948352 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.948353    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vdm\" (UniqueName: \"kubernetes.io/projected/aceba03d-e5b6-44cf-a3b3-572120464b91-kube-api-access-k4vdm\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.948570 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.948376    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.948570 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:56:04.948519    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-0be4a5a5-serving-cert: secret "maas-api-e2e-derive-0be4a5a5-serving-cert" not found
Jul 06 14:56:04.948649 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:56:04.948580    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls podName:aceba03d-e5b6-44cf-a3b3-572120464b91 nodeName:}" failed. No retries permitted until 2026-07-06 14:56:05.448562012 +0000 UTC m=+1626.840466165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls") pod "maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv" (UID: "aceba03d-e5b6-44cf-a3b3-572120464b91") : secret "maas-api-e2e-derive-0be4a5a5-serving-cert" not found
Jul 06 14:56:04.948982 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.948961    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceba03d-e5b6-44cf-a3b3-572120464b91-openshift-service-ca\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:04.957678 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:04.957650    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vdm\" (UniqueName: \"kubernetes.io/projected/aceba03d-e5b6-44cf-a3b3-572120464b91-kube-api-access-k4vdm\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:05.159147 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:05.159101    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb43567f-342d-413e-bbc5-1de09f104ff7" path="/var/lib/kubelet/pods/cb43567f-342d-413e-bbc5-1de09f104ff7/volumes"
Jul 06 14:56:05.454355 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:05.454258    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:05.456885 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:05.456857    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls\") pod \"maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") " pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:05.739807 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:05.739715    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:05.822831 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:05.822794    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:05.887219 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:05.887194    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"]
Jul 06 14:56:05.888812 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:56:05.888784    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceba03d_e5b6_44cf_a3b3_572120464b91.slice/crio-0d06f2550a62391cc2d75a58ab7bf1e44e4c1ec4d89822ddb12721a888a50001 WatchSource:0}: Error finding container 0d06f2550a62391cc2d75a58ab7bf1e44e4c1ec4d89822ddb12721a888a50001: Status 404 returned error can't find the container with id 0d06f2550a62391cc2d75a58ab7bf1e44e4c1ec4d89822ddb12721a888a50001
Jul 06 14:56:06.203971 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:06.203934    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv" event={"ID":"aceba03d-e5b6-44cf-a3b3-572120464b91","Type":"ContainerStarted","Data":"0d06f2550a62391cc2d75a58ab7bf1e44e4c1ec4d89822ddb12721a888a50001"}
Jul 06 14:56:06.204246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:06.204228    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:06.205245 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:06.205227    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:07.210701 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:07.210660    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv" event={"ID":"aceba03d-e5b6-44cf-a3b3-572120464b91","Type":"ContainerStarted","Data":"b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66"}
Jul 06 14:56:07.211171 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:07.210728    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:07.321214 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:07.321162    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv" podStartSLOduration=2.9442849190000002 podStartE2EDuration="3.321140607s" totalImagesPullingTime="376.855688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:56:07.238959974 +0000 UTC m=+1628.630864146" watchObservedRunningTime="2026-07-06 14:56:07.321140607 +0000 UTC m=+1628.713044782"
Jul 06 14:56:09.481014 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:09.480941    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"]
Jul 06 14:56:09.482310 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:09.482274    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr" podUID="750021cb-4580-4ab1-ad2b-ba0654c366a7" containerName="istio-proxy" containerID="cri-o://7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14" gracePeriod=30
Jul 06 14:56:09.723598 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:09.723562    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"]
Jul 06 14:56:09.723787 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:09.723762    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv" podUID="aceba03d-e5b6-44cf-a3b3-572120464b91" containerName="maas-api" containerID="cri-o://b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66" gracePeriod=30
Jul 06 14:56:10.012445 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.012416    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:10.100175 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.100137    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceba03d-e5b6-44cf-a3b3-572120464b91-openshift-service-ca\") pod \"aceba03d-e5b6-44cf-a3b3-572120464b91\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") "
Jul 06 14:56:10.100362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.100194    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4vdm\" (UniqueName: \"kubernetes.io/projected/aceba03d-e5b6-44cf-a3b3-572120464b91-kube-api-access-k4vdm\") pod \"aceba03d-e5b6-44cf-a3b3-572120464b91\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") "
Jul 06 14:56:10.100362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.100259    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls\") pod \"aceba03d-e5b6-44cf-a3b3-572120464b91\" (UID: \"aceba03d-e5b6-44cf-a3b3-572120464b91\") "
Jul 06 14:56:10.100510 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.100467    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aceba03d-e5b6-44cf-a3b3-572120464b91-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aceba03d-e5b6-44cf-a3b3-572120464b91" (UID: "aceba03d-e5b6-44cf-a3b3-572120464b91"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:56:10.102484 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.102459    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aceba03d-e5b6-44cf-a3b3-572120464b91" (UID: "aceba03d-e5b6-44cf-a3b3-572120464b91"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:56:10.102587 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.102544    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aceba03d-e5b6-44cf-a3b3-572120464b91-kube-api-access-k4vdm" (OuterVolumeSpecName: "kube-api-access-k4vdm") pod "aceba03d-e5b6-44cf-a3b3-572120464b91" (UID: "aceba03d-e5b6-44cf-a3b3-572120464b91"). InnerVolumeSpecName "kube-api-access-k4vdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:10.201484 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.201239    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aceba03d-e5b6-44cf-a3b3-572120464b91-openshift-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:10.201484 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.201279    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4vdm\" (UniqueName: \"kubernetes.io/projected/aceba03d-e5b6-44cf-a3b3-572120464b91-kube-api-access-k4vdm\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:10.201484 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.201295    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aceba03d-e5b6-44cf-a3b3-572120464b91-maas-api-tls\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:10.227853 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.227819    2552 generic.go:356] "Generic (PLEG): container finished" podID="aceba03d-e5b6-44cf-a3b3-572120464b91" containerID="b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66" exitCode=0
Jul 06 14:56:10.228046 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.227861    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"
Jul 06 14:56:10.228046 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.227902    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv" event={"ID":"aceba03d-e5b6-44cf-a3b3-572120464b91","Type":"ContainerDied","Data":"b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66"}
Jul 06 14:56:10.228046 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.227956    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv" event={"ID":"aceba03d-e5b6-44cf-a3b3-572120464b91","Type":"ContainerDied","Data":"0d06f2550a62391cc2d75a58ab7bf1e44e4c1ec4d89822ddb12721a888a50001"}
Jul 06 14:56:10.228046 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.227979    2552 scope.go:117] "RemoveContainer" containerID="b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66"
Jul 06 14:56:10.238029 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.237979    2552 scope.go:117] "RemoveContainer" containerID="b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66"
Jul 06 14:56:10.238339 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:56:10.238317    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66\": container with ID starting with b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66 not found: ID does not exist" containerID="b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66"
Jul 06 14:56:10.238440 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.238348    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66"} err="failed to get container status \"b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66\": rpc error: code = NotFound desc = could not find container \"b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66\": container with ID starting with b8d7fd20840cfe00d36a7598cf42293da8296e37f6394416fb23322a78de4b66 not found: ID does not exist"
Jul 06 14:56:10.252276 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.252206    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"]
Jul 06 14:56:10.271018 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:10.263191    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-0be4a5a5-6d6c975784-nsqpv"]
Jul 06 14:56:11.169021 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:11.165923    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aceba03d-e5b6-44cf-a3b3-572120464b91" path="/var/lib/kubelet/pods/aceba03d-e5b6-44cf-a3b3-572120464b91/volumes"
Jul 06 14:56:15.037206 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.037146    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:15.148679 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148579    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-socket\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148679 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148623    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8q9f\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-kube-api-access-b8q9f\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148681    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-envoy\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148708    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750021cb-4580-4ab1-ad2b-ba0654c366a7-istiod-ca-cert\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148749    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-credential-socket\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148773    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-token\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148794    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-data\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148827    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-certs\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148860    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-podinfo\") pod \"750021cb-4580-4ab1-ad2b-ba0654c366a7\" (UID: \"750021cb-4580-4ab1-ad2b-ba0654c366a7\") "
Jul 06 14:56:15.148912 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.148874    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:15.149362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.149129    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:15.149362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.149145    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:15.149362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.149211    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/750021cb-4580-4ab1-ad2b-ba0654c366a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:56:15.149362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.149246    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.149362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.149271    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.149362 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.149285    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.150019 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.149975    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:15.150979 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.150956    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:15.151103 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.151061    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-kube-api-access-b8q9f" (OuterVolumeSpecName: "kube-api-access-b8q9f") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "kube-api-access-b8q9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:15.151307 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.151286    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:15.151374 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.151312    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "750021cb-4580-4ab1-ad2b-ba0654c366a7" (UID: "750021cb-4580-4ab1-ad2b-ba0654c366a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:56:15.250320 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.250291    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.250320 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.250317    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/750021cb-4580-4ab1-ad2b-ba0654c366a7-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.250320 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.250326    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.250547 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.250334    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.250547 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.250341    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/750021cb-4580-4ab1-ad2b-ba0654c366a7-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.250547 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.250349    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8q9f\" (UniqueName: \"kubernetes.io/projected/750021cb-4580-4ab1-ad2b-ba0654c366a7-kube-api-access-b8q9f\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:56:15.264323 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.264293    2552 generic.go:356] "Generic (PLEG): container finished" podID="750021cb-4580-4ab1-ad2b-ba0654c366a7" containerID="7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14" exitCode=0
Jul 06 14:56:15.264465 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.264342    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"
Jul 06 14:56:15.264465 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.264380    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr" event={"ID":"750021cb-4580-4ab1-ad2b-ba0654c366a7","Type":"ContainerDied","Data":"7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14"}
Jul 06 14:56:15.264465 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.264444    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr" event={"ID":"750021cb-4580-4ab1-ad2b-ba0654c366a7","Type":"ContainerDied","Data":"e6c06f33ac8848d3bc575b7acb54315a6aee3c76540998ea58c9d3e1ddcd88df"}
Jul 06 14:56:15.264601 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.264475    2552 scope.go:117] "RemoveContainer" containerID="7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14"
Jul 06 14:56:15.273552 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.273532    2552 scope.go:117] "RemoveContainer" containerID="7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14"
Jul 06 14:56:15.273822 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:56:15.273805    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14\": container with ID starting with 7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14 not found: ID does not exist" containerID="7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14"
Jul 06 14:56:15.273894 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.273829    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14"} err="failed to get container status \"7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14\": rpc error: code = NotFound desc = could not find container \"7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14\": container with ID starting with 7833bf140239700ebe8e7d9db943208ee571bfe098979066f0d0a8542225ef14 not found: ID does not exist"
Jul 06 14:56:15.284020 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.283978    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"]
Jul 06 14:56:15.288881 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:15.288858    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0be4a5a5-openshift-default-85657594d7-89hlr"]
Jul 06 14:56:17.157101 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:56:17.157070    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="750021cb-4580-4ab1-ad2b-ba0654c366a7" path="/var/lib/kubelet/pods/750021cb-4580-4ab1-ad2b-ba0654c366a7/volumes"
Jul 06 14:58:02.279741 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.279703    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"]
Jul 06 14:58:02.280204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.280091    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750021cb-4580-4ab1-ad2b-ba0654c366a7" containerName="istio-proxy"
Jul 06 14:58:02.280204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.280103    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="750021cb-4580-4ab1-ad2b-ba0654c366a7" containerName="istio-proxy"
Jul 06 14:58:02.280204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.280116    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aceba03d-e5b6-44cf-a3b3-572120464b91" containerName="maas-api"
Jul 06 14:58:02.280204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.280121    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aceba03d-e5b6-44cf-a3b3-572120464b91" containerName="maas-api"
Jul 06 14:58:02.280204 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.280206    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="750021cb-4580-4ab1-ad2b-ba0654c366a7" containerName="istio-proxy"
Jul 06 14:58:02.280368 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.280213    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="aceba03d-e5b6-44cf-a3b3-572120464b91" containerName="maas-api"
Jul 06 14:58:02.283227 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.283210    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.285951 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.285929    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dc636816-openshift-default-dockercfg-q5h9g\""
Jul 06 14:58:02.307750 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.307725    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"]
Jul 06 14:58:02.418419 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418384    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-socket\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418594 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418437    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936f74e-a23c-4505-add6-1a2c693ff222-istio-podinfo\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418594 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418460    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936f74e-a23c-4505-add6-1a2c693ff222-istiod-ca-cert\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418594 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418498    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-credential-socket\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418594 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418534    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-envoy\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418594 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418555    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfkmc\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-kube-api-access-hfkmc\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418767 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418632    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-data\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418767 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418659    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-istio-token\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.418767 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.418695    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-certs\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.519916 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.519879    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-certs\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520149 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.519939    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-socket\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520149 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.519977    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936f74e-a23c-4505-add6-1a2c693ff222-istio-podinfo\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520149 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520026    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936f74e-a23c-4505-add6-1a2c693ff222-istiod-ca-cert\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520149 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520051    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-credential-socket\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520382 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520174    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-envoy\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520382 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520205    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfkmc\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-kube-api-access-hfkmc\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520382 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520295    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-data\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520382 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520339    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-istio-token\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520385    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-certs\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520581 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520426    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-credential-socket\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520700 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520626    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-data\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520696    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-socket\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.520812 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.520757    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936f74e-a23c-4505-add6-1a2c693ff222-istiod-ca-cert\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.522467 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.522436    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936f74e-a23c-4505-add6-1a2c693ff222-istio-podinfo\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.522467 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.522458    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-envoy\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.529453 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.529430    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-istio-token\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.529953 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.529879    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfkmc\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-kube-api-access-hfkmc\") pod \"e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") " pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.593847 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.593804    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:02.739191 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.739162    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"]
Jul 06 14:58:02.741191 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:58:02.741158    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode936f74e_a23c_4505_add6_1a2c693ff222.slice/crio-de26621071322f801af27094a7eff3c27c827a055769888f2e6c8a7f756e0857 WatchSource:0}: Error finding container de26621071322f801af27094a7eff3c27c827a055769888f2e6c8a7f756e0857: Status 404 returned error can't find the container with id de26621071322f801af27094a7eff3c27c827a055769888f2e6c8a7f756e0857
Jul 06 14:58:02.743488 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.743454    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:02.743559 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.743522    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:02.743599 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.743561    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:02.828569 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.828533    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" event={"ID":"e936f74e-a23c-4505-add6-1a2c693ff222","Type":"ContainerStarted","Data":"d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790"}
Jul 06 14:58:02.828759 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.828595    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" event={"ID":"e936f74e-a23c-4505-add6-1a2c693ff222","Type":"ContainerStarted","Data":"de26621071322f801af27094a7eff3c27c827a055769888f2e6c8a7f756e0857"}
Jul 06 14:58:02.850901 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:02.850842    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" podStartSLOduration=0.850822752 podStartE2EDuration="850.822752ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:02.850221843 +0000 UTC m=+1744.242126007" watchObservedRunningTime="2026-07-06 14:58:02.850822752 +0000 UTC m=+1744.242726925"
Jul 06 14:58:03.594933 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:03.594895    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:03.600010 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:03.599969    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:03.834062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:03.834026    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:03.834935 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:03.834910    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:05.379535 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.379501    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"]
Jul 06 14:58:05.383064 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.383046    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.387023 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.386986    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-dc636816-serving-cert\""
Jul 06 14:58:05.398655 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.398632    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"]
Jul 06 14:58:05.451246 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.451206    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869fea89-3f8e-4345-a912-f2f88a432501-maas-api-tls\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.451409 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.451258    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m55p\" (UniqueName: \"kubernetes.io/projected/869fea89-3f8e-4345-a912-f2f88a432501-kube-api-access-8m55p\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.451409 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.451327    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869fea89-3f8e-4345-a912-f2f88a432501-openshift-service-ca\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.552467 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.552432    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869fea89-3f8e-4345-a912-f2f88a432501-maas-api-tls\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.552467 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.552480    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m55p\" (UniqueName: \"kubernetes.io/projected/869fea89-3f8e-4345-a912-f2f88a432501-kube-api-access-8m55p\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.552710 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.552514    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869fea89-3f8e-4345-a912-f2f88a432501-openshift-service-ca\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.553248 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.553228    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869fea89-3f8e-4345-a912-f2f88a432501-openshift-service-ca\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.555018 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.554980    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869fea89-3f8e-4345-a912-f2f88a432501-maas-api-tls\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.563694 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.563669    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m55p\" (UniqueName: \"kubernetes.io/projected/869fea89-3f8e-4345-a912-f2f88a432501-kube-api-access-8m55p\") pod \"maas-api-e2e-mt-dc636816-85579d64c4-sgtqk\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") " pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.694024 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.693901    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:05.837708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:05.837683    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"]
Jul 06 14:58:05.839576 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:58:05.839539    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869fea89_3f8e_4345_a912_f2f88a432501.slice/crio-0e277776247e3ed6f6ff512248997240007412c4a92bb419c6720269eae14c1b WatchSource:0}: Error finding container 0e277776247e3ed6f6ff512248997240007412c4a92bb419c6720269eae14c1b: Status 404 returned error can't find the container with id 0e277776247e3ed6f6ff512248997240007412c4a92bb419c6720269eae14c1b
Jul 06 14:58:06.851867 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:06.851830    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk" event={"ID":"869fea89-3f8e-4345-a912-f2f88a432501","Type":"ContainerStarted","Data":"5a2aabb3b9ea712ec25ef3613ea4508f2922f4c21f7281e48ef9aa2d625e0905"}
Jul 06 14:58:06.852295 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:06.851888    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk" event={"ID":"869fea89-3f8e-4345-a912-f2f88a432501","Type":"ContainerStarted","Data":"0e277776247e3ed6f6ff512248997240007412c4a92bb419c6720269eae14c1b"}
Jul 06 14:58:06.852295 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:06.851957    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:06.877140 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:06.877092    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk" podStartSLOduration=1.440506487 podStartE2EDuration="1.877075876s" totalImagesPullingTime="436.569389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:06.875360246 +0000 UTC m=+1748.267264420" watchObservedRunningTime="2026-07-06 14:58:06.877075876 +0000 UTC m=+1748.268980047"
Jul 06 14:58:12.870351 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:12.870319    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:17.920661 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:17.920625    2552 generic.go:356] "Generic (PLEG): container finished" podID="e936f74e-a23c-4505-add6-1a2c693ff222" containerID="d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790" exitCode=0
Jul 06 14:58:17.921112 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:17.920699    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" event={"ID":"e936f74e-a23c-4505-add6-1a2c693ff222","Type":"ContainerDied","Data":"d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790"}
Jul 06 14:58:17.921170 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:17.921117    2552 scope.go:117] "RemoveContainer" containerID="d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790"
Jul 06 14:58:17.922242 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:17.922213    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:17.922317 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:17.922299    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:17.922357 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:17.922341    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:18.722505 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:18.722471    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"]
Jul 06 14:58:18.722675 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:18.722651    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk" podUID="869fea89-3f8e-4345-a912-f2f88a432501" containerName="maas-api" containerID="cri-o://5a2aabb3b9ea712ec25ef3613ea4508f2922f4c21f7281e48ef9aa2d625e0905" gracePeriod=30
Jul 06 14:58:18.834640 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:18.834611    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:18.930708 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:18.930654    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" event={"ID":"e936f74e-a23c-4505-add6-1a2c693ff222","Type":"ContainerStarted","Data":"611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a"}
Jul 06 14:58:18.932691 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:18.932662    2552 generic.go:356] "Generic (PLEG): container finished" podID="869fea89-3f8e-4345-a912-f2f88a432501" containerID="5a2aabb3b9ea712ec25ef3613ea4508f2922f4c21f7281e48ef9aa2d625e0905" exitCode=0
Jul 06 14:58:18.932818 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:18.932734    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk" event={"ID":"869fea89-3f8e-4345-a912-f2f88a432501","Type":"ContainerDied","Data":"5a2aabb3b9ea712ec25ef3613ea4508f2922f4c21f7281e48ef9aa2d625e0905"}
Jul 06 14:58:19.003121 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.003093    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:19.085658 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.085619    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869fea89-3f8e-4345-a912-f2f88a432501-openshift-service-ca\") pod \"869fea89-3f8e-4345-a912-f2f88a432501\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") "
Jul 06 14:58:19.085861 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.085706    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869fea89-3f8e-4345-a912-f2f88a432501-maas-api-tls\") pod \"869fea89-3f8e-4345-a912-f2f88a432501\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") "
Jul 06 14:58:19.085861 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.085727    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m55p\" (UniqueName: \"kubernetes.io/projected/869fea89-3f8e-4345-a912-f2f88a432501-kube-api-access-8m55p\") pod \"869fea89-3f8e-4345-a912-f2f88a432501\" (UID: \"869fea89-3f8e-4345-a912-f2f88a432501\") "
Jul 06 14:58:19.086065 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.086032    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869fea89-3f8e-4345-a912-f2f88a432501-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "869fea89-3f8e-4345-a912-f2f88a432501" (UID: "869fea89-3f8e-4345-a912-f2f88a432501"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:58:19.087948 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.087922    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/869fea89-3f8e-4345-a912-f2f88a432501-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "869fea89-3f8e-4345-a912-f2f88a432501" (UID: "869fea89-3f8e-4345-a912-f2f88a432501"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:58:19.088062 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.087956    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869fea89-3f8e-4345-a912-f2f88a432501-kube-api-access-8m55p" (OuterVolumeSpecName: "kube-api-access-8m55p") pod "869fea89-3f8e-4345-a912-f2f88a432501" (UID: "869fea89-3f8e-4345-a912-f2f88a432501"). InnerVolumeSpecName "kube-api-access-8m55p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:58:19.186375 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.186340    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/869fea89-3f8e-4345-a912-f2f88a432501-maas-api-tls\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:19.186375 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.186373    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m55p\" (UniqueName: \"kubernetes.io/projected/869fea89-3f8e-4345-a912-f2f88a432501-kube-api-access-8m55p\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:19.186375 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.186383    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/869fea89-3f8e-4345-a912-f2f88a432501-openshift-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:19.594293 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.594247    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:19.595376 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.595354    2552 patch_prober.go:28] interesting pod/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 14:58:19.595454 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.595404    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 14:58:19.938794 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.938762    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"
Jul 06 14:58:19.939226 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.938790    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk" event={"ID":"869fea89-3f8e-4345-a912-f2f88a432501","Type":"ContainerDied","Data":"0e277776247e3ed6f6ff512248997240007412c4a92bb419c6720269eae14c1b"}
Jul 06 14:58:19.939226 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.938851    2552 scope.go:117] "RemoveContainer" containerID="5a2aabb3b9ea712ec25ef3613ea4508f2922f4c21f7281e48ef9aa2d625e0905"
Jul 06 14:58:19.960765 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.960726    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"]
Jul 06 14:58:19.968132 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:19.968097    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-dc636816-85579d64c4-sgtqk"]
Jul 06 14:58:20.594603 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:20.594567    2552 patch_prober.go:28] interesting pod/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 14:58:20.594788 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:20.594626    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 14:58:21.158177 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:21.158135    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="869fea89-3f8e-4345-a912-f2f88a432501" path="/var/lib/kubelet/pods/869fea89-3f8e-4345-a912-f2f88a432501/volumes"
Jul 06 14:58:21.594985 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:21.594884    2552 patch_prober.go:28] interesting pod/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 14:58:21.594985 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:21.594947    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 14:58:22.594521 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:22.594485    2552 patch_prober.go:28] interesting pod/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 06 14:58:22.594910 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:22.594544    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 06 14:58:23.598275 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:23.598247    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:23.598723 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:23.598685    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:23.599414 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:23.599392    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:25.531563 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:25.531530    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"]
Jul 06 14:58:25.972186 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:25.972148    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy" containerID="cri-o://611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a" gracePeriod=30
Jul 06 14:58:31.225833 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.225805    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:31.288726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288627    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936f74e-a23c-4505-add6-1a2c693ff222-istio-podinfo\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.288726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288675    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfkmc\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-kube-api-access-hfkmc\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.288726 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288713    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-credential-socket\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.289032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288750    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936f74e-a23c-4505-add6-1a2c693ff222-istiod-ca-cert\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.289032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288779    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-envoy\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.289032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288802    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-socket\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.289032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288867    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-certs\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.289032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.288959    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-data\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.289032 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.289019    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-istio-token\") pod \"e936f74e-a23c-4505-add6-1a2c693ff222\" (UID: \"e936f74e-a23c-4505-add6-1a2c693ff222\") "
Jul 06 14:58:31.289370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.289198    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:58:31.289370 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.289303    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e936f74e-a23c-4505-add6-1a2c693ff222-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:58:31.289487 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.289373    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:58:31.289487 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.289395    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.289694 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.289668    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:58:31.290187 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.290166    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-data" (OuterVolumeSpecName: "istio-data") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:58:31.291266 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.291229    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-kube-api-access-hfkmc" (OuterVolumeSpecName: "kube-api-access-hfkmc") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "kube-api-access-hfkmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:58:31.291418 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.291398    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:58:31.291475 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.291459    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e936f74e-a23c-4505-add6-1a2c693ff222-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 14:58:31.291565 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.291550    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-istio-token" (OuterVolumeSpecName: "istio-token") pod "e936f74e-a23c-4505-add6-1a2c693ff222" (UID: "e936f74e-a23c-4505-add6-1a2c693ff222"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:58:31.390433 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390398    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.390433 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390425    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.390433 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390434    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e936f74e-a23c-4505-add6-1a2c693ff222-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.390433 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390444    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfkmc\" (UniqueName: \"kubernetes.io/projected/e936f74e-a23c-4505-add6-1a2c693ff222-kube-api-access-hfkmc\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.390700 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390452    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.390700 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390460    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e936f74e-a23c-4505-add6-1a2c693ff222-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.390700 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390469    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:31.390700 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:31.390483    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e936f74e-a23c-4505-add6-1a2c693ff222-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:58:32.005753 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.005719    2552 generic.go:356] "Generic (PLEG): container finished" podID="e936f74e-a23c-4505-add6-1a2c693ff222" containerID="611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a" exitCode=0
Jul 06 14:58:32.005923 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.005771    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"
Jul 06 14:58:32.005923 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.005802    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" event={"ID":"e936f74e-a23c-4505-add6-1a2c693ff222","Type":"ContainerDied","Data":"611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a"}
Jul 06 14:58:32.005923 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.005855    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd" event={"ID":"e936f74e-a23c-4505-add6-1a2c693ff222","Type":"ContainerDied","Data":"de26621071322f801af27094a7eff3c27c827a055769888f2e6c8a7f756e0857"}
Jul 06 14:58:32.005923 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.005877    2552 scope.go:117] "RemoveContainer" containerID="611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a"
Jul 06 14:58:32.015113 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.015095    2552 scope.go:117] "RemoveContainer" containerID="d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790"
Jul 06 14:58:32.023162 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.023135    2552 scope.go:117] "RemoveContainer" containerID="611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a"
Jul 06 14:58:32.023428 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:58:32.023410    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a\": container with ID starting with 611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a not found: ID does not exist" containerID="611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a"
Jul 06 14:58:32.023507 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.023441    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a"} err="failed to get container status \"611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a\": rpc error: code = NotFound desc = could not find container \"611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a\": container with ID starting with 611c88c73fe71cd7148225d463f2922db07727409f0e85a48d48bf6f3130760a not found: ID does not exist"
Jul 06 14:58:32.023507 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.023467    2552 scope.go:117] "RemoveContainer" containerID="d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790"
Jul 06 14:58:32.023734 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:58:32.023713    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790\": container with ID starting with d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790 not found: ID does not exist" containerID="d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790"
Jul 06 14:58:32.023773 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.023739    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790"} err="failed to get container status \"d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790\": rpc error: code = NotFound desc = could not find container \"d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790\": container with ID starting with d58a8b0ffd9e0e25284fdf01ce222c7fed62580c2453c97d70f0dc1cf4417790 not found: ID does not exist"
Jul 06 14:58:32.028428 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.028405    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"]
Jul 06 14:58:32.035494 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:32.035472    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dc636816-openshift-default-bbdbb57f5-74hsd"]
Jul 06 14:58:33.156558 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:33.156522    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" path="/var/lib/kubelet/pods/e936f74e-a23c-4505-add6-1a2c693ff222/volumes"
Jul 06 14:58:47.226385 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226348    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"]
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226750    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226764    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226772    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226780    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226797    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869fea89-3f8e-4345-a912-f2f88a432501" containerName="maas-api"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226802    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="869fea89-3f8e-4345-a912-f2f88a432501" containerName="maas-api"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226854    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226862    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="869fea89-3f8e-4345-a912-f2f88a432501" containerName="maas-api"
Jul 06 14:58:47.226865 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.226867    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e936f74e-a23c-4505-add6-1a2c693ff222" containerName="istio-proxy"
Jul 06 14:58:47.231434 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.231418    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.234563 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.234528    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5737c8f3-openshift-default-dockercfg-n6skz\""
Jul 06 14:58:47.245951 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.245926    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"]
Jul 06 14:58:47.334973 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.334935    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-certs\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.334987    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-envoy\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.335066    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-credential-socket\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.335106    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-socket\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.335123    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-istio-token\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335169 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.335145    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcc2\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-kube-api-access-4zcc2\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335355 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.335173    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-data\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335355 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.335213    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b184e-c7f0-467e-b30e-940beaa58eec-istiod-ca-cert\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.335355 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.335237    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b184e-c7f0-467e-b30e-940beaa58eec-istio-podinfo\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.436586 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436551    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-credential-socket\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.436586 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436586    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-socket\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.436806 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436607    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-istio-token\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.436806 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436624    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcc2\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-kube-api-access-4zcc2\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.436806 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436649    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-data\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.436806 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436734    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b184e-c7f0-467e-b30e-940beaa58eec-istiod-ca-cert\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.436806 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436770    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b184e-c7f0-467e-b30e-940beaa58eec-istio-podinfo\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.437156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436819    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-certs\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.437156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.436869    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-envoy\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.437156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.437045    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-socket\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.437156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.437072    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-credential-socket\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.437156 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.437152    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-data\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.437455 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.437403    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-certs\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.437583 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.437561    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b184e-c7f0-467e-b30e-940beaa58eec-istiod-ca-cert\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.439176 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.439156    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-envoy\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.439381 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.439364    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b184e-c7f0-467e-b30e-940beaa58eec-istio-podinfo\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.453157 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.453136    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-istio-token\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.453421 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.453403    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcc2\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-kube-api-access-4zcc2\") pod \"e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") " pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.541300 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.541214    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:47.693269 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.693242    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"]
Jul 06 14:58:47.694242 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:58:47.694218    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960b184e_c7f0_467e_b30e_940beaa58eec.slice/crio-d40e42f799de6371bdad8b2e0e7b0a0e5e854daa4431db043d0f31750ee3bc20 WatchSource:0}: Error finding container d40e42f799de6371bdad8b2e0e7b0a0e5e854daa4431db043d0f31750ee3bc20: Status 404 returned error can't find the container with id d40e42f799de6371bdad8b2e0e7b0a0e5e854daa4431db043d0f31750ee3bc20
Jul 06 14:58:47.696216 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.696184    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:47.696283 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.696256    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:47.696321 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:47.696285    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:58:48.092074 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:48.092041    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" event={"ID":"960b184e-c7f0-467e-b30e-940beaa58eec","Type":"ContainerStarted","Data":"c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c"}
Jul 06 14:58:48.092263 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:48.092096    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" event={"ID":"960b184e-c7f0-467e-b30e-940beaa58eec","Type":"ContainerStarted","Data":"d40e42f799de6371bdad8b2e0e7b0a0e5e854daa4431db043d0f31750ee3bc20"}
Jul 06 14:58:48.111503 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:48.111443    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" podStartSLOduration=1.111426061 podStartE2EDuration="1.111426061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:48.111210756 +0000 UTC m=+1789.503114927" watchObservedRunningTime="2026-07-06 14:58:48.111426061 +0000 UTC m=+1789.503330232"
Jul 06 14:58:48.542234 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:48.542193    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:48.547373 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:48.547348    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:49.097799 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:49.097768    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:49.098829 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:49.098810    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:58:50.298005 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.297968    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"]
Jul 06 14:58:50.301493 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.301471    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.304516 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.304491    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-5737c8f3-serving-cert\""
Jul 06 14:58:50.319274 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.319247    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"]
Jul 06 14:58:50.367765 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.367731    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.367972 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.367796    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b021a84-6b42-4288-a669-4e9a1fb433f3-openshift-service-ca\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.367972 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.367870    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7ssz\" (UniqueName: \"kubernetes.io/projected/3b021a84-6b42-4288-a669-4e9a1fb433f3-kube-api-access-z7ssz\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.468863 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.468821    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b021a84-6b42-4288-a669-4e9a1fb433f3-openshift-service-ca\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.468863 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.468867    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7ssz\" (UniqueName: \"kubernetes.io/projected/3b021a84-6b42-4288-a669-4e9a1fb433f3-kube-api-access-z7ssz\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.469155 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.468939    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.469155 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:58:50.469092    2552 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-5737c8f3-serving-cert: secret "maas-api-e2e-mt-5737c8f3-serving-cert" not found
Jul 06 14:58:50.469278 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:58:50.469183    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls podName:3b021a84-6b42-4288-a669-4e9a1fb433f3 nodeName:}" failed. No retries permitted until 2026-07-06 14:58:50.969160423 +0000 UTC m=+1792.361064591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls") pod "maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2" (UID: "3b021a84-6b42-4288-a669-4e9a1fb433f3") : secret "maas-api-e2e-mt-5737c8f3-serving-cert" not found
Jul 06 14:58:50.469622 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.469600    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b021a84-6b42-4288-a669-4e9a1fb433f3-openshift-service-ca\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.479564 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.479539    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7ssz\" (UniqueName: \"kubernetes.io/projected/3b021a84-6b42-4288-a669-4e9a1fb433f3-kube-api-access-z7ssz\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.974746 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.974709    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:50.977179 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:50.977159    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls\") pod \"maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") " pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:51.211738 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:51.211704    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:51.350420 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:51.350382    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"]
Jul 06 14:58:51.351635 ip-10-0-129-16 kubenswrapper[2552]: W0706 14:58:51.351608    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b021a84_6b42_4288_a669_4e9a1fb433f3.slice/crio-d93ce7e7f0a8cdb847692ea644856a79e4e229f32e7ff201afadebefff781831 WatchSource:0}: Error finding container d93ce7e7f0a8cdb847692ea644856a79e4e229f32e7ff201afadebefff781831: Status 404 returned error can't find the container with id d93ce7e7f0a8cdb847692ea644856a79e4e229f32e7ff201afadebefff781831
Jul 06 14:58:52.121968 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:52.121931    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2" event={"ID":"3b021a84-6b42-4288-a669-4e9a1fb433f3","Type":"ContainerStarted","Data":"d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd"}
Jul 06 14:58:52.122188 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:52.121982    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2" event={"ID":"3b021a84-6b42-4288-a669-4e9a1fb433f3","Type":"ContainerStarted","Data":"d93ce7e7f0a8cdb847692ea644856a79e4e229f32e7ff201afadebefff781831"}
Jul 06 14:58:52.122188 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:52.122025    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:58:52.143564 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:52.143517    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2" podStartSLOduration=1.672790096 podStartE2EDuration="2.143500897s" totalImagesPullingTime="470.710801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:52.143029003 +0000 UTC m=+1793.534933173" watchObservedRunningTime="2026-07-06 14:58:52.143500897 +0000 UTC m=+1793.535405066"
Jul 06 14:58:58.132924 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:58:58.132894    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:59:03.191585 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:03.191544    2552 generic.go:356] "Generic (PLEG): container finished" podID="960b184e-c7f0-467e-b30e-940beaa58eec" containerID="c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c" exitCode=0
Jul 06 14:59:03.192099 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:03.191615    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" event={"ID":"960b184e-c7f0-467e-b30e-940beaa58eec","Type":"ContainerDied","Data":"c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c"}
Jul 06 14:59:03.192099 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:03.192023    2552 scope.go:117] "RemoveContainer" containerID="c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c"
Jul 06 14:59:03.193108 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:03.193079    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:59:03.193212 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:03.193145    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:59:03.193212 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:03.193178    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 14:59:04.098526 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:04.098451    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:59:04.200054 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:04.200017    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" event={"ID":"960b184e-c7f0-467e-b30e-940beaa58eec","Type":"ContainerStarted","Data":"f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3"}
Jul 06 14:59:04.541739 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:04.541702    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:59:04.543072 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:04.543045    2552 patch_prober.go:28] interesting pod/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:59:04.543197 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:04.543091    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 06 14:59:05.542319 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:05.542279    2552 patch_prober.go:28] interesting pod/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:59:05.542719 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:05.542341    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 06 14:59:06.541889 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:06.541846    2552 patch_prober.go:28] interesting pod/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:59:06.542079 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:06.541921    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 06 14:59:07.541777 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:07.541739    2552 patch_prober.go:28] interesting pod/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 06 14:59:07.542198 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:07.541799    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 06 14:59:08.546139 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:08.546107    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:59:08.546522 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:08.546441    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:59:08.547086 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:08.547066    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 14:59:22.374164 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.374128    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"]
Jul 06 14:59:22.374651 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.374329    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2" podUID="3b021a84-6b42-4288-a669-4e9a1fb433f3" containerName="maas-api" containerID="cri-o://d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd" gracePeriod=30
Jul 06 14:59:22.625716 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.625656    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:59:22.694365 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.694330    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls\") pod \"3b021a84-6b42-4288-a669-4e9a1fb433f3\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") "
Jul 06 14:59:22.694532 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.694375    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b021a84-6b42-4288-a669-4e9a1fb433f3-openshift-service-ca\") pod \"3b021a84-6b42-4288-a669-4e9a1fb433f3\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") "
Jul 06 14:59:22.694532 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.694470    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7ssz\" (UniqueName: \"kubernetes.io/projected/3b021a84-6b42-4288-a669-4e9a1fb433f3-kube-api-access-z7ssz\") pod \"3b021a84-6b42-4288-a669-4e9a1fb433f3\" (UID: \"3b021a84-6b42-4288-a669-4e9a1fb433f3\") "
Jul 06 14:59:22.694765 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.694738    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b021a84-6b42-4288-a669-4e9a1fb433f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b021a84-6b42-4288-a669-4e9a1fb433f3" (UID: "3b021a84-6b42-4288-a669-4e9a1fb433f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:59:22.696465 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.696441    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b021a84-6b42-4288-a669-4e9a1fb433f3" (UID: "3b021a84-6b42-4288-a669-4e9a1fb433f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:59:22.696567 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.696551    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b021a84-6b42-4288-a669-4e9a1fb433f3-kube-api-access-z7ssz" (OuterVolumeSpecName: "kube-api-access-z7ssz") pod "3b021a84-6b42-4288-a669-4e9a1fb433f3" (UID: "3b021a84-6b42-4288-a669-4e9a1fb433f3"). InnerVolumeSpecName "kube-api-access-z7ssz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:59:22.795606 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.795569    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7ssz\" (UniqueName: \"kubernetes.io/projected/3b021a84-6b42-4288-a669-4e9a1fb433f3-kube-api-access-z7ssz\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:59:22.795606 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.795601    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b021a84-6b42-4288-a669-4e9a1fb433f3-maas-api-tls\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:59:22.795606 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:22.795612    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b021a84-6b42-4288-a669-4e9a1fb433f3-openshift-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 14:59:23.300721 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.300682    2552 generic.go:356] "Generic (PLEG): container finished" podID="3b021a84-6b42-4288-a669-4e9a1fb433f3" containerID="d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd" exitCode=0
Jul 06 14:59:23.300908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.300732    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2" event={"ID":"3b021a84-6b42-4288-a669-4e9a1fb433f3","Type":"ContainerDied","Data":"d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd"}
Jul 06 14:59:23.300908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.300743    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"
Jul 06 14:59:23.300908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.300780    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2" event={"ID":"3b021a84-6b42-4288-a669-4e9a1fb433f3","Type":"ContainerDied","Data":"d93ce7e7f0a8cdb847692ea644856a79e4e229f32e7ff201afadebefff781831"}
Jul 06 14:59:23.300908 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.300805    2552 scope.go:117] "RemoveContainer" containerID="d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd"
Jul 06 14:59:23.309840 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.309819    2552 scope.go:117] "RemoveContainer" containerID="d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd"
Jul 06 14:59:23.310134 ip-10-0-129-16 kubenswrapper[2552]: E0706 14:59:23.310113    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd\": container with ID starting with d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd not found: ID does not exist" containerID="d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd"
Jul 06 14:59:23.310196 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.310151    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd"} err="failed to get container status \"d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd\": rpc error: code = NotFound desc = could not find container \"d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd\": container with ID starting with d72d4a79ef33d9a6caa43e3aa80f05a8a2017fc1d6b152592bcbec4fb08b12fd not found: ID does not exist"
Jul 06 14:59:23.323679 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.323652    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"]
Jul 06 14:59:23.328587 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:23.328560    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-5737c8f3-5db8cf9d97-4knm2"]
Jul 06 14:59:25.156602 ip-10-0-129-16 kubenswrapper[2552]: I0706 14:59:25.156567    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b021a84-6b42-4288-a669-4e9a1fb433f3" path="/var/lib/kubelet/pods/3b021a84-6b42-4288-a669-4e9a1fb433f3/volumes"
Jul 06 15:00:31.333744 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:31.333710    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"]
Jul 06 15:00:31.334316 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:31.333924    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy" containerID="cri-o://f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3" gracePeriod=30
Jul 06 15:00:36.588385 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.588358    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 15:00:36.685301 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.685263    2552 generic.go:356] "Generic (PLEG): container finished" podID="960b184e-c7f0-467e-b30e-940beaa58eec" containerID="f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3" exitCode=0
Jul 06 15:00:36.685568 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.685320    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"
Jul 06 15:00:36.685568 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.685348    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" event={"ID":"960b184e-c7f0-467e-b30e-940beaa58eec","Type":"ContainerDied","Data":"f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3"}
Jul 06 15:00:36.685568 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.685409    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp" event={"ID":"960b184e-c7f0-467e-b30e-940beaa58eec","Type":"ContainerDied","Data":"d40e42f799de6371bdad8b2e0e7b0a0e5e854daa4431db043d0f31750ee3bc20"}
Jul 06 15:00:36.685568 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.685438    2552 scope.go:117] "RemoveContainer" containerID="f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3"
Jul 06 15:00:36.696085 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.696064    2552 scope.go:117] "RemoveContainer" containerID="c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c"
Jul 06 15:00:36.704379 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.704358    2552 scope.go:117] "RemoveContainer" containerID="f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3"
Jul 06 15:00:36.704645 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:00:36.704624    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3\": container with ID starting with f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3 not found: ID does not exist" containerID="f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3"
Jul 06 15:00:36.704710 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.704655    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3"} err="failed to get container status \"f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3\": rpc error: code = NotFound desc = could not find container \"f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3\": container with ID starting with f8e204088de13b1a45caa4794d7095a447ef6f414a7e7f01d6f73e5a3804e4c3 not found: ID does not exist"
Jul 06 15:00:36.704710 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.704673    2552 scope.go:117] "RemoveContainer" containerID="c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c"
Jul 06 15:00:36.704932 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:00:36.704911    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c\": container with ID starting with c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c not found: ID does not exist" containerID="c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c"
Jul 06 15:00:36.705005 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.704941    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c"} err="failed to get container status \"c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c\": rpc error: code = NotFound desc = could not find container \"c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c\": container with ID starting with c317e59c737e7be6a45b5fced173cb3de29228b68a32288e1255788c7eb4bb9c not found: ID does not exist"
Jul 06 15:00:36.779014 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.778968    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-data\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779040    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b184e-c7f0-467e-b30e-940beaa58eec-istiod-ca-cert\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779073    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-credential-socket\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779104    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zcc2\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-kube-api-access-4zcc2\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779133    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-socket\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779195    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-certs\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779219    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-envoy\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779254    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b184e-c7f0-467e-b30e-940beaa58eec-istio-podinfo\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779302    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-istio-token\") pod \"960b184e-c7f0-467e-b30e-940beaa58eec\" (UID: \"960b184e-c7f0-467e-b30e-940beaa58eec\") "
Jul 06 15:00:36.779603 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779417    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:00:36.779603 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779427    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/960b184e-c7f0-467e-b30e-940beaa58eec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:00:36.779603 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779542    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:00:36.779758 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779728    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/960b184e-c7f0-467e-b30e-940beaa58eec-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.779758 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779751    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.779865 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779767    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.779944 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.779916    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:00:36.780310 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.780285    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-data" (OuterVolumeSpecName: "istio-data") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:00:36.781519 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.781490    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-istio-token" (OuterVolumeSpecName: "istio-token") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:36.781846 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.781816    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:00:36.781935 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.781851    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/960b184e-c7f0-467e-b30e-940beaa58eec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:00:36.781935 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.781875    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-kube-api-access-4zcc2" (OuterVolumeSpecName: "kube-api-access-4zcc2") pod "960b184e-c7f0-467e-b30e-940beaa58eec" (UID: "960b184e-c7f0-467e-b30e-940beaa58eec"). InnerVolumeSpecName "kube-api-access-4zcc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:36.881008 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.880971    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.881181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.881029    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/960b184e-c7f0-467e-b30e-940beaa58eec-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.881181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.881038    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.881181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.881046    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.881181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.881054    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zcc2\" (UniqueName: \"kubernetes.io/projected/960b184e-c7f0-467e-b30e-940beaa58eec-kube-api-access-4zcc2\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:36.881181 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:36.881063    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/960b184e-c7f0-467e-b30e-940beaa58eec-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:00:37.034032 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:37.033977    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"]
Jul 06 15:00:37.041515 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:37.041484    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5737c8f3-openshift-default-585f8c46dc-q4dnp"]
Jul 06 15:00:37.156751 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:00:37.156704    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" path="/var/lib/kubelet/pods/960b184e-c7f0-467e-b30e-940beaa58eec/volumes"
Jul 06 15:01:31.006420 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006381    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"]
Jul 06 15:01:31.006903 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006775    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy"
Jul 06 15:01:31.006903 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006788    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy"
Jul 06 15:01:31.006903 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006807    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b021a84-6b42-4288-a669-4e9a1fb433f3" containerName="maas-api"
Jul 06 15:01:31.006903 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006816    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b021a84-6b42-4288-a669-4e9a1fb433f3" containerName="maas-api"
Jul 06 15:01:31.006903 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006831    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy"
Jul 06 15:01:31.006903 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006837    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy"
Jul 06 15:01:31.007145 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006911    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy"
Jul 06 15:01:31.007145 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.006921    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b021a84-6b42-4288-a669-4e9a1fb433f3" containerName="maas-api"
Jul 06 15:01:31.010018 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.009986    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.012235 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.012215    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-419f91-openshift-default-dockercfg-h2cps\""
Jul 06 15:01:31.023026 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.022987    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"]
Jul 06 15:01:31.065272 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065238    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-istio-token\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065272 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065281    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wxr\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-kube-api-access-k4wxr\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065523 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065389    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-credential-socket\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065523 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065420    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821d0156-2744-47d6-989e-455064efe59f-istio-podinfo\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065523 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065441    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-envoy\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065523 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065490    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821d0156-2744-47d6-989e-455064efe59f-istiod-ca-cert\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065658 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065558    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-data\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065658 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065576    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-certs\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.065658 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.065629    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-socket\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166685 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166652    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-socket\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166685 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-istio-token\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166943 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166708    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wxr\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-kube-api-access-k4wxr\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166943 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166765    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-credential-socket\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166943 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166788    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821d0156-2744-47d6-989e-455064efe59f-istio-podinfo\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166943 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166819    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-envoy\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166943 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166849    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821d0156-2744-47d6-989e-455064efe59f-istiod-ca-cert\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166943 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166894    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-data\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.166943 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.166919    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-certs\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.167306 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.167152    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-socket\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.167306 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.167206    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-credential-socket\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.167306 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.167246    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-certs\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.167410 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.167386    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-data\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.167625 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.167599    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821d0156-2744-47d6-989e-455064efe59f-istiod-ca-cert\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.169215 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.169196    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-envoy\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.169369 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.169351    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821d0156-2744-47d6-989e-455064efe59f-istio-podinfo\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.176722 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.176694    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-istio-token\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.176827 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.176803    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wxr\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-kube-api-access-k4wxr\") pod \"e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") " pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.319862 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.319776    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:31.467608 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.467571    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"]
Jul 06 15:01:31.468811 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:01:31.468774    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821d0156_2744_47d6_989e_455064efe59f.slice/crio-bd3d72324ffe5c3bd07666a9c0fb63348b9d766b86722415e1794ced29f94129 WatchSource:0}: Error finding container bd3d72324ffe5c3bd07666a9c0fb63348b9d766b86722415e1794ced29f94129: Status 404 returned error can't find the container with id bd3d72324ffe5c3bd07666a9c0fb63348b9d766b86722415e1794ced29f94129
Jul 06 15:01:31.470895 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.470863    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:31.470965 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.470928    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:31.470965 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.470957    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:31.978899 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.978860    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" event={"ID":"821d0156-2744-47d6-989e-455064efe59f","Type":"ContainerStarted","Data":"eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff"}
Jul 06 15:01:31.979087 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:31.978924    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" event={"ID":"821d0156-2744-47d6-989e-455064efe59f","Type":"ContainerStarted","Data":"bd3d72324ffe5c3bd07666a9c0fb63348b9d766b86722415e1794ced29f94129"}
Jul 06 15:01:32.016276 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:32.016221    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podStartSLOduration=2.016204806 podStartE2EDuration="2.016204806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:32.015097796 +0000 UTC m=+1953.407001968" watchObservedRunningTime="2026-07-06 15:01:32.016204806 +0000 UTC m=+1953.408108977"
Jul 06 15:01:32.320541 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:32.320439    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:32.325532 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:32.325505    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:32.984564 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:32.984534    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:32.985445 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:32.985423    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:34.290423 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.290388    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"]
Jul 06 15:01:34.290882 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.290867    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="960b184e-c7f0-467e-b30e-940beaa58eec" containerName="istio-proxy"
Jul 06 15:01:34.292865 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.292848    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.296969 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.296944    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-419f91-serving-cert\""
Jul 06 15:01:34.311250 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.311225    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"]
Jul 06 15:01:34.398236 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.398203    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3295a447-e4d9-4f51-8528-4752aab551d8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.398412 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.398277    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3295a447-e4d9-4f51-8528-4752aab551d8-maas-api-tls\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.398412 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.398318    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phtg5\" (UniqueName: \"kubernetes.io/projected/3295a447-e4d9-4f51-8528-4752aab551d8-kube-api-access-phtg5\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.499727 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.499692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3295a447-e4d9-4f51-8528-4752aab551d8-maas-api-tls\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.499940 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.499763    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phtg5\" (UniqueName: \"kubernetes.io/projected/3295a447-e4d9-4f51-8528-4752aab551d8-kube-api-access-phtg5\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.499940 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.499838    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3295a447-e4d9-4f51-8528-4752aab551d8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.500542 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.500517    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3295a447-e4d9-4f51-8528-4752aab551d8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.502217 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.502194    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3295a447-e4d9-4f51-8528-4752aab551d8-maas-api-tls\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.515079 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.515049    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phtg5\" (UniqueName: \"kubernetes.io/projected/3295a447-e4d9-4f51-8528-4752aab551d8-kube-api-access-phtg5\") pod \"maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") " pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.604339 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.604243    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:34.745278 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.745250    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"]
Jul 06 15:01:34.747206 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:01:34.747181    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3295a447_e4d9_4f51_8528_4752aab551d8.slice/crio-f36966480b2c1d4555b00f9e2ded37658ed6d78cd24bc01a2dbfa0322b2bc914 WatchSource:0}: Error finding container f36966480b2c1d4555b00f9e2ded37658ed6d78cd24bc01a2dbfa0322b2bc914: Status 404 returned error can't find the container with id f36966480b2c1d4555b00f9e2ded37658ed6d78cd24bc01a2dbfa0322b2bc914
Jul 06 15:01:34.748584 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:34.748563    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 15:01:35.002824 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:35.002778    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf" event={"ID":"3295a447-e4d9-4f51-8528-4752aab551d8","Type":"ContainerStarted","Data":"f36966480b2c1d4555b00f9e2ded37658ed6d78cd24bc01a2dbfa0322b2bc914"}
Jul 06 15:01:36.009608 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:36.009563    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf" event={"ID":"3295a447-e4d9-4f51-8528-4752aab551d8","Type":"ContainerStarted","Data":"40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f"}
Jul 06 15:01:36.010115 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:36.009770    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:36.033321 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:36.033272    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf" podStartSLOduration=0.997428518 podStartE2EDuration="2.033257663s" totalImagesPullingTime="1.035829145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:36.031385786 +0000 UTC m=+1957.423289957" watchObservedRunningTime="2026-07-06 15:01:36.033257663 +0000 UTC m=+1957.425161863"
Jul 06 15:01:39.278897 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.278865    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"]
Jul 06 15:01:39.281532 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.281509    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.285451 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.285432    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-69ca3d-openshift-default-dockercfg-2nnxm\""
Jul 06 15:01:39.295103 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.295071    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"]
Jul 06 15:01:39.345339 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345293    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-certs\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345339 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345342    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f84852e-f868-4b14-8439-ea8e6b399f82-istiod-ca-cert\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345554 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345372    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-socket\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345554 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345440    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-credential-socket\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345554 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345472    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-data\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345554 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345498    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-token\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345554 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345529    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-envoy\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345720 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345663    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bk6x\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-kube-api-access-4bk6x\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.345720 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.345694    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-podinfo\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446347 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446305    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bk6x\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-kube-api-access-4bk6x\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446347 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446349    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-podinfo\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446597 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446384    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-certs\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446597 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446408    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f84852e-f868-4b14-8439-ea8e6b399f82-istiod-ca-cert\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446597 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446448    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-socket\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446597 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446489    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-credential-socket\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446597 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446513    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-data\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446597 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446544    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-token\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446597 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446586    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-envoy\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.446986 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.446945    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-certs\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.447090 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.447025    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-credential-socket\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.447161 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.447138    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-socket\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.447234 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.447215    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-data\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.447320 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.447302    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f84852e-f868-4b14-8439-ea8e6b399f82-istiod-ca-cert\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.448781 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.448759    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-envoy\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.449019 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.448985    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-podinfo\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.458620 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.458591    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-token\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.458928 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.458907    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bk6x\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-kube-api-access-4bk6x\") pod \"e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") " pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.591384 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.591288    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:39.743889 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.743860    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"]
Jul 06 15:01:39.745619 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:01:39.745588    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f84852e_f868_4b14_8439_ea8e6b399f82.slice/crio-e806bf750ab95be2c5c49e854ae92bf57fdd22df05c1b124e3de8bc9f7eefac9 WatchSource:0}: Error finding container e806bf750ab95be2c5c49e854ae92bf57fdd22df05c1b124e3de8bc9f7eefac9: Status 404 returned error can't find the container with id e806bf750ab95be2c5c49e854ae92bf57fdd22df05c1b124e3de8bc9f7eefac9
Jul 06 15:01:39.747706 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.747670    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:39.747802 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.747737    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:39.747802 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:39.747766    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:40.033091 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:40.033054    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" event={"ID":"7f84852e-f868-4b14-8439-ea8e6b399f82","Type":"ContainerStarted","Data":"98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3"}
Jul 06 15:01:40.033257 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:40.033116    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" event={"ID":"7f84852e-f868-4b14-8439-ea8e6b399f82","Type":"ContainerStarted","Data":"e806bf750ab95be2c5c49e854ae92bf57fdd22df05c1b124e3de8bc9f7eefac9"}
Jul 06 15:01:40.055963 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:40.055892    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podStartSLOduration=1.055871262 podStartE2EDuration="1.055871262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:40.055085394 +0000 UTC m=+1961.446989557" watchObservedRunningTime="2026-07-06 15:01:40.055871262 +0000 UTC m=+1961.447775436"
Jul 06 15:01:40.591961 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:40.591927    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:40.597027 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:40.596979    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:41.038349 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:41.038319    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:41.039311 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:41.039292    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:42.021191 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:42.021164    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:01:49.026208 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:49.026168    2552 patch_prober.go:28] interesting pod/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 15:01:49.026573 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:49.026269    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 15:01:51.102223 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:51.102186    2552 generic.go:356] "Generic (PLEG): container finished" podID="821d0156-2744-47d6-989e-455064efe59f" containerID="eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff" exitCode=0
Jul 06 15:01:51.102787 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:51.102263    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" event={"ID":"821d0156-2744-47d6-989e-455064efe59f","Type":"ContainerDied","Data":"eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff"}
Jul 06 15:01:51.102862 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:51.102801    2552 scope.go:117] "RemoveContainer" containerID="eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff"
Jul 06 15:01:51.103862 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:51.103831    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:51.104119 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:51.103901    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:51.104119 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:51.103947    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:52.109494 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:52.109460    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" event={"ID":"821d0156-2744-47d6-989e-455064efe59f","Type":"ContainerStarted","Data":"5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b"}
Jul 06 15:01:52.320191 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:52.320133    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:52.320560 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:52.320537    2552 patch_prober.go:28] interesting pod/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 06 15:01:52.320611 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:52.320588    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 06 15:01:53.320682 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:53.320646    2552 patch_prober.go:28] interesting pod/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 06 15:01:53.321075 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:53.320699    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 06 15:01:54.321147 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:54.321110    2552 patch_prober.go:28] interesting pod/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 06 15:01:54.321550 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:54.321166    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 06 15:01:55.320957 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:55.320914    2552 patch_prober.go:28] interesting pod/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 06 15:01:55.321179 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:55.320975    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 06 15:01:56.401210 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:56.401173    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:56.401689 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:56.401556    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:56.402432 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:56.402415    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:01:57.080235 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:57.080194    2552 patch_prober.go:28] interesting pod/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 15:01:57.080432 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:57.080276    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 15:01:58.146413 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:58.146380    2552 generic.go:356] "Generic (PLEG): container finished" podID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerID="98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3" exitCode=0
Jul 06 15:01:58.146842 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:58.146453    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" event={"ID":"7f84852e-f868-4b14-8439-ea8e6b399f82","Type":"ContainerDied","Data":"98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3"}
Jul 06 15:01:58.146968 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:58.146953    2552 scope.go:117] "RemoveContainer" containerID="98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3"
Jul 06 15:01:58.147924 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:58.147897    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:58.148043 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:58.147960    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:58.148043 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:58.148007    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:01:59.163051 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:59.162987    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" event={"ID":"7f84852e-f868-4b14-8439-ea8e6b399f82","Type":"ContainerStarted","Data":"a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78"}
Jul 06 15:01:59.592251 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:59.592152    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:01:59.592419 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:59.592391    2552 patch_prober.go:28] interesting pod/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 06 15:01:59.592472 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:01:59.592438    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 06 15:02:00.592360 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:00.592324    2552 patch_prober.go:28] interesting pod/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 06 15:02:00.592754 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:00.592397    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 06 15:02:01.592492 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:01.592453    2552 patch_prober.go:28] interesting pod/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 06 15:02:01.592960 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:01.592515    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 06 15:02:02.592598 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:02.592561    2552 patch_prober.go:28] interesting pod/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 06 15:02:02.593099 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:02.592618    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 06 15:02:03.595855 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:03.595815    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:02:03.596335 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:03.596125    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:02:03.596741 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:03.596725    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:02:42.425316 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.425280    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"]
Jul 06 15:02:42.425851 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.425538    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf" podUID="3295a447-e4d9-4f51-8528-4752aab551d8" containerName="maas-api" containerID="cri-o://40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f" gracePeriod=30
Jul 06 15:02:42.683367 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.683302    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:02:42.761190 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.761156    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3295a447-e4d9-4f51-8528-4752aab551d8-openshift-service-ca\") pod \"3295a447-e4d9-4f51-8528-4752aab551d8\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") "
Jul 06 15:02:42.761378 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.761246    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3295a447-e4d9-4f51-8528-4752aab551d8-maas-api-tls\") pod \"3295a447-e4d9-4f51-8528-4752aab551d8\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") "
Jul 06 15:02:42.761378 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.761277    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phtg5\" (UniqueName: \"kubernetes.io/projected/3295a447-e4d9-4f51-8528-4752aab551d8-kube-api-access-phtg5\") pod \"3295a447-e4d9-4f51-8528-4752aab551d8\" (UID: \"3295a447-e4d9-4f51-8528-4752aab551d8\") "
Jul 06 15:02:42.761638 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.761607    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3295a447-e4d9-4f51-8528-4752aab551d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3295a447-e4d9-4f51-8528-4752aab551d8" (UID: "3295a447-e4d9-4f51-8528-4752aab551d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:02:42.763402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.763373    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3295a447-e4d9-4f51-8528-4752aab551d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3295a447-e4d9-4f51-8528-4752aab551d8" (UID: "3295a447-e4d9-4f51-8528-4752aab551d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 15:02:42.763499 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.763427    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3295a447-e4d9-4f51-8528-4752aab551d8-kube-api-access-phtg5" (OuterVolumeSpecName: "kube-api-access-phtg5") pod "3295a447-e4d9-4f51-8528-4752aab551d8" (UID: "3295a447-e4d9-4f51-8528-4752aab551d8"). InnerVolumeSpecName "kube-api-access-phtg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:02:42.862948 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.862909    2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3295a447-e4d9-4f51-8528-4752aab551d8-openshift-service-ca\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.862948 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.862942    2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3295a447-e4d9-4f51-8528-4752aab551d8-maas-api-tls\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:02:42.862948 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:42.862955    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phtg5\" (UniqueName: \"kubernetes.io/projected/3295a447-e4d9-4f51-8528-4752aab551d8-kube-api-access-phtg5\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:02:43.415563 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.415525    2552 generic.go:356] "Generic (PLEG): container finished" podID="3295a447-e4d9-4f51-8528-4752aab551d8" containerID="40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f" exitCode=0
Jul 06 15:02:43.415743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.415568    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"
Jul 06 15:02:43.415743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.415595    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf" event={"ID":"3295a447-e4d9-4f51-8528-4752aab551d8","Type":"ContainerDied","Data":"40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f"}
Jul 06 15:02:43.415743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.415639    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf" event={"ID":"3295a447-e4d9-4f51-8528-4752aab551d8","Type":"ContainerDied","Data":"f36966480b2c1d4555b00f9e2ded37658ed6d78cd24bc01a2dbfa0322b2bc914"}
Jul 06 15:02:43.415743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.415661    2552 scope.go:117] "RemoveContainer" containerID="40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f"
Jul 06 15:02:43.425019 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.424980    2552 scope.go:117] "RemoveContainer" containerID="40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f"
Jul 06 15:02:43.425274 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:02:43.425255    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f\": container with ID starting with 40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f not found: ID does not exist" containerID="40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f"
Jul 06 15:02:43.425367 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.425281    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f"} err="failed to get container status \"40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f\": rpc error: code = NotFound desc = could not find container \"40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f\": container with ID starting with 40ca80fad27d06a41eda9cc4df5b820f52b05fc92856ab177a45fc9f2d1f636f not found: ID does not exist"
Jul 06 15:02:43.445088 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.445055    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"]
Jul 06 15:02:43.450278 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:43.450252    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-419f91-5df5895f5-vbmxf"]
Jul 06 15:02:45.156817 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:02:45.156767    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3295a447-e4d9-4f51-8528-4752aab551d8" path="/var/lib/kubelet/pods/3295a447-e4d9-4f51-8528-4752aab551d8/volumes"
Jul 06 15:03:25.135454 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:25.135371    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"]
Jul 06 15:03:25.135969 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:25.135627    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy" containerID="cri-o://5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b" gracePeriod=30
Jul 06 15:03:26.403972 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:26.403934    2552 patch_prober.go:28] interesting pod/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 15:03:26.404416 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:26.404017    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 15:03:30.395133 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.395105    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:03:30.515884 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.515793    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4wxr\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-kube-api-access-k4wxr\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.515884 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.515846    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-credential-socket\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.515884 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.515862    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-certs\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.516198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.515897    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821d0156-2744-47d6-989e-455064efe59f-istiod-ca-cert\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.516198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.515948    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821d0156-2744-47d6-989e-455064efe59f-istio-podinfo\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.516198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.515973    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-envoy\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.516198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516037    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-socket\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.516198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516115    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-istio-token\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.516198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516142    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-data\") pod \"821d0156-2744-47d6-989e-455064efe59f\" (UID: \"821d0156-2744-47d6-989e-455064efe59f\") "
Jul 06 15:03:30.516512 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516107    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:30.516512 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516395    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/821d0156-2744-47d6-989e-455064efe59f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:03:30.516512 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516305    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:30.516512 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516317    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:30.516743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516609    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.516743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516628    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.516743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516642    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821d0156-2744-47d6-989e-455064efe59f-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.516743 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.516655    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.517136 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.517116    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-data" (OuterVolumeSpecName: "istio-data") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:30.518191 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.518166    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:30.518370 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.518350    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-istio-token" (OuterVolumeSpecName: "istio-token") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:03:30.518551 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.518527    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-kube-api-access-k4wxr" (OuterVolumeSpecName: "kube-api-access-k4wxr") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "kube-api-access-k4wxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:03:30.518618 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.518526    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/821d0156-2744-47d6-989e-455064efe59f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "821d0156-2744-47d6-989e-455064efe59f" (UID: "821d0156-2744-47d6-989e-455064efe59f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:03:30.617530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.617488    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.617530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.617522    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.617530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.617534    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4wxr\" (UniqueName: \"kubernetes.io/projected/821d0156-2744-47d6-989e-455064efe59f-kube-api-access-k4wxr\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.617777 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.617546    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821d0156-2744-47d6-989e-455064efe59f-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.617777 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.617558    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821d0156-2744-47d6-989e-455064efe59f-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:30.678237 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.678204    2552 generic.go:356] "Generic (PLEG): container finished" podID="821d0156-2744-47d6-989e-455064efe59f" containerID="5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b" exitCode=0
Jul 06 15:03:30.678408 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.678255    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"
Jul 06 15:03:30.678408 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.678278    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" event={"ID":"821d0156-2744-47d6-989e-455064efe59f","Type":"ContainerDied","Data":"5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b"}
Jul 06 15:03:30.678408 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.678329    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw" event={"ID":"821d0156-2744-47d6-989e-455064efe59f","Type":"ContainerDied","Data":"bd3d72324ffe5c3bd07666a9c0fb63348b9d766b86722415e1794ced29f94129"}
Jul 06 15:03:30.678408 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.678354    2552 scope.go:117] "RemoveContainer" containerID="5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b"
Jul 06 15:03:30.687598 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.687578    2552 scope.go:117] "RemoveContainer" containerID="eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff"
Jul 06 15:03:30.695585 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.695567    2552 scope.go:117] "RemoveContainer" containerID="5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b"
Jul 06 15:03:30.695843 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:03:30.695823    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b\": container with ID starting with 5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b not found: ID does not exist" containerID="5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b"
Jul 06 15:03:30.695893 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.695851    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b"} err="failed to get container status \"5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b\": rpc error: code = NotFound desc = could not find container \"5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b\": container with ID starting with 5a70ec0254b4c3dd4e3d0e89a0bd70100d40b433e9066565839083820ce4546b not found: ID does not exist"
Jul 06 15:03:30.695893 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.695867    2552 scope.go:117] "RemoveContainer" containerID="eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff"
Jul 06 15:03:30.696104 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:03:30.696089    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff\": container with ID starting with eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff not found: ID does not exist" containerID="eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff"
Jul 06 15:03:30.696163 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.696107    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff"} err="failed to get container status \"eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff\": rpc error: code = NotFound desc = could not find container \"eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff\": container with ID starting with eca0199fabe8499ab9d96e8b595a04024368209447d9b47d0d59bd64ad4488ff not found: ID does not exist"
Jul 06 15:03:30.708408 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.708382    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"]
Jul 06 15:03:30.713846 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:30.713824    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-419f91-openshift-default-bc5978bb9-g45cw"]
Jul 06 15:03:31.156888 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:31.156853    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="821d0156-2744-47d6-989e-455064efe59f" path="/var/lib/kubelet/pods/821d0156-2744-47d6-989e-455064efe59f/volumes"
Jul 06 15:03:32.887102 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:32.887068    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"]
Jul 06 15:03:32.887554 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:32.887284    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy" containerID="cri-o://a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78" gracePeriod=30
Jul 06 15:03:33.598696 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.598660    2552 patch_prober.go:28] interesting pod/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 15:03:33.598861 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.598717    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 15:03:33.768702 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.768665    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"]
Jul 06 15:03:33.769276 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769245    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy"
Jul 06 15:03:33.769276 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769276    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy"
Jul 06 15:03:33.769442 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769298    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3295a447-e4d9-4f51-8528-4752aab551d8" containerName="maas-api"
Jul 06 15:03:33.769442 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769304    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3295a447-e4d9-4f51-8528-4752aab551d8" containerName="maas-api"
Jul 06 15:03:33.769442 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769312    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy"
Jul 06 15:03:33.769442 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769319    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy"
Jul 06 15:03:33.769442 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769390    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy"
Jul 06 15:03:33.769442 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.769398    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3295a447-e4d9-4f51-8528-4752aab551d8" containerName="maas-api"
Jul 06 15:03:33.771391 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.771374    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.775947 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.775926    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b5a326-openshift-default-dockercfg-khlgg\""
Jul 06 15:03:33.788360 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.788329    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"]
Jul 06 15:03:33.945636 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945596    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-podinfo\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.945636 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945642    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-envoy\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.946198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945662    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50aeec6a-51f5-4651-be66-8ecfcd276603-istiod-ca-cert\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.946198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945691    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-token\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.946198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945760    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgn5n\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-kube-api-access-cgn5n\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.946198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945826    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-data\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.946198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945923    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-socket\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.946198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945960    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-credential-socket\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:33.946198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:33.945984    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-certs\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047263 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047233    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-data\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047429 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047282    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-socket\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047429 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047299    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-credential-socket\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047429 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047320    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-certs\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047429 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047370    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-podinfo\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047429 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047397    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-envoy\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047429 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047422    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50aeec6a-51f5-4651-be66-8ecfcd276603-istiod-ca-cert\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047790 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047459    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-token\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047790 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047503    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgn5n\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-kube-api-access-cgn5n\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047790 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047770    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-socket\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047944 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047797    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-credential-socket\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.047944 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.047910    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-certs\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.048162 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.048142    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-data\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.048388 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.048364    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50aeec6a-51f5-4651-be66-8ecfcd276603-istiod-ca-cert\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.049839 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.049810    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-envoy\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.049922 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.049887    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-podinfo\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.057688 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.057635    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-token\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.057895 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.057871    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgn5n\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-kube-api-access-cgn5n\") pod \"e2e-api-a-b5a326-openshift-default-6dd844445-84v6d\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") " pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.080944 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.080916    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:34.231733 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.231709    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"]
Jul 06 15:03:34.233908 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:03:34.233881    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50aeec6a_51f5_4651_be66_8ecfcd276603.slice/crio-4e46ce51f67e99cb93cc34609f3d4e5d90fb38e7200a8552b7c0f76dbd2b709b WatchSource:0}: Error finding container 4e46ce51f67e99cb93cc34609f3d4e5d90fb38e7200a8552b7c0f76dbd2b709b: Status 404 returned error can't find the container with id 4e46ce51f67e99cb93cc34609f3d4e5d90fb38e7200a8552b7c0f76dbd2b709b
Jul 06 15:03:34.236453 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.236421    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:34.236521 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.236491    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:34.236565 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.236520    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:34.702300 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.702264    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" event={"ID":"50aeec6a-51f5-4651-be66-8ecfcd276603","Type":"ContainerStarted","Data":"fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd"}
Jul 06 15:03:34.702499 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.702317    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" event={"ID":"50aeec6a-51f5-4651-be66-8ecfcd276603","Type":"ContainerStarted","Data":"4e46ce51f67e99cb93cc34609f3d4e5d90fb38e7200a8552b7c0f76dbd2b709b"}
Jul 06 15:03:34.726504 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:34.726453    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" podStartSLOduration=1.726427799 podStartE2EDuration="1.726427799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:03:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:03:34.723683003 +0000 UTC m=+2076.115587174" watchObservedRunningTime="2026-07-06 15:03:34.726427799 +0000 UTC m=+2076.118331969"
Jul 06 15:03:35.081780 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:35.081689    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:35.086770 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:35.086738    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:35.707653 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:35.707626    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:35.708509 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:35.708488    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:38.145306 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.145280    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:03:38.187191 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187094    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-credential-socket\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187191 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187134    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-token\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187191 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187175    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-certs\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187191 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187194    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-podinfo\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187210    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-socket\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187231    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-envoy\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187258    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f84852e-f868-4b14-8439-ea8e6b399f82-istiod-ca-cert\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187281    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-data\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187348    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bk6x\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-kube-api-access-4bk6x\") pod \"7f84852e-f868-4b14-8439-ea8e6b399f82\" (UID: \"7f84852e-f868-4b14-8439-ea8e6b399f82\") "
Jul 06 15:03:38.187530 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187404    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:38.187848 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187626    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:38.187848 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187685    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.187848 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.187684    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f84852e-f868-4b14-8439-ea8e6b399f82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:03:38.188144 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.188120    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:38.188225 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.188203    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:38.189589 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.189562    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:03:38.189957 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.189935    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:03:38.190096 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.190078    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:03:38.190153 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.190101    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-kube-api-access-4bk6x" (OuterVolumeSpecName: "kube-api-access-4bk6x") pod "7f84852e-f868-4b14-8439-ea8e6b399f82" (UID: "7f84852e-f868-4b14-8439-ea8e6b399f82"). InnerVolumeSpecName "kube-api-access-4bk6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:03:38.288569 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288534    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bk6x\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-kube-api-access-4bk6x\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.288569 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288568    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.288569 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288579    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.288810 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288587    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.288810 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288595    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.288810 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288603    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.288810 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288611    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f84852e-f868-4b14-8439-ea8e6b399f82-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.288810 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.288618    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f84852e-f868-4b14-8439-ea8e6b399f82-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:03:38.726826 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.726789    2552 generic.go:356] "Generic (PLEG): container finished" podID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerID="a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78" exitCode=0
Jul 06 15:03:38.727038 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.726862    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"
Jul 06 15:03:38.727038 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.726873    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" event={"ID":"7f84852e-f868-4b14-8439-ea8e6b399f82","Type":"ContainerDied","Data":"a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78"}
Jul 06 15:03:38.727038 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.726966    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm" event={"ID":"7f84852e-f868-4b14-8439-ea8e6b399f82","Type":"ContainerDied","Data":"e806bf750ab95be2c5c49e854ae92bf57fdd22df05c1b124e3de8bc9f7eefac9"}
Jul 06 15:03:38.727038 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.727012    2552 scope.go:117] "RemoveContainer" containerID="a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78"
Jul 06 15:03:38.736806 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.736788    2552 scope.go:117] "RemoveContainer" containerID="98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3"
Jul 06 15:03:38.744980 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.744961    2552 scope.go:117] "RemoveContainer" containerID="a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78"
Jul 06 15:03:38.745291 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:03:38.745272    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78\": container with ID starting with a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78 not found: ID does not exist" containerID="a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78"
Jul 06 15:03:38.745342 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.745301    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78"} err="failed to get container status \"a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78\": rpc error: code = NotFound desc = could not find container \"a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78\": container with ID starting with a776e247f656f71dd2df477c828fd932b9f1ef0bc654bc215745f9276ed6ae78 not found: ID does not exist"
Jul 06 15:03:38.745342 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.745320    2552 scope.go:117] "RemoveContainer" containerID="98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3"
Jul 06 15:03:38.745552 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:03:38.745534    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3\": container with ID starting with 98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3 not found: ID does not exist" containerID="98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3"
Jul 06 15:03:38.745592 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.745554    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3"} err="failed to get container status \"98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3\": rpc error: code = NotFound desc = could not find container \"98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3\": container with ID starting with 98a0a96d2b5ccfb981e80b4471aadf2039cec2a9f4f1757d93439f2aac1a1ee3 not found: ID does not exist"
Jul 06 15:03:38.751572 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.751551    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"]
Jul 06 15:03:38.756807 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:38.756782    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-69ca3d-openshift-default-7bcffb855-n4knm"]
Jul 06 15:03:39.157382 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:39.157337    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" path="/var/lib/kubelet/pods/7f84852e-f868-4b14-8439-ea8e6b399f82/volumes"
Jul 06 15:03:42.133103 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.133068    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"]
Jul 06 15:03:42.133654 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.133633    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy"
Jul 06 15:03:42.133736 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.133657    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy"
Jul 06 15:03:42.133736 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.133680    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy"
Jul 06 15:03:42.133736 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.133691    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy"
Jul 06 15:03:42.133889 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.133777    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy"
Jul 06 15:03:42.133889 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.133792    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="821d0156-2744-47d6-989e-455064efe59f" containerName="istio-proxy"
Jul 06 15:03:42.136808 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.136789    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.139456 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.139434    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1da456-openshift-default-dockercfg-l6ndf\""
Jul 06 15:03:42.152869 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.152847    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"]
Jul 06 15:03:42.224061 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224021    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-podinfo\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224061 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224069    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mttrd\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-kube-api-access-mttrd\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224337 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224174    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istiod-ca-cert\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224337 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224226    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-certs\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224337 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224270    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-credential-socket\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224337 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224297    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-envoy\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224572 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224339    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-socket\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224572 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224418    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-data\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.224572 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.224444    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-token\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.324881 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.324846    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istiod-ca-cert\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325091 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.324900    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-certs\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325091 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.324918    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-credential-socket\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325091 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.324937    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-envoy\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325091 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.324955    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-socket\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325318 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325111    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-data\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325318 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325195    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-token\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325318 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325282    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-podinfo\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325318 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325310    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttrd\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-kube-api-access-mttrd\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325536 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325349    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-credential-socket\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325536 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325418    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-certs\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325646 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325542    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-socket\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325728 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325704    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istiod-ca-cert\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.325825 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.325798    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-data\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.327538 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.327514    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-envoy\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.328013 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.327964    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-podinfo\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.336801 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.336781    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mttrd\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-kube-api-access-mttrd\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.336801 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.336796    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-token\") pod \"e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") " pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.448419 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.448314    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:42.598522 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.598499    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"]
Jul 06 15:03:42.600380 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:03:42.600336    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce09d9e7_f333_41bb_bef1_aa1e330033e8.slice/crio-6b8fa8444557e04a60a6626337dae76e62034a4cb4d870026a0ea25ce67ef21e WatchSource:0}: Error finding container 6b8fa8444557e04a60a6626337dae76e62034a4cb4d870026a0ea25ce67ef21e: Status 404 returned error can't find the container with id 6b8fa8444557e04a60a6626337dae76e62034a4cb4d870026a0ea25ce67ef21e
Jul 06 15:03:42.602407 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.602372    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:42.602487 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.602435    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:42.602487 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.602466    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:42.760247 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.760143    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" event={"ID":"ce09d9e7-f333-41bb-bef1-aa1e330033e8","Type":"ContainerStarted","Data":"d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2"}
Jul 06 15:03:42.760411 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.760262    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" event={"ID":"ce09d9e7-f333-41bb-bef1-aa1e330033e8","Type":"ContainerStarted","Data":"6b8fa8444557e04a60a6626337dae76e62034a4cb4d870026a0ea25ce67ef21e"}
Jul 06 15:03:42.795598 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:42.795545    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" podStartSLOduration=0.795527691 podStartE2EDuration="795.527691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:03:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:03:42.793154066 +0000 UTC m=+2084.185058252" watchObservedRunningTime="2026-07-06 15:03:42.795527691 +0000 UTC m=+2084.187431861"
Jul 06 15:03:43.449438 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:43.449402    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:43.454649 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:43.454619    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:43.771017 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:43.770706    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:43.773116 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:43.773079    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:50.709485 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.709457    2552 patch_prober.go:28] interesting pod/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 06 15:03:50.709826 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.709516    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 06 15:03:50.817633 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.817548    2552 generic.go:356] "Generic (PLEG): container finished" podID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerID="fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd" exitCode=0
Jul 06 15:03:50.817633 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.817607    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" event={"ID":"50aeec6a-51f5-4651-be66-8ecfcd276603","Type":"ContainerDied","Data":"fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd"}
Jul 06 15:03:50.818088 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.818065    2552 scope.go:117] "RemoveContainer" containerID="fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd"
Jul 06 15:03:50.819122 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.819087    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:50.819198 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.819180    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:50.819236 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:50.819222    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:51.825517 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:51.825481    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" event={"ID":"50aeec6a-51f5-4651-be66-8ecfcd276603","Type":"ContainerStarted","Data":"bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8"}
Jul 06 15:03:52.081537 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:52.081436    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:52.081829 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:52.081560    2552 patch_prober.go:28] interesting pod/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 06 15:03:52.081982 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:52.081959    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 06 15:03:53.082469 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:53.082427    2552 patch_prober.go:28] interesting pod/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 06 15:03:53.083545 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:53.083108    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 06 15:03:54.081741 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:54.081703    2552 patch_prober.go:28] interesting pod/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 06 15:03:54.082079 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:54.082040    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 06 15:03:55.082143 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:55.082035    2552 patch_prober.go:28] interesting pod/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 06 15:03:55.082143 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:55.082122    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 06 15:03:56.085666 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:56.085632    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:56.086296 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:56.086110    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:56.086821 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:56.086799    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:03:57.860830 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:57.860748    2552 generic.go:356] "Generic (PLEG): container finished" podID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerID="d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2" exitCode=0
Jul 06 15:03:57.861274 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:57.860824    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" event={"ID":"ce09d9e7-f333-41bb-bef1-aa1e330033e8","Type":"ContainerDied","Data":"d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2"}
Jul 06 15:03:57.861342 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:57.861311    2552 scope.go:117] "RemoveContainer" containerID="d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2"
Jul 06 15:03:57.862341 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:57.862305    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:57.862436 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:57.862393    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:57.862479 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:57.862442    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:03:58.771022 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:58.770963    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:58.872911 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:58.872864    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" event={"ID":"ce09d9e7-f333-41bb-bef1-aa1e330033e8","Type":"ContainerStarted","Data":"e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8"}
Jul 06 15:03:59.449246 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:59.449205    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:03:59.450388 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:59.450366    2552 patch_prober.go:28] interesting pod/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 06 15:03:59.450451 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:03:59.450426    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 06 15:04:00.449090 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:00.449051    2552 patch_prober.go:28] interesting pod/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 06 15:04:00.449487 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:00.449114    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 06 15:04:01.449505 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:01.449464    2552 patch_prober.go:28] interesting pod/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 06 15:04:01.450023 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:01.449529    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 06 15:04:02.449673 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:02.449634    2552 patch_prober.go:28] interesting pod/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 06 15:04:02.450142 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:02.449689    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 06 15:04:03.453117 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:03.453086    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:04:03.453521 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:03.453374    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:04:03.453987 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:03.453966    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:04:05.082713 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:05.082680    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"]
Jul 06 15:04:05.083216 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:05.082885    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy" containerID="cri-o://bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8" gracePeriod=30
Jul 06 15:04:10.335078 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.335052    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:04:10.500681 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500647    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-data\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.500880 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500690    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-envoy\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.500880 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500707    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-certs\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.500880 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500740    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-token\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.500880 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500775    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgn5n\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-kube-api-access-cgn5n\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.500880 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500794    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-socket\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.500880 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500826    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50aeec6a-51f5-4651-be66-8ecfcd276603-istiod-ca-cert\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.500880 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500870    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-credential-socket\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.501261 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.500898    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-podinfo\") pod \"50aeec6a-51f5-4651-be66-8ecfcd276603\" (UID: \"50aeec6a-51f5-4651-be66-8ecfcd276603\") "
Jul 06 15:04:10.501261 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.501149    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:10.501261 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.501179    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:10.501423 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.501395    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:10.501535 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.501507    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50aeec6a-51f5-4651-be66-8ecfcd276603-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:04:10.501671 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.501548    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-data" (OuterVolumeSpecName: "istio-data") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:10.503087 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.503050    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-kube-api-access-cgn5n" (OuterVolumeSpecName: "kube-api-access-cgn5n") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "kube-api-access-cgn5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:10.503087 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.503061    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:10.503455 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.503431    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-token" (OuterVolumeSpecName: "istio-token") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:10.503529 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.503461    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50aeec6a-51f5-4651-be66-8ecfcd276603" (UID: "50aeec6a-51f5-4651-be66-8ecfcd276603"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:04:10.602673 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602633    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.602673 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602664    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.602673 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602674    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.602673 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602682    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.603098 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602690    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.603098 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602698    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.603098 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602705    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgn5n\" (UniqueName: \"kubernetes.io/projected/50aeec6a-51f5-4651-be66-8ecfcd276603-kube-api-access-cgn5n\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.603098 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602714    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50aeec6a-51f5-4651-be66-8ecfcd276603-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.603098 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.602723    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50aeec6a-51f5-4651-be66-8ecfcd276603-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:10.938488 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.938456    2552 generic.go:356] "Generic (PLEG): container finished" podID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerID="bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8" exitCode=0
Jul 06 15:04:10.938679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.938495    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" event={"ID":"50aeec6a-51f5-4651-be66-8ecfcd276603","Type":"ContainerDied","Data":"bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8"}
Jul 06 15:04:10.938679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.938506    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"
Jul 06 15:04:10.938679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.938540    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d" event={"ID":"50aeec6a-51f5-4651-be66-8ecfcd276603","Type":"ContainerDied","Data":"4e46ce51f67e99cb93cc34609f3d4e5d90fb38e7200a8552b7c0f76dbd2b709b"}
Jul 06 15:04:10.938679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.938563    2552 scope.go:117] "RemoveContainer" containerID="bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8"
Jul 06 15:04:10.948781 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.948764    2552 scope.go:117] "RemoveContainer" containerID="fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd"
Jul 06 15:04:10.960676 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.960649    2552 scope.go:117] "RemoveContainer" containerID="bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8"
Jul 06 15:04:10.961081 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:04:10.961057    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8\": container with ID starting with bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8 not found: ID does not exist" containerID="bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8"
Jul 06 15:04:10.961173 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.961090    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8"} err="failed to get container status \"bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8\": rpc error: code = NotFound desc = could not find container \"bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8\": container with ID starting with bfbad06609f20fe0f8cd0949fde5c62e0dce3bee3ebcc1f4b6fe499461f61be8 not found: ID does not exist"
Jul 06 15:04:10.961173 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.961107    2552 scope.go:117] "RemoveContainer" containerID="fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd"
Jul 06 15:04:10.961371 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:04:10.961347    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd\": container with ID starting with fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd not found: ID does not exist" containerID="fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd"
Jul 06 15:04:10.961424 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.961376    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd"} err="failed to get container status \"fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd\": rpc error: code = NotFound desc = could not find container \"fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd\": container with ID starting with fe457431ffa44042dfeefdf29c8d87d4377aa21b8b410ef6d13dce33f37b4dfd not found: ID does not exist"
Jul 06 15:04:10.963506 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.963470    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"]
Jul 06 15:04:10.965612 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:10.965594    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b5a326-openshift-default-6dd844445-84v6d"]
Jul 06 15:04:11.157118 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:11.157084    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" path="/var/lib/kubelet/pods/50aeec6a-51f5-4651-be66-8ecfcd276603/volumes"
Jul 06 15:04:12.460395 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:12.460360    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"]
Jul 06 15:04:12.461015 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:12.460606    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy" containerID="cri-o://e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8" gracePeriod=30
Jul 06 15:04:13.368485 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.365517    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"]
Jul 06 15:04:13.368485 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.366143    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy"
Jul 06 15:04:13.368485 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.366162    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy"
Jul 06 15:04:13.368485 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.366260    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy"
Jul 06 15:04:13.368485 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.366268    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy"
Jul 06 15:04:13.368485 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.366279    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f84852e-f868-4b14-8439-ea8e6b399f82" containerName="istio-proxy"
Jul 06 15:04:13.370919 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.370890    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"]
Jul 06 15:04:13.371078 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.371020    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.373282 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.373261    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-296ba3-openshift-default-dockercfg-p5nrr\""
Jul 06 15:04:13.528005 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.527965    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-socket\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528060    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-data\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528093    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-envoy\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528107    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf21237-b774-49fa-819c-1687522a9a67-istio-podinfo\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528123    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf21237-b774-49fa-819c-1687522a9a67-istiod-ca-cert\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528236    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-certs\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528264    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p952\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-kube-api-access-4p952\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528281    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-credential-socket\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.528402 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.528312    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-istio-token\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629675 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629581    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-data\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629675 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629633    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-envoy\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629675 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629651    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf21237-b774-49fa-819c-1687522a9a67-istio-podinfo\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629675 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629673    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf21237-b774-49fa-819c-1687522a9a67-istiod-ca-cert\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629981 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629761    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-certs\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629981 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629792    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p952\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-kube-api-access-4p952\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629981 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629818    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-credential-socket\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629981 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629842    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-istio-token\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.629981 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.629878    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-socket\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.630270 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.630079    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-data\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.630270 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.630208    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-certs\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.630270 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.630237    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-credential-socket\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.630671 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.630645    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf21237-b774-49fa-819c-1687522a9a67-istiod-ca-cert\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.631017 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.630979    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-socket\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.632100 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.632078    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-envoy\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.632247 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.632231    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf21237-b774-49fa-819c-1687522a9a67-istio-podinfo\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.639232 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.639204    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p952\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-kube-api-access-4p952\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.640344 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.640327    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-istio-token\") pod \"e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") " pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.681547 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.681506    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:13.825266 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.825233    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"]
Jul 06 15:04:13.828459 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:04:13.828433    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf21237_b774_49fa_819c_1687522a9a67.slice/crio-55e41dc5233b6360ec63dae643b371b71283a11a17f4443cf41722f6a70e7c3b WatchSource:0}: Error finding container 55e41dc5233b6360ec63dae643b371b71283a11a17f4443cf41722f6a70e7c3b: Status 404 returned error can't find the container with id 55e41dc5233b6360ec63dae643b371b71283a11a17f4443cf41722f6a70e7c3b
Jul 06 15:04:13.830492 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.830457    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:13.830593 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.830539    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:13.830593 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.830584    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:13.959119 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.959081    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" event={"ID":"bbf21237-b774-49fa-819c-1687522a9a67","Type":"ContainerStarted","Data":"4959965b5ee94e15df5b1ec6a50b84ef40792a8e5de7bda78684fe9fd2e2dc0e"}
Jul 06 15:04:13.959304 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:13.959144    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" event={"ID":"bbf21237-b774-49fa-819c-1687522a9a67","Type":"ContainerStarted","Data":"55e41dc5233b6360ec63dae643b371b71283a11a17f4443cf41722f6a70e7c3b"}
Jul 06 15:04:14.001071 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:14.001012    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" podStartSLOduration=1.000976424 podStartE2EDuration="1.000976424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:04:14.000123047 +0000 UTC m=+2115.392027239" watchObservedRunningTime="2026-07-06 15:04:14.000976424 +0000 UTC m=+2115.392880594"
Jul 06 15:04:14.682351 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:14.682312    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:14.687900 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:14.687876    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:14.964407 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:14.964317    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:14.965437 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:14.965421    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:17.718873 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.718841    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:04:17.872817 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.872790    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-certs\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873015 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.872833    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-podinfo\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873015 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.872874    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-token\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873015 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.872891    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istiod-ca-cert\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873015 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.872920    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mttrd\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-kube-api-access-mttrd\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873015 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.872946    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-envoy\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873317 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873040    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-socket\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873317 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873091    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:17.873317 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873112    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-credential-socket\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873317 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873187    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-data\") pod \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\" (UID: \"ce09d9e7-f333-41bb-bef1-aa1e330033e8\") "
Jul 06 15:04:17.873537 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873419    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:17.873537 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873444    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:17.873537 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873459    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:04:17.873683 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873657    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.873683 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873677    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.873772 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873690    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.873772 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.873705    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.874180 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.874156    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:17.875113 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.875094    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:17.875230 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.875212    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-kube-api-access-mttrd" (OuterVolumeSpecName: "kube-api-access-mttrd") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "kube-api-access-mttrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:04:17.875515 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.875495    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:04:17.875579 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.875544    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce09d9e7-f333-41bb-bef1-aa1e330033e8" (UID: "ce09d9e7-f333-41bb-bef1-aa1e330033e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:04:17.974669 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.974632    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mttrd\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-kube-api-access-mttrd\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.974669 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.974665    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.974669 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.974674    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.974904 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.974681    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.974904 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.974690    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce09d9e7-f333-41bb-bef1-aa1e330033e8-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:04:17.980593 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.980561    2552 generic.go:356] "Generic (PLEG): container finished" podID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerID="e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8" exitCode=0
Jul 06 15:04:17.980735 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.980605    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"
Jul 06 15:04:17.980735 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.980647    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" event={"ID":"ce09d9e7-f333-41bb-bef1-aa1e330033e8","Type":"ContainerDied","Data":"e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8"}
Jul 06 15:04:17.980735 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.980707    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb" event={"ID":"ce09d9e7-f333-41bb-bef1-aa1e330033e8","Type":"ContainerDied","Data":"6b8fa8444557e04a60a6626337dae76e62034a4cb4d870026a0ea25ce67ef21e"}
Jul 06 15:04:17.980897 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.980777    2552 scope.go:117] "RemoveContainer" containerID="e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8"
Jul 06 15:04:17.990858 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.990842    2552 scope.go:117] "RemoveContainer" containerID="d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2"
Jul 06 15:04:17.998861 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.998843    2552 scope.go:117] "RemoveContainer" containerID="e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8"
Jul 06 15:04:17.999157 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:04:17.999137    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8\": container with ID starting with e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8 not found: ID does not exist" containerID="e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8"
Jul 06 15:04:17.999216 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.999166    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8"} err="failed to get container status \"e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8\": rpc error: code = NotFound desc = could not find container \"e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8\": container with ID starting with e30bdeff2f8594e33cbae0cf45b3d59775fe84fce874feea8d1545f753eb6da8 not found: ID does not exist"
Jul 06 15:04:17.999216 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.999182    2552 scope.go:117] "RemoveContainer" containerID="d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2"
Jul 06 15:04:17.999407 ip-10-0-129-16 kubenswrapper[2552]: E0706 15:04:17.999390    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2\": container with ID starting with d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2 not found: ID does not exist" containerID="d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2"
Jul 06 15:04:17.999447 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:17.999413    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2"} err="failed to get container status \"d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2\": rpc error: code = NotFound desc = could not find container \"d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2\": container with ID starting with d077bff537616dba84a24865d48b7c7ef2c8caf74501a1aef94e6af115dfb8e2 not found: ID does not exist"
Jul 06 15:04:18.024108 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:18.024079    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"]
Jul 06 15:04:18.030916 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:18.030891    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1da456-openshift-default-5d55d7b77f-6jltb"]
Jul 06 15:04:19.157604 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:19.157567    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" path="/var/lib/kubelet/pods/ce09d9e7-f333-41bb-bef1-aa1e330033e8/volumes"
Jul 06 15:04:21.241279 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241245    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"]
Jul 06 15:04:21.241666 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241634    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy"
Jul 06 15:04:21.241666 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241645    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="50aeec6a-51f5-4651-be66-8ecfcd276603" containerName="istio-proxy"
Jul 06 15:04:21.241666 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241663    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy"
Jul 06 15:04:21.241774 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241671    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy"
Jul 06 15:04:21.241774 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241681    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy"
Jul 06 15:04:21.241774 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241687    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy"
Jul 06 15:04:21.241774 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241750    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy"
Jul 06 15:04:21.241774 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.241757    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce09d9e7-f333-41bb-bef1-aa1e330033e8" containerName="istio-proxy"
Jul 06 15:04:21.244635 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.244614    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.247445 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.247423    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c7737a-openshift-default-dockercfg-gvp9h\""
Jul 06 15:04:21.269224 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.269192    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"]
Jul 06 15:04:21.303715 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.303680    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-socket\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.303919 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.303727    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjmft\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-kube-api-access-gjmft\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.303919 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.303823    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-envoy\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.303919 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.303872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-podinfo\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.303919 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.303897    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54e64839-e05a-45f5-a7b1-7244d00f4e68-istiod-ca-cert\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.304179 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.303939    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-credential-socket\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.304179 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.303979    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-certs\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.304179 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.304012    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-data\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.304179 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.304042    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-token\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.404979 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.404942    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-credential-socket\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405205 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405035    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-certs\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405205 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405060    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-data\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405205 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405103    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-token\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405205 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405159    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-socket\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405443 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405206    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjmft\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-kube-api-access-gjmft\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405443 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405271    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-envoy\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405443 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405314    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-podinfo\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405443 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405340    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54e64839-e05a-45f5-a7b1-7244d00f4e68-istiod-ca-cert\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405650 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405552    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-credential-socket\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405650 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405596    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-socket\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405650 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405638    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-data\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.405815 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.405744    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-certs\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.406176 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.406152    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54e64839-e05a-45f5-a7b1-7244d00f4e68-istiod-ca-cert\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.407710 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.407682    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-envoy\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.407889 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.407871    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-podinfo\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.424683 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.424654    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-token\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.424898 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.424877    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjmft\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-kube-api-access-gjmft\") pod \"e2e-shared-b-c7737a-openshift-default-764754b855-b848f\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") " pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.555514 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.555416    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:21.740852 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.740819    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"]
Jul 06 15:04:21.744090 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:04:21.744057    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e64839_e05a_45f5_a7b1_7244d00f4e68.slice/crio-ebe7a78332750d5a5856ef020da7ac55efca28664be3a63f95d383b8f1bb0364 WatchSource:0}: Error finding container ebe7a78332750d5a5856ef020da7ac55efca28664be3a63f95d383b8f1bb0364: Status 404 returned error can't find the container with id ebe7a78332750d5a5856ef020da7ac55efca28664be3a63f95d383b8f1bb0364
Jul 06 15:04:21.746213 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.746177    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:21.746311 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.746287    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:21.746381 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:21.746335    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:22.003902 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:22.003864    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" event={"ID":"54e64839-e05a-45f5-a7b1-7244d00f4e68","Type":"ContainerStarted","Data":"2d769f559bc2e5492e7d7d3b2bdd0919295cd613dbf93e09577cfbfaea646b56"}
Jul 06 15:04:22.004088 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:22.003921    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" event={"ID":"54e64839-e05a-45f5-a7b1-7244d00f4e68","Type":"ContainerStarted","Data":"ebe7a78332750d5a5856ef020da7ac55efca28664be3a63f95d383b8f1bb0364"}
Jul 06 15:04:22.028758 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:22.028695    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" podStartSLOduration=1.028672154 podStartE2EDuration="1.028672154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:04:22.027424861 +0000 UTC m=+2123.419329033" watchObservedRunningTime="2026-07-06 15:04:22.028672154 +0000 UTC m=+2123.420576326"
Jul 06 15:04:22.558254 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:22.558209    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:22.566602 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:22.566560    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:23.009841 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:23.009811    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:23.010780 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:23.010763    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:29.044778 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:29.044676    2552 generic.go:356] "Generic (PLEG): container finished" podID="bbf21237-b774-49fa-819c-1687522a9a67" containerID="4959965b5ee94e15df5b1ec6a50b84ef40792a8e5de7bda78684fe9fd2e2dc0e" exitCode=0
Jul 06 15:04:29.044778 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:29.044752    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" event={"ID":"bbf21237-b774-49fa-819c-1687522a9a67","Type":"ContainerDied","Data":"4959965b5ee94e15df5b1ec6a50b84ef40792a8e5de7bda78684fe9fd2e2dc0e"}
Jul 06 15:04:29.045322 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:29.045197    2552 scope.go:117] "RemoveContainer" containerID="4959965b5ee94e15df5b1ec6a50b84ef40792a8e5de7bda78684fe9fd2e2dc0e"
Jul 06 15:04:29.046261 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:29.046225    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:29.046374 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:29.046296    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:29.046374 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:29.046328    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:29.964895 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:29.964851    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:30.052684 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:30.052649    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" event={"ID":"bbf21237-b774-49fa-819c-1687522a9a67","Type":"ContainerStarted","Data":"a0222d824c7713aaba142f8b85c8ed060ac02e53f3f517125ea5a64c4e820c66"}
Jul 06 15:04:30.683719 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:30.683684    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:30.684113 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:30.684088    2552 patch_prober.go:28] interesting pod/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 06 15:04:30.684291 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:30.684268    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 06 15:04:31.682376 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:31.682334    2552 patch_prober.go:28] interesting pod/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 06 15:04:31.683392 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:31.682945    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 06 15:04:32.682934 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:32.682893    2552 patch_prober.go:28] interesting pod/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 06 15:04:32.683555 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:32.683520    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 06 15:04:33.685038 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:33.682798    2552 patch_prober.go:28] interesting pod/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 06 15:04:33.685038 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:33.682872    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 06 15:04:34.686605 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:34.686569    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:34.687125 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:34.686959    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:34.687671 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:34.687652    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:04:36.103230 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:36.103143    2552 generic.go:356] "Generic (PLEG): container finished" podID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerID="2d769f559bc2e5492e7d7d3b2bdd0919295cd613dbf93e09577cfbfaea646b56" exitCode=0
Jul 06 15:04:36.103748 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:36.103236    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" event={"ID":"54e64839-e05a-45f5-a7b1-7244d00f4e68","Type":"ContainerDied","Data":"2d769f559bc2e5492e7d7d3b2bdd0919295cd613dbf93e09577cfbfaea646b56"}
Jul 06 15:04:36.103818 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:36.103791    2552 scope.go:117] "RemoveContainer" containerID="2d769f559bc2e5492e7d7d3b2bdd0919295cd613dbf93e09577cfbfaea646b56"
Jul 06 15:04:36.104762 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:36.104733    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:36.104855 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:36.104798    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:36.104855 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:36.104831    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 15:04:37.109850 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:37.109814    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" event={"ID":"54e64839-e05a-45f5-a7b1-7244d00f4e68","Type":"ContainerStarted","Data":"3bfbeb05faa7e9a9d1a9c8cb2befa519def1352c829f0985145cd9f9c544daf0"}
Jul 06 15:04:37.557587 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:37.557537    2552 patch_prober.go:28] interesting pod/e2e-shared-b-c7737a-openshift-default-764754b855-b848f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 06 15:04:37.557811 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:37.557623    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 06 15:04:37.557959 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:37.557934    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:38.010312 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:38.010272    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:38.556699 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:38.556658    2552 patch_prober.go:28] interesting pod/e2e-shared-b-c7737a-openshift-default-764754b855-b848f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 06 15:04:38.557339 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:38.557295    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 06 15:04:39.561754 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:39.561702    2552 patch_prober.go:28] interesting pod/e2e-shared-b-c7737a-openshift-default-764754b855-b848f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 06 15:04:39.562312 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:39.561788    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 06 15:04:40.555829 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:40.555792    2552 patch_prober.go:28] interesting pod/e2e-shared-b-c7737a-openshift-default-764754b855-b848f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 06 15:04:40.556073 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:40.555860    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 06 15:04:41.559952 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:41.559913    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:04:41.561040 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:04:41.561017    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:11:15.082351 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:15.082302    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"]
Jul 06 15:11:15.082861 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:15.082615    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy" containerID="cri-o://a0222d824c7713aaba142f8b85c8ed060ac02e53f3f517125ea5a64c4e820c66" gracePeriod=30
Jul 06 15:11:19.689171 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:19.689120    2552 patch_prober.go:28] interesting pod/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 15:11:19.689577 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:19.689209    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 15:11:20.265417 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.265381    2552 generic.go:356] "Generic (PLEG): container finished" podID="bbf21237-b774-49fa-819c-1687522a9a67" containerID="a0222d824c7713aaba142f8b85c8ed060ac02e53f3f517125ea5a64c4e820c66" exitCode=0
Jul 06 15:11:20.265619 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.265454    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" event={"ID":"bbf21237-b774-49fa-819c-1687522a9a67","Type":"ContainerDied","Data":"a0222d824c7713aaba142f8b85c8ed060ac02e53f3f517125ea5a64c4e820c66"}
Jul 06 15:11:20.265619 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.265513    2552 scope.go:117] "RemoveContainer" containerID="4959965b5ee94e15df5b1ec6a50b84ef40792a8e5de7bda78684fe9fd2e2dc0e"
Jul 06 15:11:20.345395 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.345329    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:11:20.409480 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409450    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-istio-token\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.409679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409506    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf21237-b774-49fa-819c-1687522a9a67-istiod-ca-cert\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.409679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409531    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p952\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-kube-api-access-4p952\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.409679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409551    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf21237-b774-49fa-819c-1687522a9a67-istio-podinfo\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.409679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409584    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-socket\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.409679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409604    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-credential-socket\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.409679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409653    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-data\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.409679 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409675    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-envoy\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.410224 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409713    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-certs\") pod \"bbf21237-b774-49fa-819c-1687522a9a67\" (UID: \"bbf21237-b774-49fa-819c-1687522a9a67\") "
Jul 06 15:11:20.410224 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.409897    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:20.410224 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.410019    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf21237-b774-49fa-819c-1687522a9a67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:11:20.410224 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.410063    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.410224 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.410149    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:20.410224 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.410168    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:20.411078 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.411048    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-data" (OuterVolumeSpecName: "istio-data") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:20.412030 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.411982    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbf21237-b774-49fa-819c-1687522a9a67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:11:20.412194 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.412159    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:20.412305 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.412254    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-istio-token" (OuterVolumeSpecName: "istio-token") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:11:20.412418 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.412396    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-kube-api-access-4p952" (OuterVolumeSpecName: "kube-api-access-4p952") pod "bbf21237-b774-49fa-819c-1687522a9a67" (UID: "bbf21237-b774-49fa-819c-1687522a9a67"). InnerVolumeSpecName "kube-api-access-4p952". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:11:20.510460 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510424    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.510460 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510454    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.510460 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510463    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.510700 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510472    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.510700 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510481    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf21237-b774-49fa-819c-1687522a9a67-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.510700 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510489    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p952\" (UniqueName: \"kubernetes.io/projected/bbf21237-b774-49fa-819c-1687522a9a67-kube-api-access-4p952\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.510700 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510499    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf21237-b774-49fa-819c-1687522a9a67-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:20.510700 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:20.510508    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf21237-b774-49fa-819c-1687522a9a67-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:21.271926 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:21.271895    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"
Jul 06 15:11:21.272367 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:21.271934    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc" event={"ID":"bbf21237-b774-49fa-819c-1687522a9a67","Type":"ContainerDied","Data":"55e41dc5233b6360ec63dae643b371b71283a11a17f4443cf41722f6a70e7c3b"}
Jul 06 15:11:21.272367 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:21.272019    2552 scope.go:117] "RemoveContainer" containerID="a0222d824c7713aaba142f8b85c8ed060ac02e53f3f517125ea5a64c4e820c66"
Jul 06 15:11:21.310395 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:21.310359    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"]
Jul 06 15:11:21.316078 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:21.316048    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-296ba3-openshift-default-849465c8d7-8g7rc"]
Jul 06 15:11:23.156126 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:23.156088    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf21237-b774-49fa-819c-1687522a9a67" path="/var/lib/kubelet/pods/bbf21237-b774-49fa-819c-1687522a9a67/volumes"
Jul 06 15:11:25.161026 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:25.160955    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"]
Jul 06 15:11:25.161536 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:25.161298    2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy" containerID="cri-o://3bfbeb05faa7e9a9d1a9c8cb2befa519def1352c829f0985145cd9f9c544daf0" gracePeriod=30
Jul 06 15:11:26.562614 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:26.562572    2552 patch_prober.go:28] interesting pod/e2e-shared-b-c7737a-openshift-default-764754b855-b848f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 15:11:26.563027 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:26.562636    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 15:11:30.328411 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.328376    2552 generic.go:356] "Generic (PLEG): container finished" podID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerID="3bfbeb05faa7e9a9d1a9c8cb2befa519def1352c829f0985145cd9f9c544daf0" exitCode=0
Jul 06 15:11:30.328828 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.328434    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" event={"ID":"54e64839-e05a-45f5-a7b1-7244d00f4e68","Type":"ContainerDied","Data":"3bfbeb05faa7e9a9d1a9c8cb2befa519def1352c829f0985145cd9f9c544daf0"}
Jul 06 15:11:30.328828 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.328489    2552 scope.go:117] "RemoveContainer" containerID="2d769f559bc2e5492e7d7d3b2bdd0919295cd613dbf93e09577cfbfaea646b56"
Jul 06 15:11:30.423622 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.423548    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:11:30.510899 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.510859    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-credential-socket\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511094 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.510923    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-socket\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511094 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.510959    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-certs\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511094 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511018    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-token\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511094 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511052    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-envoy\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511094 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511085    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54e64839-e05a-45f5-a7b1-7244d00f4e68-istiod-ca-cert\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511357 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511130    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjmft\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-kube-api-access-gjmft\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511357 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511209    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-data\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511357 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511241    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-podinfo\") pod \"54e64839-e05a-45f5-a7b1-7244d00f4e68\" (UID: \"54e64839-e05a-45f5-a7b1-7244d00f4e68\") "
Jul 06 15:11:30.511357 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511249    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:30.511357 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511283    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:30.511357 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511327    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:30.511668 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511556    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-credential-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.511668 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511552    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54e64839-e05a-45f5-a7b1-7244d00f4e68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 15:11:30.511668 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511576    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-socket\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.511668 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.511593    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-workload-certs\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.512108 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.512084    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-data" (OuterVolumeSpecName: "istio-data") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:30.513429 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.513392    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-token" (OuterVolumeSpecName: "istio-token") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:11:30.513547 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.513507    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 15:11:30.513802 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.513782    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 15:11:30.513875 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.513820    2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-kube-api-access-gjmft" (OuterVolumeSpecName: "kube-api-access-gjmft") pod "54e64839-e05a-45f5-a7b1-7244d00f4e68" (UID: "54e64839-e05a-45f5-a7b1-7244d00f4e68"). InnerVolumeSpecName "kube-api-access-gjmft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:11:30.612469 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.612429    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-token\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.612469 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.612463    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-envoy\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.612469 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.612472    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54e64839-e05a-45f5-a7b1-7244d00f4e68-istiod-ca-cert\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.612732 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.612482    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjmft\" (UniqueName: \"kubernetes.io/projected/54e64839-e05a-45f5-a7b1-7244d00f4e68-kube-api-access-gjmft\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.612732 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.612492    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-data\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:30.612732 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:30.612500    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54e64839-e05a-45f5-a7b1-7244d00f4e68-istio-podinfo\") on node \"ip-10-0-129-16.ec2.internal\" DevicePath \"\""
Jul 06 15:11:31.076390 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.076359    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6kzmq_1ff7c272-9326-4af9-93a7-dc9134cd0eb8/manager/0.log"
Jul 06 15:11:31.213253 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.213217    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gtbpt_e7bd10b1-15aa-4ec7-81ad-b671dfaa7834/manager/0.log"
Jul 06 15:11:31.335633 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.335546    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"
Jul 06 15:11:31.335633 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.335578    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f" event={"ID":"54e64839-e05a-45f5-a7b1-7244d00f4e68","Type":"ContainerDied","Data":"ebe7a78332750d5a5856ef020da7ac55efca28664be3a63f95d383b8f1bb0364"}
Jul 06 15:11:31.335633 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.335629    2552 scope.go:117] "RemoveContainer" containerID="3bfbeb05faa7e9a9d1a9c8cb2befa519def1352c829f0985145cd9f9c544daf0"
Jul 06 15:11:31.364462 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.364431    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8755677bc-kb92r_499e2ad9-7b0a-48f0-857c-5b0a6515a640/maas-api/0.log"
Jul 06 15:11:31.383916 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.383879    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"]
Jul 06 15:11:31.392047 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.392017    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c7737a-openshift-default-764754b855-b848f"]
Jul 06 15:11:31.908459 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:31.908432    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6xr5x_3c92373a-29fa-42e2-9985-b189d2b94e98/server/0.log"
Jul 06 15:11:32.042123 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:32.042084    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bzzzn_dd9f07f0-2cbf-4f66-bba7-7a0df2269193/manager/0.log"
Jul 06 15:11:32.164750 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:32.164673    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-4fk6z_6b52e350-87d6-4e0d-a61f-da90e1da9218/copy-manifests/0.log"
Jul 06 15:11:32.180317 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:32.180280    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-4fk6z_6b52e350-87d6-4e0d-a61f-da90e1da9218/manager/0.log"
Jul 06 15:11:32.558666 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:32.558585    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ndk2b_655f0294-7c22-42a9-a186-2eb808095b05/postgres/0.log"
Jul 06 15:11:33.157153 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.157122    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" path="/var/lib/kubelet/pods/54e64839-e05a-45f5-a7b1-7244d00f4e68/volumes"
Jul 06 15:11:33.365744 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.365707    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5_2976a7f8-ff3d-4289-b2a4-86b84d078b42/extract/0.log"
Jul 06 15:11:33.380481 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.380452    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5_2976a7f8-ff3d-4289-b2a4-86b84d078b42/util/0.log"
Jul 06 15:11:33.390463 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.390410    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5_2976a7f8-ff3d-4289-b2a4-86b84d078b42/pull/0.log"
Jul 06 15:11:33.511602 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.511522    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs_1ad4a287-2dbf-4da1-a319-1c6d319e3887/util/0.log"
Jul 06 15:11:33.521368 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.521339    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs_1ad4a287-2dbf-4da1-a319-1c6d319e3887/pull/0.log"
Jul 06 15:11:33.530479 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.530454    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs_1ad4a287-2dbf-4da1-a319-1c6d319e3887/extract/0.log"
Jul 06 15:11:33.650122 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.650097    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l_aa8f22d8-4852-43ad-a871-71460c0afa6b/util/0.log"
Jul 06 15:11:33.659531 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.659503    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l_aa8f22d8-4852-43ad-a871-71460c0afa6b/pull/0.log"
Jul 06 15:11:33.668537 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.668511    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l_aa8f22d8-4852-43ad-a871-71460c0afa6b/extract/0.log"
Jul 06 15:11:33.787983 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.787899    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv_eb97162d-97f7-4fb0-b09e-5bdd947c81ec/util/0.log"
Jul 06 15:11:33.796783 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.796754    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv_eb97162d-97f7-4fb0-b09e-5bdd947c81ec/pull/0.log"
Jul 06 15:11:33.806762 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:33.806738    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv_eb97162d-97f7-4fb0-b09e-5bdd947c81ec/extract/0.log"
Jul 06 15:11:34.067682 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:34.067603    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8hd28_e29303ab-392d-4f8e-b469-0ae47387f2ec/manager/0.log"
Jul 06 15:11:34.184417 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:34.184387    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgmbf_3c4cf28f-40ab-498c-807f-ca59a7686538/manager/0.log"
Jul 06 15:11:34.437686 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:34.437649    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vhghf_19e611be-66e2-47ce-810e-c0f0820e35f2/registry-server/0.log"
Jul 06 15:11:34.575336 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:34.575298    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pz4dx_25ccd65d-6a72-4de1-a82c-847e5fada9e6/manager/0.log"
Jul 06 15:11:35.249011 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:35.248970    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46g7z5_fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55/istio-proxy/0.log"
Jul 06 15:11:35.525015 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:35.524900    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-btbv5_a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4/kube-auth-proxy/0.log"
Jul 06 15:11:35.805674 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:35.805589    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ndwvw_edaf42e8-85d0-4ceb-a293-b5ec27587994/istio-proxy/1.log"
Jul 06 15:11:35.952428 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:35.952394    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h8m6j_8bfa84da-faca-43ca-a13f-088b103a5efe/payload-pre-processing/0.log"
Jul 06 15:11:36.683907 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:36.683871    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-24whv_01be8453-deef-4c50-942a-bdd62d8e479c/main/0.log"
Jul 06 15:11:36.940837 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:36.940745    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4vzjq_10bd2eae-618e-4d3f-880c-6f73d6319263/main/0.log"
Jul 06 15:11:37.320295 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:37.320209    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ltsj9_8ddd8aef-d6c6-4799-abfd-17e4aa14db01/main/0.log"
Jul 06 15:11:45.067739 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:45.067702    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8qdkn_43ce7d1a-cd99-45d8-afc9-69a798e2ed0a/global-pull-secret-syncer/0.log"
Jul 06 15:11:45.426035 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:45.425984    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-px7r2_aa755821-0449-42ea-a144-fe316765c7ce/konnectivity-agent/0.log"
Jul 06 15:11:45.461207 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:45.461169    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-16.ec2.internal_95122f1faf395ac2f8128358b45aeb4e/haproxy/0.log"
Jul 06 15:11:49.225266 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.225228    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5_2976a7f8-ff3d-4289-b2a4-86b84d078b42/extract/0.log"
Jul 06 15:11:49.299209 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.299179    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5_2976a7f8-ff3d-4289-b2a4-86b84d078b42/util/0.log"
Jul 06 15:11:49.349746 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.349713    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7597jhq5_2976a7f8-ff3d-4289-b2a4-86b84d078b42/pull/0.log"
Jul 06 15:11:49.395308 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.395270    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs_1ad4a287-2dbf-4da1-a319-1c6d319e3887/extract/0.log"
Jul 06 15:11:49.441324 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.441295    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs_1ad4a287-2dbf-4da1-a319-1c6d319e3887/util/0.log"
Jul 06 15:11:49.494926 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.494844    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tgdbs_1ad4a287-2dbf-4da1-a319-1c6d319e3887/pull/0.log"
Jul 06 15:11:49.530968 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.530937    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l_aa8f22d8-4852-43ad-a871-71460c0afa6b/extract/0.log"
Jul 06 15:11:49.563975 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.563942    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l_aa8f22d8-4852-43ad-a871-71460c0afa6b/util/0.log"
Jul 06 15:11:49.596385 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.596357    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c6s8l_aa8f22d8-4852-43ad-a871-71460c0afa6b/pull/0.log"
Jul 06 15:11:49.642830 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.642804    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv_eb97162d-97f7-4fb0-b09e-5bdd947c81ec/extract/0.log"
Jul 06 15:11:49.681722 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.681685    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv_eb97162d-97f7-4fb0-b09e-5bdd947c81ec/util/0.log"
Jul 06 15:11:49.720746 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:49.720715    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tp5hv_eb97162d-97f7-4fb0-b09e-5bdd947c81ec/pull/0.log"
Jul 06 15:11:50.168805 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:50.168774    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8hd28_e29303ab-392d-4f8e-b469-0ae47387f2ec/manager/0.log"
Jul 06 15:11:50.212386 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:50.212351    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgmbf_3c4cf28f-40ab-498c-807f-ca59a7686538/manager/0.log"
Jul 06 15:11:50.329272 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:50.329230    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vhghf_19e611be-66e2-47ce-810e-c0f0820e35f2/registry-server/0.log"
Jul 06 15:11:50.525543 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:50.525410    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pz4dx_25ccd65d-6a72-4de1-a82c-847e5fada9e6/manager/0.log"
Jul 06 15:11:53.272024 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:53.271963    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2g7pn_9d4c379a-b880-4993-989a-68d218366d6b/node-exporter/0.log"
Jul 06 15:11:53.326763 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:53.326720    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2g7pn_9d4c379a-b880-4993-989a-68d218366d6b/kube-rbac-proxy/0.log"
Jul 06 15:11:53.378526 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:53.378497    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2g7pn_9d4c379a-b880-4993-989a-68d218366d6b/init-textfile/0.log"
Jul 06 15:11:54.302011 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.301968    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f5699db6-ggnrs_6b5be752-9ed5-4b00-9e36-e36303dd188b/telemeter-client/0.log"
Jul 06 15:11:54.340107 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.340078    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f5699db6-ggnrs_6b5be752-9ed5-4b00-9e36-e36303dd188b/reload/0.log"
Jul 06 15:11:54.375555 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.375525    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f5699db6-ggnrs_6b5be752-9ed5-4b00-9e36-e36303dd188b/kube-rbac-proxy/0.log"
Jul 06 15:11:54.936593 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.936553    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"]
Jul 06 15:11:54.936933 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.936920    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy"
Jul 06 15:11:54.936977 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.936934    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy"
Jul 06 15:11:54.936977 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.936946    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy"
Jul 06 15:11:54.936977 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.936951    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy"
Jul 06 15:11:54.936977 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.936963    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy"
Jul 06 15:11:54.936977 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.936969    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy"
Jul 06 15:11:54.937152 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.937047    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf21237-b774-49fa-819c-1687522a9a67" containerName="istio-proxy"
Jul 06 15:11:54.937152 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.937057    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy"
Jul 06 15:11:54.937152 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.937064    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e64839-e05a-45f5-a7b1-7244d00f4e68" containerName="istio-proxy"
Jul 06 15:11:54.940389 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.940367    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:54.942324 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.942304    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2bspv\"/\"default-dockercfg-gn9kj\""
Jul 06 15:11:54.942434 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.942379    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2bspv\"/\"openshift-service-ca.crt\""
Jul 06 15:11:54.942947 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.942932    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2bspv\"/\"kube-root-ca.crt\""
Jul 06 15:11:54.956057 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:54.956029    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"]
Jul 06 15:11:55.048501 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.048457    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-sys\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.048501 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.048496    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-proc\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.048765 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.048516    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-lib-modules\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.048765 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.048618    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88mx2\" (UniqueName: \"kubernetes.io/projected/8d40c944-5f1e-45ef-88af-690506164cb3-kube-api-access-88mx2\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.048765 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.048664    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-podres\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150084 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150049    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88mx2\" (UniqueName: \"kubernetes.io/projected/8d40c944-5f1e-45ef-88af-690506164cb3-kube-api-access-88mx2\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150258 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150111    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-podres\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150258 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150231    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-sys\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150257    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-proc\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150278    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-lib-modules\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150279    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-podres\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150326    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-proc\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150399 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150328    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-sys\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.150564 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.150454    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d40c944-5f1e-45ef-88af-690506164cb3-lib-modules\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.162775 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.162740    2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88mx2\" (UniqueName: \"kubernetes.io/projected/8d40c944-5f1e-45ef-88af-690506164cb3-kube-api-access-88mx2\") pod \"perf-node-gather-daemonset-fwlxj\" (UID: \"8d40c944-5f1e-45ef-88af-690506164cb3\") " pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.250566 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.250479    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.395452 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.395418    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"]
Jul 06 15:11:55.397479 ip-10-0-129-16 kubenswrapper[2552]: W0706 15:11:55.397450    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d40c944_5f1e_45ef_88af_690506164cb3.slice/crio-0f29c570d3143ad37f9c8af4f9d978223f462a2dc1c287c7990362490edb8225 WatchSource:0}: Error finding container 0f29c570d3143ad37f9c8af4f9d978223f462a2dc1c287c7990362490edb8225: Status 404 returned error can't find the container with id 0f29c570d3143ad37f9c8af4f9d978223f462a2dc1c287c7990362490edb8225
Jul 06 15:11:55.475819 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.475787    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj" event={"ID":"8d40c944-5f1e-45ef-88af-690506164cb3","Type":"ContainerStarted","Data":"e6c258adc70af592eebc9d824b08c333ad7842046a393f3a5f241b3f236dc2ed"}
Jul 06 15:11:55.475977 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.475841    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj" event={"ID":"8d40c944-5f1e-45ef-88af-690506164cb3","Type":"ContainerStarted","Data":"0f29c570d3143ad37f9c8af4f9d978223f462a2dc1c287c7990362490edb8225"}
Jul 06 15:11:55.475977 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.475920    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:11:55.497057 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.496981    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj" podStartSLOduration=1.49696387 podStartE2EDuration="1.49696387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:11:55.495113377 +0000 UTC m=+2576.887017562" watchObservedRunningTime="2026-07-06 15:11:55.49696387 +0000 UTC m=+2576.888868041"
Jul 06 15:11:55.846911 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:55.846881    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-944dh_c7cf1e93-64da-439c-ae08-6fa95a400593/networking-console-plugin/0.log"
Jul 06 15:11:57.146620 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:57.146588    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b7458b866-mb8xc_089816a4-dc47-48ce-b18f-e15a7e9e0d51/console/0.log"
Jul 06 15:11:59.464240 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:59.464210    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v988b_868f2401-21e0-4ee8-bd66-fa7561b414c3/dns/0.log"
Jul 06 15:11:59.496916 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:59.496878    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v988b_868f2401-21e0-4ee8-bd66-fa7561b414c3/kube-rbac-proxy/0.log"
Jul 06 15:11:59.529088 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:11:59.529061    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9b68v_327b6d93-f9b6-4efb-a52b-0ee9eb63b66a/dns-node-resolver/0.log"
Jul 06 15:12:00.364627 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:00.364588    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xjr22_e5810c04-5477-4007-9115-39679b16373e/node-ca/0.log"
Jul 06 15:12:01.491154 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:01.491124    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2bspv/perf-node-gather-daemonset-fwlxj"
Jul 06 15:12:01.614716 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:01.614687    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46g7z5_fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55/istio-proxy/0.log"
Jul 06 15:12:01.755666 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:01.755569    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-btbv5_a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4/kube-auth-proxy/0.log"
Jul 06 15:12:01.837298 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:01.837242    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ndwvw_edaf42e8-85d0-4ceb-a293-b5ec27587994/istio-proxy/0.log"
Jul 06 15:12:01.891120 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:01.891083    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ndwvw_edaf42e8-85d0-4ceb-a293-b5ec27587994/istio-proxy/1.log"
Jul 06 15:12:01.944159 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:01.944128    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h8m6j_8bfa84da-faca-43ca-a13f-088b103a5efe/payload-pre-processing/0.log"
Jul 06 15:12:02.906983 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:02.906944    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzk4z_b0078455-d25b-4421-ad36-8b60697475bc/serve-healthcheck-canary/0.log"
Jul 06 15:12:03.954037 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:03.953938    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qh4zv_8e93ea80-81cd-4b78-b9f2-4960fa75bbda/kube-rbac-proxy/0.log"
Jul 06 15:12:04.074986 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:04.074956    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qh4zv_8e93ea80-81cd-4b78-b9f2-4960fa75bbda/exporter/0.log"
Jul 06 15:12:04.120149 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:04.120106    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qh4zv_8e93ea80-81cd-4b78-b9f2-4960fa75bbda/extractor/0.log"
Jul 06 15:12:05.086260 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:05.086227    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46g7z5_fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55/istio-proxy/0.log"
Jul 06 15:12:05.211371 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:05.211339    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-btbv5_a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4/kube-auth-proxy/0.log"
Jul 06 15:12:05.268806 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:05.268766    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ndwvw_edaf42e8-85d0-4ceb-a293-b5ec27587994/istio-proxy/0.log"
Jul 06 15:12:05.323320 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:05.323284    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ndwvw_edaf42e8-85d0-4ceb-a293-b5ec27587994/istio-proxy/1.log"
Jul 06 15:12:05.356724 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:05.356687    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h8m6j_8bfa84da-faca-43ca-a13f-088b103a5efe/payload-pre-processing/0.log"
Jul 06 15:12:06.703908 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:06.703874    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46g7z5_fc29c286-cc07-4fe7-b54c-a6cb2bbeaf55/istio-proxy/0.log"
Jul 06 15:12:06.803203 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:06.803159    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6kzmq_1ff7c272-9326-4af9-93a7-dc9134cd0eb8/manager/0.log"
Jul 06 15:12:06.857649 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:06.857619    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855f944d48-btbv5_a7a3e8a7-3d9a-4792-a89e-75ec83b8baf4/kube-auth-proxy/0.log"
Jul 06 15:12:06.936060 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:06.935916    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ndwvw_edaf42e8-85d0-4ceb-a293-b5ec27587994/istio-proxy/0.log"
Jul 06 15:12:07.003208 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.003171    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ndwvw_edaf42e8-85d0-4ceb-a293-b5ec27587994/istio-proxy/1.log"
Jul 06 15:12:07.047246 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.047218    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gtbpt_e7bd10b1-15aa-4ec7-81ad-b671dfaa7834/manager/0.log"
Jul 06 15:12:07.140544 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.140509    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h8m6j_8bfa84da-faca-43ca-a13f-088b103a5efe/payload-pre-processing/0.log"
Jul 06 15:12:07.220035 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.219924    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8755677bc-kb92r_499e2ad9-7b0a-48f0-857c-5b0a6515a640/maas-api/0.log"
Jul 06 15:12:07.496464 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.496372    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6xr5x_3c92373a-29fa-42e2-9985-b189d2b94e98/server/0.log"
Jul 06 15:12:07.626935 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.626899    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bzzzn_dd9f07f0-2cbf-4f66-bba7-7a0df2269193/manager/0.log"
Jul 06 15:12:07.677946 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.677908    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-4fk6z_6b52e350-87d6-4e0d-a61f-da90e1da9218/manager/0.log"
Jul 06 15:12:07.711389 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.711364    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75545b5d88-4fk6z_6b52e350-87d6-4e0d-a61f-da90e1da9218/copy-manifests/0.log"
Jul 06 15:12:07.964110 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:07.964071    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ndk2b_655f0294-7c22-42a9-a186-2eb808095b05/postgres/0.log"
Jul 06 15:12:09.404339 ip-10-0-129-16 kubenswrapper[2552]: I0706 15:12:09.404305    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-c8srg_7e42a6e4-cd23-467a-948b-5441161a756c/openshift-lws-operator/0.log"